This is an unpleasant experience.
I had set the run levels using systemctl and when I used systemctl get-default to check, it indeed is set to graphical target.
To confirm if after reboot the setting persist, I rebooted the first app server. After reboot, the server did not came up as ping did not reply.(I waited for about 5 mins) I think KodeCloud should fix this issue.
While I thought that I had completed this task successfully, if there is a limitation that server should not be rebooted it should be stated as well.