OpenPBS won't start

Hi,

I have an OpenPBS server that won’t start. I have looked at the server_logs and comm_logs and they look ok, but PBS dataservice seems to stop itself. Are there any other logs to see why PBS dataservice is stopping itself?

I have tried to add PBS_Leaf_Name to the /etc/pbs.conf and have it resolve to only the internal network. It seems like pbs_comm still picks up the external interface. Could that be a cause of the issue? Or could it be something else?

Server_Logs shows:
Registering address 10.1.0.251:15001 to pbs_comm pbs-server:17001
Connected to pbs_comm pbs-server:17001
Stopping PBS dataservice

Comm_Logs shows:
(Thread 0); Thread ready
(Thread 1); Thread ready
(Thread 2); Thread ready
(Thread 3); Thread ready
Leaf registered address 10.1.0.251:15001
Leaf registered address 1xx.xxx.xxx.xxx:15001
Connection from leaf 10.1.0.251:15001 down

Please check these pre-requisites

Thanks for the pointer! Selinux and Firewall are good.

If I am starting PBS ‘/etc/init.d/pbs’ start on the headnode only, does firewall come into play?
I have not gotten to the point to set up the execution node yet.

Yes, it would require 15001-15009 and 17001 to be open for communication.

Looking into the pbs_dataservice logs and it shows that it received fast shutdown request.

/etc/init.d/pbs start, during the start, it looks like dataservice does come up and is ready to accept connections, but something is making it shutdown and then pbs_server will not start and stops.

2022-09-09 15:53:29.545 EDT [2412586] LOG: database system was shut down at 2022-09-08 10:28:32 EDT
2022-09-09 15:53:29.547 EDT [2412581] LOG: database system is ready to accept connections
2022-09-09 15:53:32.834 EDT [2412581] LOG: received fast shutdown request
2022-09-09 15:53:32.835 EDT [2412581] LOG: aborting any active transactions
2022-09-09 15:53:32.836 EDT [2412581] LOG: worker process: logical replication launcher (PID 2412596) exited with exit code 1
2022-09-09 15:53:32.837 EDT [2412587] LOG: shutting down
2022-09-09 15:53:32.842 EDT [2412581] LOG: database system is shut down

I’ve looked in the comm_logs and the server_logs, but everything looks normal. They all show pbs_server starting… but then stops but no reason given.

Is there any way to turn the level of logging to give more detail? Anyway to find out which process sent the fast shutdown request?