When I start PBS, only pbs_sched runs

Young · May 4, 2022, 7:35am

I followed INSTALL from openpbs/INSTALL at master · openpbs/openpbs · GitHub, and I got some troubles on “13. Start the PBS services.”

I add some information about my situation.

OS: Ubuntu 20.04
PBS version: 20.0.0

/etc/pbs.conf
PBS_SERVER=orum-workstation
PBS_START_SERVER=1
PBS_START_SCHED=1
PBS_START_COMM=1
PBS_START_MOM=1
PBS_EXEC=/opt/pbs
PBS_HOME=/var/spool/pbs
PBS_CORE_LIMIT=unlimited
PBS_SCP=/usr/bin/scp

/etc/hosts
127.0.0.1 localhost
127.0.1.1 orum-workstation

ifconfig
eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.0.140 netmask 255.255.255.0 broadcast 192.168.0.255
inet6 fe80::fa0e:726d:f369:612d prefixlen 64 scopeid 0x20
ether 74:86:e2:11:b1:f9 txqueuelen 1000 (Ethernet)
RX packets 583598 bytes 532536173 (532.5 MB)
RX errors 0 dropped 14 overruns 0 frame 0
TX packets 171668 bytes 17640020 (17.6 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device interrupt 16 memory 0x92f00000-92f20000

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 1000 (Local Loopback)
RX packets 468477 bytes 40161122 (40.1 MB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 468477 bytes 40161122 (40.1 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

ping -c 5 orum-workstation
PING orum-workstation (127.0.1.1) 56(84) bytes of data.
64 bytes from orum-workstation (127.0.1.1): icmp_seq=1 ttl=64 time=0.024 ms
64 bytes from orum-workstation (127.0.1.1): icmp_seq=1 ttl=64 time=0.038 ms
64 bytes from orum-workstation (127.0.1.1): icmp_seq=1 ttl=64 time=0.028 ms
64 bytes from orum-workstation (127.0.1.1): icmp_seq=1 ttl=64 time=0.037 ms
64 bytes from orum-workstation (127.0.1.1): icmp_seq=1 ttl=64 time=0.031 ms

— orum-workstation ping statistics —
5 packets transmitted, 5 received, 0% packet loss, time 4086ms
rtt min/avg/max/mdev = 0.024/0.031/0.038/0.005 ms

hostname / hostname -A
orum-workstation

hostname -i
127.0.1.1

**sudo /etc/init.d/pbs start""
Starting PBS
PBS comm
/opt/pbs/sbin/pbs_comm ready (pid=275492), Proxy Name:orum-workstation:17001, Threads:4
PBS mom
PBS sched
/opt/pbs/sbin/pbs_ds_systemd: 43: [: xdegraded: unexpected operator
Connecting to PBS dataservice…connected to PBS dataservice@orum-workstation
PBS server

sudo /etc/init.d/pbs status
pbs_server is not running
pbs_mom is not running
pbs_sched is pid 275518
pbs_comm is not running

ps -ef | grep pbs_
root 275518 1943 0 16:28 ? 00:00:00 /opt/pbs/sbin/pbs_sched

/var/spool/pbs/server_logs/20220504
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Log;Log opened
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;pbs_version=20.0.0
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;pbs_build=mach=N/A:security=N/A:configure_args=N/A
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;hostname=orum-workstation;pbs_leaf_name=N/A;pbs_mom_node_name=N/A
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;ipv4 interface lo: localhost
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;ipv4 interface eno1: orum-workstation
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;ipv6 interface lo: ip6-loopback
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;ipv6 interface eno1: orum-workstation
05/04/2022 16:28:48;0006;Server@orum-workstation;Fil;Server@orum-workstation;Version 20.0.0, started, initialization type = 1
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;pbs_status_db exit code 1
05/04/2022 16:28:48;0002;Server@orum-workstation;Svr;Server@orum-workstation;Starting PBS dataservice
05/04/2022 16:28:51;0002;Server@orum-workstation;Svr;Server@orum-workstation;connected to PBS dataservice@orum-workstation
05/04/2022 16:28:51;0086;Server@orum-workstation;Svr;pbs_python_ext_quick_start_interpreter;–> Python Interpreter quick started, compiled with version:'3.9.5 (default, Nov 23 2021, 15:27:38)
05/04/2022 16:28:51;0086;Server@orum-workstation;Svr;pbs_python_ext_quick_start_interpreter;–> Inserted Altair PBS Python modules dir ‘/opt/pbs/lib/python/altair’ ‘/opt/pbs/lib/python/altair/pbs/v1’<–
05/04/2022 16:28:51;0086;Server@orum-workstation;Svr;pbs_python_ext_quick_shutdown_interpreter;–> Stopping Python interpreter ←
05/04/2022 16:28:51;0001;Server@orum-workstation;Svr;Server@orum-workstation;main, Could not find any usable IP address for host orum-workstation
05/04/2022 16:28:51;0002;Server@orum-workstation;Svr;Server@orum-workstation;Stopping PBS dataservice

pbs_hostn -v $PBS_SERVER
primary name: orum-workstation (from gethostbyname())
aliases: -none-
address length: 4 bytes
address: 127.0.1.1 (16842879 dec) name: orum-workstation

echo “sleep 100” | qsub
Connection refused
qstat: cannot connect to server orum-workstation (errno=15010)

qstat
Connection refused
qstat: cannot connect to server orum-workstation (errno=15010)

pbsnodes -a
Connection refused
pbsnodes: cannot connect to server orum-workstation, error=15010

Young · May 9, 2022, 8:27am

How can I treat “Could not find any usable IP address for host” in the server_logs?

adarsh · May 10, 2022, 9:09am

Please check the below:

DNS and /etc/hosts should be working and same across all the nodes
static IP and hostname is a must for all the systems in the PBS clusters
SELinux disabled and system restarted
firewall allowing ports 15001 to 15007 and 17001
NTP configured

Young · May 11, 2022, 1:28am

I only use a single node, and do I have to consider other things?

I checked your list and there is no problem. @adarsh

adarsh · May 11, 2022, 6:25am

Please check this link