Can never run jobs

Parodi85 · July 6, 2020, 7:19pm

Hi All,

Im trying to configure a Cluster with 3 queue (baja,alta,baja_ahm) but i´m getting this messages when i try to execute simultaneus jobs on each queue, Error: “Can Never Run: Insufficient amount of resource: slot_type (baja_ahm != baja)” i´m using pbs_version = 18.1.3.

Any idea about this erro?

Kind regards,

Luis Parody

adarsh · July 7, 2020, 8:29am

Please share the output of these commands:

qmgr -c ‘l r baja_ahm’
source /etc/pbs.conf ; grep baja_ahm $PBS_HOME/sched_priv/sched_config
pbsnodes -av
qstat -fx
qmgr -c ‘print queue @default’

Parodi85 · July 7, 2020, 2:20pm

Hi Adarsh,

Here are the outputs:

[prueba.gigante@ip-0A640806 ~]$ qmgr -c ‘l r baja_ahm’
Unknown Host.
qmgr: cannot connect to server r
Unknown Host.
qmgr: cannot connect to server baja_ahm’

[prueba.gigante@ip-0A640806 ~]$ source /etc/pbs.conf ; grep baja_ahm $PBS_HOME/sched_priv/sched_config
PBS_EXEC=/opt/pbs: Command not found.
PBS_SERVER=ip-0A640806: Command not found.
PBS_START_SERVER=1: Command not found.
PBS_START_SCHED=1: Command not found.
PBS_START_COMM=1: Command not found.
PBS_START_MOM=0: Command not found.
PBS_HOME=/var/spool/pbs: Command not found.
PBS_CORE_LIMIT=unlimited: Command not found.
PBS_SCP=/bin/scp: Command not found.
PBS_HOME: Undefined variable.

[prueba.gigante@ip-0A640806 ~]$ pbsnodes -av
ip-0A640808
Mom = ip-0a640808
ntype = PBS
state = job-busy
pcpus = 16
jobs = 8.ip-0A640806/0, 8.ip-0A640806/1, 8.ip-0A640806/2, 8.ip-0A640806/3, 8.ip-0A640806/4, 8.ip-0A640806/5, 8.ip-0A640806/6, 8.ip-0A640806/7, 8.ip-0A640806/8, 8.ip-0A640806/9, 8.ip-0A640806/10, 8.ip-0A640806/11, 8.ip-0A640806/12, 8.ip-0A640806/13, 8.ip-0A640806/14, 8.ip-0A640806/15
resources_available.arch = linux
resources_available.host = ip-0a640808
resources_available.instance_id = 1e9a3745fb317f0f8d931086eb86fe81
resources_available.machinetype = Standard_H16r
resources_available.mem = 115503592kb
resources_available.ncpus = 16
resources_available.nodearray = baja
resources_available.slot_type = baja
resources_available.ungrouped = true
resources_available.vnode = ip-0A640808
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 16
resources_assigned.vmem = 0kb
resv_enable = True
sharing = default_shared
last_state_change_time = Tue Jul 7 09:07:33 2020

[prueba.gigante@ip-0A640806 ~]$ qstat -fx
qstat: PBS is not configured to maintain job history

[prueba.gigante@ip-0A640806 ~]$ qmgr -c ‘print queue @default’
Unknown Host.
qmgr: cannot connect to server queue
Unknown Host.
qmgr: cannot connect to server @default’

Kind regards,

Luis

adarsh · July 7, 2020, 3:04pm

Thank you Luis, sorry i should have mentioned it earlier, the above commands should have been run as a root user.

Also, please enable job history on the system by running the below command
qmgr -c “set server job_history_enable=true”

Please share the below command output as root user:

qmgr -c ‘l r baja_ahm’
source /etc/pbs.conf ; grep baja_ahm $PBS_HOME/sched_priv/sched_config
pbsnodes -av
qstat -fx < jobid that is showing that comment >
qmgr -c ‘p s’

Parodi85 · July 7, 2020, 3:23pm

Hi Adarsh,

here are the new outputs:

[root@ip-0A640806 ~]# qmgr -c “set server job_history_enable=true”
Unknown Host.
qmgr: cannot connect to server server
Unknown Host.
qmgr: cannot connect to server job_history_enable=true”

[root@ip-0A640806 ~]# qmgr -c ‘l r baja_ahm’
Unknown Host.
qmgr: cannot connect to server r
Unknown Host.
qmgr: cannot connect to server baja_ahm’

[root@ip-0A640806 ~]# pbsnodes -av
ip-0A640808
Mom = ip-0a640808
Port = 15002
pbs_version = 18.1.3
ntype = PBS
state = free
pcpus = 16
resources_available.arch = linux
resources_available.host = ip-0a640808
resources_available.instance_id = 1e9a3745fb317f0f8d931086eb86fe81
resources_available.machinetype = Standard_H16r
resources_available.mem = 115503592kb
resources_available.ncpus = 16
resources_available.nodearray = baja
resources_available.slot_type = baja
resources_available.ungrouped = true
resources_available.vnode = ip-0A640808
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 0
resources_assigned.vmem = 0kb
resv_enable = True
sharing = default_shared
last_state_change_time = Tue Jul 7 10:04:33 2020
last_used_time = Tue Jul 7 10:04:33 2020

[root@ip-0A640806 ~]# qstat -fx 9.ip-0A640806
qstat: PBS is not configured to maintain job history 9.ip-0A640806

[root@ip-0A640806 ~]# qmgr -c ‘p s’
Unknown Host.
qmgr: cannot connect to server s’

Kind regards,

Luis Parody

adarsh · July 7, 2020, 3:37pm

Thank you Luis. It seems there is a name resolution / firewall issue.

static IP and hostname is required for the PBS Server and Compute nodes
/etc/hosts should have all the compute node and server details with hostnames and IP addresses
*reverse / forward address resolution should work
firewall should be turned off ( or 15001 to 15009 , 17001 ports should be allowed to communicate)
SELinux should be disabled (if you disable it now, then the system should be rebooted )
Check pbs services are running ps -ef | grep pbs_ or /etc/init.d/pbs status or systemctl status pbs

Job history was not configure or enabled when this job was submitted, you can submit a new job and that will be part of the job history and stored in PBS for 14 days.

These commands should print some information, but here it is finding issue to connect to the server.

For example:
You can run strace qmgr -c ‘p s’ command to find out the cause .

Parodi85 · July 7, 2020, 9:05pm

Hi Adarsh

There is no security feature enable.

[root@ip-0A640806 ~]# getenforce
Permissive

[root@ip-0A640806 ~]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
Docs: man:firewalld(1)

[root@ip-0A640806 ~]# ps -ef | grep pbs_
root 10812 1 0 Jul06 ? 00:00:00 /opt/pbs/sbin/pbs_comm
root 10827 1 0 Jul06 ? 00:00:03 /opt/pbs/sbin/pbs_sched
root 11109 1 0 Jul06 ? 00:00:09 /opt/pbs/sbin/pbs_ds_monitor monitor
postgres 11188 11160 0 Jul06 ? 00:00:00 postgres: postgres pbs_datastore 10.100.8.6(53338) idle
root 11201 1 0 Jul06 ? 00:00:59 /opt/pbs/sbin/pbs_server.bin
root 127209 126935 0 15:26 pts/1 00:00:00 grep --color=auto pbs_

strace qmgr -c ‘p s’
execve("/opt/pbs/bin/qmgr", [“qmgr”, “-c”, “\342\200\230p”, “s\342\200\231”], [/* 24 vars */]) = 0
brk(NULL) = 0x1a07000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e0000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54044, …}) = 0
mmap(NULL, 54044, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2b14c89e1000
close(3) = 0
open("/lib64/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200m\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=142144, …}) = 0
mmap(NULL, 2208904, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c8be2000
mprotect(0x2b14c8bf9000, 2093056, PROT_NONE) = 0
mmap(0x2b14c8df8000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x2b14c8df8000
mmap(0x2b14c8dfa000, 13448, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14c8dfa000
close(3) = 0
open("/lib64/libedit.so.0", O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\326\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=235064, ...}) = 0 mmap(NULL, 2344512, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c8dfe000 mprotect(0x2b14c8e33000, 2093056, PROT_NONE) = 0 mmap(0x2b14c9032000, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x34000) = 0x2b14c9032000 mmap(0x2b14c9036000, 17984, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14c9036000 close(3) = 0 open("/lib64/libncurses.so.5", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0Pm\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=163696, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89ef000 mmap(NULL, 2254920, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c903b000 mprotect(0x2b14c9061000, 2093056, PROT_NONE) = 0 mmap(0x2b14c9260000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x25000) = 0x2b14c9260000 close(3) = 0 open("/lib64/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\316\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=174576, ...}) = 0 mmap(NULL, 2268928, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c9262000 mprotect(0x2b14c9287000, 2097152, PROT_NONE) = 0 mmap(0x2b14c9487000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x25000) = 0x2b14c9487000 close(3) = 0 open("/lib64/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\16\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=19248, ...}) = 0 mmap(NULL, 2109744, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c948c000 mprotect(0x2b14c948e000, 2097152, PROT_NONE) = 0 mmap(0x2b14c968e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x2b14c968e000 close(3) = 0 open("/lib64/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0000\16\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=40600, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89f0000 mmap(NULL, 2318912, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c9690000 mprotect(0x2b14c9698000, 2093056, PROT_NONE) = 0 mmap(0x2b14c9897000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x2b14c9897000 mmap(0x2b14c9899000, 184896, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14c9899000 close(3) = 0 open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0&\2\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=2156240, …}) = 0
mmap(NULL, 3985920, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c98c7000
mprotect(0x2b14c9a8a000, 2097152, PROT_NONE) = 0
mmap(0x2b14c9c8a000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1c3000) = 0x2b14c9c8a000
mmap(0x2b14c9c90000, 16896, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14c9c90000
close(3) = 0
open("/lib64/libfreebl3.so", O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\v\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=11392, …}) = 0
mmap(NULL, 2105536, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c9c95000
mprotect(0x2b14c9c97000, 2093056, PROT_NONE) = 0
mmap(0x2b14c9e96000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x2b14c9e96000
close(3) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89f1000
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89f2000
arch_prctl(ARCH_SET_FS, 0x2b14c89f2480) = 0
mprotect(0x2b14c9c8a000, 16384, PROT_READ) = 0
mprotect(0x2b14c968e000, 4096, PROT_READ) = 0
mprotect(0x2b14c9e96000, 4096, PROT_READ) = 0
mprotect(0x2b14c9897000, 4096, PROT_READ) = 0
mprotect(0x2b14c9487000, 16384, PROT_READ) = 0
mprotect(0x2b14c9260000, 4096, PROT_READ) = 0
mprotect(0x2b14c9032000, 12288, PROT_READ) = 0
mprotect(0x2b14c8df8000, 4096, PROT_READ) = 0
mprotect(0x639000, 4096, PROT_READ) = 0
mprotect(0x2b14c8bdf000, 4096, PROT_READ) = 0
munmap(0x2b14c89e1000, 54044) = 0
set_tid_address(0x2b14c89f2750) = 128173
set_robust_list(0x2b14c89f2760, 24) = 0
rt_sigaction(SIGRTMIN, {0x2b14c8be8860, [], SA_RESTORER|SA_SIGINFO, 0x2b14c8bf1630}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {0x2b14c8be88f0, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x2b14c8bf1630}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
getrlimit(RLIMIT_STACK, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0
brk(NULL) = 0x1a07000
brk(0x1a28000) = 0x1a28000
brk(NULL) = 0x1a28000
getuid() = 16960
socket(AF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
connect(3, {sa_family=AF_LOCAL, sun_path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
close(3) = 0
socket(AF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
connect(3, {sa_family=AF_LOCAL, sun_path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
close(3) = 0
open("/etc/nsswitch.conf", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=1746, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “#\n# /etc/nsswitch.conf\n#\n# An ex”…, 4096) = 1746
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54044, …}) = 0
mmap(NULL, 54044, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2b14c89e1000
close(3) = 0
open("/lib64/libnss_files.so.2", O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260!\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=61560, …}) = 0
mmap(NULL, 2173048, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x2b14c9e98000
mprotect(0x2b14c9ea4000, 2093056, PROT_NONE) = 0
mmap(0x2b14ca0a3000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xb000) = 0x2b14ca0a3000
mmap(0x2b14ca0a5000, 22648, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14ca0a5000
close(3) = 0
mprotect(0x2b14ca0a3000, 4096, PROT_READ) = 0
munmap(0x2b14c89e1000, 54044) = 0
open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=1820, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “root:x:0:0:root:/root:/bin/bash\n”…, 4096) = 1820
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
futex(0x63fcac, FUTEX_WAKE_PRIVATE, 2147483647) = 0
getuid() = 16960
open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=1820, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “root:x:0:0:root:/root:/bin/bash\n”…, 4096) = 1820
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
futex(0x63fca8, FUTEX_WAKE_PRIVATE, 2147483647) = 0
open("/etc/services", O_RDONLY|O_CLOEXEC) = 3
lseek(3, 0, SEEK_CUR) = 0
fstat(3, {st_mode=S_IFREG|0644, st_size=670293, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
lseek(3, 0, SEEK_SET) = 0
read(3, “# /etc/services:\n# $Id: services”…, 4096) = 4096
read(3, " 74/udp “…, 4096) = 4096
read(3, " # Quick Mail Transfer Proto”…, 4096) = 4096
read(3, " 636/udp “…, 4096) = 4096
read(3, " # Microsoft-SQL-Monito”…, 4096) = 4096
read(3, " # discp s"…, 4096) = 4096
read(3, "l Signal Alternate\n\nbprd "…, 4096) = 4096
read(3, " 3690/udp “…, 4096) = 4096
read(3, " # Message Processing M”…, 4096) = 4096
read(3, "o-Point Trans Net\nacr-nema “…, 4096) = 4096
read(3, " # SGMP\nsgmp “…, 4096) = 4096
read(3, " # Directory Loca”…, 4096) = 4096
read(3, “ervice 267/udp “…, 4096) = 4096
read(3, " bh611\nbh611 354/ud”…, 4096) = 4096
read(3, " # EMBL Nucleic Dat”…, 4096) = 4096
read(3, " 430/tcp # UT”…, 4096) = 4096
read(3, "login\nljk-login 472/udp "…, 4096) = 4096
read(3, "#\nulp 522/tcp “…, 4096) = 4096
read(3, “574/tcp # FTP So”…, 4096) = 4096
read(3, “uration Manager\nsco-sysmgr “…, 4096) = 4096
read(3, " # AODV\naodv 65”…, 4096) = 4096
read(3, " 692/tcp # Hype”…, 4096) = 4096
read(3, " 762/tcp #\nquo”…, 4096) = 4096
read(3, " 913/tcp # APEX “…, 4096) = 4096
read(3, " 1044/tcp # Dev “…, 4096) = 4096
read(3, " 1079/tcp # AS”…, 4096) = 4096
read(3, " # ARDUS Transfer\nar”…, 4096) = 4096
read(3, "q-repl 1148/udp “…, 4096) = 4096
read(3, " # 3Com Net Management\naccelen”…, 4096) = 4096
read(3, “onDCE Gateway\naeroflight-ads 12”…, 4096) = 4096
read(3, “che-query\nde-server 1256/t”…, 4096) = 4096
read(3, " # PKT-KRB-IPSec\ncmmdriver "…, 4096) = 4096
read(3, “icy 1333/udp # P”…, 4096) = 4096
read(3, " 1368/udp # “…, 4096) = 4096
read(3, “blet 1400/tcp #”…, 4096) = 4096
read(3, " # Blueberry Softw”…, 4096) = 4096
read(3, "es 1465/tcp "…, 4096) = 4096
read(3, “1504/udp # EVB So”…, 4096) = 4096
read(3, "ridgen-elmd 1542/udp "…, 4096) = 4096
read(3, “-lm 1578/udp “…, 4096) = 4096
read(3, " # NetBill Authoriz”…, 4096) = 4096
read(3, “\nstargatealerts 1654/udp “…, 4096) = 4096
read(3, “# empire-empuma\nempire-empuma “…, 4096) = 4096
read(3, " # SIMS - SIIPAT Protocol f”…, 4096) = 4096
read(3, " # EssWeb Gateway\nkmscontr”…, 4096) = 4096
read(3, " # MMPFT\nharp “…, 4096) = 4096
read(3, " # VIDS-AVTP\nvids-avtp 18”…, 4096) = 4096
read(3, “ify Web Adapter Service\nunify-ad”…, 4096) = 4096
read(3, " # XIIP\ndiscovery-port 1925”…, 4096) = 4096
read(3, " # SIMP Channel\nsimp-”…, 4096) = 4096
read(3, " 1994/udp # c”…, 4096) = 4096
read(3, " 2040/tcp “…, 4096) = 4096
read(3, “tsrmagt 2077/udp “…, 4096) = 4096
read(3, " 2116/udp # C”…, 4096) = 4096
read(3, “-User Plane (3GPP)\ngtp-user “…, 4096) = 4096
read(3, “VD User\nnvd 2184/udp”…, 4096) = 4096
read(3, " 2220/tcp #”…, 4096) = 4096
read(3, " # DTV Channel Request\ndtv”…, 4096) = 4096
read(3, " # NETML\nnetml 2288/ud”…, 4096) = 4096
read(3, " # ofsd\n3d-nfsd 232”…, 4096) = 4096
read(3, “p # NexstorIndLtd”…, 4096) = 4096
read(3, “2406/tcp # JediSe”…, 4096) = 4096
read(3, "pppsvr\nratl 2449/tcp “…, 4096) = 4096
read(3, “dp # Oracle TTC S”…, 4096) = 4096
read(3, " 2522/udp #”…, 4096) = 4096
read(3, “p # labrat\nlabrat”…, 4096) = 4096
read(3, “nt 2598/tcp # Cit”…, 4096) = 4096
read(3, "-samp 2643/tcp "…, 4096) = 4096
read(3, “2680/udp # pxc-sa”…, 4096) = 4096
read(3, "ange\nscan-change 2719/udp "…, 4096) = 4096
read(3, "status 2758/udp "…, 4096) = 4096
read(3, "eStats\nac-tech 2796/tcp "…, 4096) = 4096
read(3, “/udp # EVTP\nevtp-”…, 4096) = 4096
read(3, “port Protocol\nsps-tunnel 28”…, 4096) = 4096
read(3, "Lobby\ngamelobby 2914/udp "…, 4096) = 4096
read(3, “tcp # MPFWSAS\nmpf”…, 4096) = 4096
read(3, “V Intelligent Agent Communicatio”…, 4096) = 4096
read(3, “otes\nnds_sso 3024/tcp n”…, 4096) = 4096
read(3, "cacn-ip-tcp 3062/tcp “…, 4096) = 4096
read(3, " # Universal Message Man”…, 4096) = 4096
read(3, “cp 3134/udp “…, 4096) = 4096
read(3, “erver\nserverview-as 3169/tcp “…, 4096) = 4096
read(3, “tra\nnetwatcher-mon 3203/tcp “…, 4096) = 4096
read(3, “ort\nmdap-port 3235/udp “…, 4096) = 4096
read(3, “p # Microsoft Glo”…, 4096) = 4096
read(3, “3309/tcp # TNS AD”…, 4096) = 4096
read(3, “viatv 3350/tcp “…, 4096) = 4096
read(3, " Tapestry Client to Server\nd2k-t”…, 4096) = 4096
read(3, " # GCSP user port\ngcsp “…, 4096) = 4096
read(3, “DM ADM Notify\nedm-adm-notify 34”…, 4096) = 4096
read(3, “ether232port 3497/udp “…, 4096) = 4096
read(3, “Joltid\nraven-rmp 3532/tcp “…, 4096) = 4096
read(3, “68/tcp # EMIT sec”…, 4096) = 4096
read(3, “i 3601/udp # “…, 4096) = 4096
read(3, “stributed Objects\nsdo “…, 4096) = 4096
read(3, “ell Remote Management\ndell-rm-po”…, 4096) = 4096
read(3, “server-5 3705/tcp “…, 4096) = 4096
read(3, “\nlaunchbird-lm 3739/tcp “…, 4096) = 4096
read(3, “es 3773/udp #”…, 4096) = 4096
read(3, " # SpuGNA Communication Port\ns”…, 4096) = 4096
read(3, " # Scito Object Server\na”…, 4096) = 4096
read(3, “dp # Avocent DS A”…, 4096) = 4096
read(3, " Update (MUPDATE) protocol\nmupda”…, 4096) = 4096
read(3, “t po\naamp 3939/tcp “…, 4096) = 4096
read(3, " # LANrev Agent\nlanrevagen”…, 4096) = 4096
read(3, " # pxc-roid\npxc-roid”…, 4096) = 4096
read(3, “yo-main 4040/tcp “…, 4096) = 4096
read(3, “lly Incremental Backup\naibkup “…, 4096) = 4096
read(3, “cel 4108/udp “…, 4096) = 4096
read(3, “s # Cedros Fraud Detection Sys”…, 4096) = 4096
read(3, “rvices\nsm-disc 4174/udp “…, 4096) = 4096
read(3, " Protocol\ntrim-event 4322/t”…, 4096) = 4096
read(3, “disc 4371/udp “…, 4096) = 4096
read(3, " # L-ACOUSTICS managem”…, 4096) = 4096
read(3, " # MIH Services\nieee-mih “…, 4096) = 4096
read(3, “ice\nmmaeds 4668/udp “…, 4096) = 4096
read(3, “ux 4728/tcp “…, 4096) = 4096
read(3, " # OPC UA TCP Protocol\nq”…, 4096) = 4096
read(3, " # Equitrac Office\ne”…, 4096) = 4096
read(3, “onpsocket 5014/udp “…, 4096) = 4096
read(3, " # STANAG-5066-SUBNET-INTF\nauthe”…, 4096) = 4096
read(3, “# MyCTS server port\nrmonitor_sec”…, 4096) = 4096
read(3, “t 5234/tcp “…, 4096) = 4096
read(3, " # opalis-rbt-ipc\nopalis-rbt”…, 4096) = 4096
read(3, " # Salient User Manager\nsalient-”…, 4096) = 4096
read(3, “ker 5465/tcp # “…, 4096) = 4096
read(3, " # A3-SDUNode\na4-sdunode “…, 4096) = 4096
read(3, “video\nprosharedata 5715/tcp “…, 4096) = 4096
read(3, “\nnetagent 5771/tcp “…, 4096) = 4096
read(3, “tcp # WBEM Export”…, 4096) = 4096
read(3, “uch 6117/tcp #”…, 4096) = 4096
read(3, “er Interface\ngrid 626”…, 4096) = 4096
read(3, “# Business Objects Enterprise in”…, 4096) = 4096
read(3, “td # BoKS Clntd\nbadm_priv “…, 4096) = 4096
read(3, " # Allied Electronics NeXGen\nn”…, 4096) = 4096
read(3, “b Console Admin\nsmc-http “…, 4096) = 4096
read(3, " Serve Admin\nctdp 702”…, 4096) = 4096
read(3, " UPP Gateway\ndisplay 723”…, 4096) = 4096
read(3, “cp # OpenView DM “…, 4096) = 4096
read(3, “penXDAS Wire Protocol\nhawk “…, 4096) = 4096
read(3, “97/tcp # Propel C”…, 4096) = 4096
read(3, " # Intuit Entitlement”…, 4096) = 4096
read(3, " # Check Point Clusteri”…, 4096) = 4096
read(3, " 8300/tcp # Trans”…, 4096) = 4096
read(3, “-tunnel 8567/udp “…, 4096) = 4096
read(3, " # Desktop Data TCP 4: FARM pro”…, 4096) = 4096
read(3, “/udp # IBM AURORA”…, 4096) = 4096
read(3, “re\nwap-vcal-s 9207/udp “…, 4096) = 4096
read(3, “\nmphlpdmc 9344/tcp “…, 4096) = 4096
read(3, “ervice\ncondor 9618/udp “…, 4096) = 4096
read(3, " # HaloteC Instrument Network\na”…, 4096) = 4096
read(3, “ssaging\nnetiq-endpoint 10113/tc”…, 4096) = 4096
read(3, “p 11110/tcp “…, 4096) = 4096
read(3, “mserver1 12005/tcp “…, 4096) = 4096
read(3, " # Blackmagic Design”…, 4096) = 4096
read(3, “ate Notification\npduncs “…, 4096) = 4096
read(3, " # OPSEC CVP\nopsec-ufp “…, 4096) = 4096
read(3, “Interdevice Interaction discover”…, 4096) = 4096
read(3, “dard\ncaldsoft-backup 22537/tcp “…, 4096) = 4096
read(3, “trix StorageLink Gateway\nassoc-d”…, 4096) = 4096
read(3, “m 28200/tcp #”…, 4096) = 4096
read(3, " # FileNET BPM IOR\nfile”…, 4096) = 4096
read(3, “rt\nsafetynetp 40000/tcp “…, 4096) = 4096
read(3, " 45678/tcp # EBA”…, 4096) = 2645
read(3, “”, 4096) = 0
open(”/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=54044, …}) = 0
mmap(NULL, 54044, PROT_READ, MAP_PRIVATE, 4, 0) = 0x2b14c89f4000
close(4) = 0
open(”/lib64/libnss_sss.so.2”, O_RDONLY|O_CLOEXEC) = 4
read(4, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\25\0\0\0\0\0\0”…, 832) = 832
fstat(4, {st_mode=S_IFREG|0755, st_size=37216, …}) = 0
mmap(NULL, 2131056, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x2b14ca0ab000
mprotect(0x2b14ca0b3000, 2093056, PROT_NONE) = 0
mmap(0x2b14ca2b2000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x7000) = 0x2b14ca2b2000
close(4) = 0
mprotect(0x2b14ca2b2000, 4096, PROT_READ) = 0
munmap(0x2b14c89f4000, 54044) = 0
fstat(-1, 0x7ffd614d9dd0) = -1 EBADF (Bad file descriptor)
socket(AF_LOCAL, SOCK_STREAM, 0) = 4
fcntl(4, F_GETFL) = 0x2 (flags O_RDWR)
fcntl(4, F_SETFL, O_RDWR|O_NONBLOCK) = 0
fcntl(4, F_GETFD) = 0
fcntl(4, F_SETFD, FD_CLOEXEC) = 0
connect(4, {sa_family=AF_LOCAL, sun_path=”/var/lib/sss/pipes/nss”}, 110) = -1 ENOENT (No such file or directory)
close(4) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
socket(AF_LOCAL, SOCK_STREAM, 0) = 3
fcntl(3, F_GETFL) = 0x2 (flags O_RDWR)
fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK) = 0
fcntl(3, F_GETFD) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
connect(3, {sa_family=AF_LOCAL, sun_path=”/var/lib/sss/pipes/nss”}, 110) = -1 ENOENT (No such file or directory)
close(3) = 0
open(”/etc/pbs.conf”, O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=177, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “PBS_EXEC=/opt/pbs\nPBS_SERVER=ip-”…, 4096) = 177
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
open(”/etc/pbs.conf”, O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=177, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “PBS_EXEC=/opt/pbs\nPBS_SERVER=ip-”…, 4096) = 177
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
uname({sysname=“Linux”, nodename=“ip-0A640806”, …}) = 0
socket(AF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
connect(3, {sa_family=AF_LOCAL, sun_path=”/var/run/nscd/socket”}, 110) = -1 ENOENT (No such file or directory)
close(3) = 0
socket(AF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
connect(3, {sa_family=AF_LOCAL, sun_path=”/var/run/nscd/socket”}, 110) = -1 ENOENT (No such file or directory)
close(3) = 0
stat(”/etc/resolv.conf”, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
open(”/etc/host.conf”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=9, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “multi on\n”, 4096) = 9
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
futex(0x2b14c9c929f0, FUTEX_WAKE_PRIVATE, 2147483647) = 0
open(”/etc/resolv.conf”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “# Generated by NetworkManager\nse”…, 4096) = 106
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
open(”/etc/hosts”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54164, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “127.0.0.1 localhost localhost.”…, 4096) = 4096
read(3, “10.100.8.153 ip-0A640899\n10.100”…, 4096) = 4096
read(3, “100.9.57 ip-0A640939\n10.100.9.5”…, 4096) = 4096
read(3, “.216 ip-0A6409D8\n10.100.9.217 “…, 4096) = 4096
read(3, “ip-0A640A75\n10.100.10.118 ip-0A”…, 4096) = 4096
read(3, “00.11.14 ip-0A640B0E\n10.100.11.”…, 4096) = 4096
read(3, “0.100.11.169 ip-0A640BA9\n10.100”…, 4096) = 4096
read(3, “-0A640C43\n10.100.12.68 ip-0A640”…, 4096) = 4096
read(3, " ip-0A640CDC\n10.100.12.221 ip-0”…, 4096) = 4096
read(3, “3.120 ip-0A640D78\n10.100.13.121”…, 4096) = 4096
read(3, “10.100.14.17 ip-0A640E11\n10.100”…, 4096) = 4096
read(3, “40EAB\n10.100.14.172 ip-0A640EAC”…, 4096) = 4096
read(3, " ip-0A640F46\n10.100.15.71 ip-0”…, 4096) = 4096
read(3, “15.223 ip-0A640FDF\n10.100.15.22”…, 4096) = 916
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
stat(”/etc/resolv.conf”, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
open(”/etc/hosts”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54164, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “127.0.0.1 localhost localhost.”…, 4096) = 4096
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
stat(”/etc/resolv.conf”, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
open(”/etc/hosts”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54164, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “127.0.0.1 localhost localhost.”…, 4096) = 4096
read(3, “10.100.8.153 ip-0A640899\n10.100”…, 4096) = 4096
read(3, “100.9.57 ip-0A640939\n10.100.9.5”…, 4096) = 4096
read(3, “.216 ip-0A6409D8\n10.100.9.217 “…, 4096) = 4096
read(3, “ip-0A640A75\n10.100.10.118 ip-0A”…, 4096) = 4096
read(3, “00.11.14 ip-0A640B0E\n10.100.11.”…, 4096) = 4096
read(3, “0.100.11.169 ip-0A640BA9\n10.100”…, 4096) = 4096
read(3, “-0A640C43\n10.100.12.68 ip-0A640”…, 4096) = 4096
read(3, " ip-0A640CDC\n10.100.12.221 ip-0”…, 4096) = 4096
read(3, “3.120 ip-0A640D78\n10.100.13.121”…, 4096) = 4096
read(3, “10.100.14.17 ip-0A640E11\n10.100”…, 4096) = 4096
read(3, “40EAB\n10.100.14.172 ip-0A640EAC”…, 4096) = 4096
read(3, " ip-0A640F46\n10.100.15.71 ip-0”…, 4096) = 4096
read(3, “15.223 ip-0A640FDF\n10.100.15.22”…, 4096) = 916
read(3, “”, 4096) = 0
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
stat(”/etc/resolv.conf”, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
open(”/etc/hosts”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=54164, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(3, “127.0.0.1 localhost localhost.”…, 4096) = 4096
close(3) = 0
munmap(0x2b14c89e1000, 4096) = 0
open(”/var/spool/pbs/server_priv/hooks/tmp/qmgr_hook1281738CRHoT”, O_RDWR|O_CREAT|O_EXCL, 0600) = -1 EACCES (Permission denied)
socket(AF_INET, SOCK_STREAM, IPPROTO_IP) = 3
stat(”/etc/resolv.conf”, {st_mode=S_IFREG|0644, st_size=106, …}) = 0
open(”/etc/hosts”, O_RDONLY|O_CLOEXEC) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=54164, …}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b14c89e1000
read(4, “127.0.0.1 localhost localhost.”…, 4096) = 4096
read(4, “10.100.8.153 ip-0A640899\n10.100”…, 4096) = 4096
read(4, “100.9.57 ip-0A640939\n10.100.9.5”…, 4096) = 4096
read(4, “.216 ip-0A6409D8\n10.100.9.217 “…, 4096) = 4096
read(4, “ip-0A640A75\n10.100.10.118 ip-0A”…, 4096) = 4096
read(4, “00.11.14 ip-0A640B0E\n10.100.11.”…, 4096) = 4096
read(4, “0.100.11.169 ip-0A640BA9\n10.100”…, 4096) = 4096
read(4, “-0A640C43\n10.100.12.68 ip-0A640”…, 4096) = 4096
read(4, " ip-0A640CDC\n10.100.12.221 ip-0”…, 4096) = 4096
read(4, “3.120 ip-0A640D78\n10.100.13.121”…, 4096) = 4096
read(4, “10.100.14.17 ip-0A640E11\n10.100”…, 4096) = 4096
read(4, “40EAB\n10.100.14.172 ip-0A640EAC”…, 4096) = 4096
read(4, " ip-0A640F46\n10.100.15.71 ip-0”…, 4096) = 4096
read(4, “15.223 ip-0A640FDF\n10.100.15.22”…, 4096) = 916
read(4, “”, 4096) = 0
close(4) = 0
munmap(0x2b14c89e1000, 4096) = 0
open(”/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=54044, …}) = 0
mmap(NULL, 54044, PROT_READ, MAP_PRIVATE, 4, 0) = 0x2b14c89e1000
close(4) = 0
open(”/lib64/libnss_dns.so.2”, O_RDONLY|O_CLOEXEC) = 4
read(4, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\20\0\0\0\0\0\0”…, 832) = 832
fstat(4, {st_mode=S_IFREG|0755, st_size=31344, …}) = 0
mmap(NULL, 2121984, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x2b14ca2b4000
mprotect(0x2b14ca2ba000, 2093056, PROT_NONE) = 0
mmap(0x2b14ca4b9000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x5000) = 0x2b14ca4b9000
close(4) = 0
open(”/lib64/libresolv.so.2”, O_RDONLY|O_CLOEXEC) = 4
read(4, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\2009\0\0\0\0\0\0”…, 832) = 832
fstat(4, {st_mode=S_IFREG|0755, st_size=109976, …}) = 0
mmap(NULL, 2202112, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x2b14ca4bb000
mprotect(0x2b14ca4d1000, 2097152, PROT_NONE) = 0
mmap(0x2b14ca6d1000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x16000) = 0x2b14ca6d1000
mmap(0x2b14ca6d3000, 6656, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2b14ca6d3000
close(4) = 0
mprotect(0x2b14ca6d1000, 4096, PROT_READ) = 0
mprotect(0x2b14ca4b9000, 4096, PROT_READ) = 0
munmap(0x2b14c89e1000, 54044) = 0
open(”/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=54044, …}) = 0
mmap(NULL, 54044, PROT_READ, MAP_PRIVATE, 4, 0) = 0x2b14c89e1000
close(4) = 0
open(”/lib64/libnss_myhostname.so.2”, O_RDONLY|O_CLOEXEC) = 4
read(4, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\35\0\0\0\0\0\0”…, 832) = 832
fstat(4, {st_mode=S_IFREG|0755, st_size=86544, …}) = 0
mmap(NULL, 2181296, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x2b14ca6d5000
mprotect(0x2b14ca6e7000, 2093056, PROT_NONE) = 0
mmap(0x2b14ca8e6000, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x11000) = 0x2b14ca8e6000
close(4) = 0
open(”/lib64/libcap.so.2”, O_RDONLY|O_CLOEXEC) = 4

I can run jobs with queues (baja, alta) but when i try to run with queue “baja_ahm” all these errors appears.

Kind regards,

Luis Parody

adarsh · July 9, 2020, 8:25am

Thank you Luis for the above details

We are unable see the queue configuration of baja_ahm queue
qmgr -c “print queue baja_ahm” and also other commands as we seen above are unable to connect to the server and dispose details

Could you please share the output of cat /etc/hosts and cat /etc/nssswitch.conf ?
Also, i am not sure whether ip-0A640806 is mentioned in the /etc/hosts ?
Could you please disable SElinux and restart the system ?

Thank you

Parodi85 · July 9, 2020, 1:30pm

Hi Adarsh,

[root@ip-0A640806 ~]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

#The following was autogenerated for Cloud environments. (Subnet: 10.100.8.6/255.255.248.0)
10.100.8.1 ip-0A640801
10.100.8.2 ip-0A640802
10.100.8.3 ip-0A640803
10.100.8.4 ip-0A640804
10.100.8.5 ip-0A640805
10.100.8.6 ip-0A640806
10.100.8.7 ip-0A640807
10.100.8.8 ip-0A640808
10.100.8.9 ip-0A640809
10.100.8.10 ip-0A64080A
10.100.8.11 ip-0A64080B
10.100.8.12 ip-0A64080C
10.100.8.13 ip-0A64080D
10.100.8.14 ip-0A64080E
10.100.8.15 ip-0A64080F
10.100.8.16 ip-0A640810
10.100.8.17 ip-0A640811
10.100.8.18 ip-0A640812
10.100.8.19 ip-0A640813
10.100.8.20 ip-0A640814
10.100.8.21 ip-0A640815
10.100.8.22 ip-0A640816
10.100.8.23 ip-0A640817
10.100.8.24 ip-0A640818
10.100.8.25 ip-0A640819
10.100.8.26 ip-0A64081A
10.100.8.27 ip-0A64081B
.
.
.
.

[root@ip-0A640806 ~]# cat /etc/nsswitch.conf

/etc/nsswitch.conf

An example Name Service Switch config file. This file should be

sorted with the most-used services at the beginning.

The entry ‘[NOTFOUND=return]’ means that the search for an

entry should stop if the search in the previous entry turned

up nothing. Note that if the search failed due to some other reason

(like no NIS server responding) then the search continues with the

next entry.

Valid entries include:

nisplus Use NIS+ (NIS version 3)

nis Use NIS (NIS version 2), also called YP

dns Use DNS (Domain Name Service)

files Use the local files

db Use the local database (.db) files

compat Use NIS on compat mode

hesiod Use Hesiod for user lookups

[NOTFOUND=return] Stop searching if not found so far

To use db, put the “db” in front of “files” for entries you want to be

looked up first in the databases

Example:

#passwd: db files nisplus nis
#shadow: db files nisplus nis
#group: db files nisplus nis

passwd: files sss
shadow: files sss
group: files sss
#initgroups: files sss

#hosts: db files nisplus nis dns
hosts: files dns myhostname

Example - obey only what nisplus tells us…

#services: nisplus [NOTFOUND=return] files
#networks: nisplus [NOTFOUND=return] files
#protocols: nisplus [NOTFOUND=return] files
#rpc: nisplus [NOTFOUND=return] files
#ethers: nisplus [NOTFOUND=return] files
#netmasks: nisplus [NOTFOUND=return] files

bootparams: nisplus [NOTFOUND=return] files

ethers: files
netmasks: files
networks: files
protocols: files
rpc: files
services: files sss

netgroup: nisplus sss

publickey: nisplus

automount: files nisplus sss
aliases: files nisplus

The SELINUX is disabled but still having the same behaivor.

[root@ip-0A640806 ~]# getenforce
Disabled
[root@ip-0A640806 ~]# qmgr -c “print queue baja_ahm”
Unknown Host.
qmgr: cannot connect to server queue
Unknown Host.
qmgr: cannot connect to server baja_ahm”

Kind regards,

Luis Parody

bhroam · July 9, 2020, 7:15pm

All of the system issues aside, you only ever get a ‘Can Never Run’ message when that value is not set on any node. What "Can Never Run: Insufficient amount of resource: slot_type (baja_ahm != baja)” is telling you is that the job is requesting the resource slot_type=baha_ahm. You see on the other side of the != is a comma separated list of values on the complex. It appears the only value of resources_available.slot_type on your complex is ‘baha’.

The more interesting PBS command to run (which might not work due to the systems issues) is
qmgr -c 'list node @default' | grep resources_available.slot_type | sort | uniq

I suspect you’ll see one line with slot_type = baha

Bhroam

dtalcott · July 15, 2020, 6:39pm

I appears that there is some confusion about quote characters. From the outputs, it looks like textual quotes are being used instead of computer quotes. I.e. ‘foo’ instead of 'foo' and “foo” instead of "foo". Perhaps the Altair responders could repeat their commands, but use preformatted text so the forum won’t textualize them?

bhroam · July 20, 2020, 10:22pm

Thanks for the tip @dtalcott. I have edited my original post and used preformatted text.

Bhroam

Topic		Replies	Views
Jobs stuck in Q stat and the scheduler seems not working right Users/Site Administrators	6	1978	December 6, 2022
Job gets stuck in a queue after a fresh install Users/Site Administrators	12	4044	May 31, 2019
Pbs_server is not running Users/Site Administrators	11	6953	January 7, 2022
PBS started but not running Users/Site Administrators	2	1211	October 3, 2020
PBS-server not running Developers	31	5720	October 20, 2022

Can never run jobs

/etc/nsswitch.conf

An example Name Service Switch config file. This file should be

sorted with the most-used services at the beginning.

The entry ‘[NOTFOUND=return]’ means that the search for an

entry should stop if the search in the previous entry turned

up nothing. Note that if the search failed due to some other reason

(like no NIS server responding) then the search continues with the

next entry.

Valid entries include:

nisplus Use NIS+ (NIS version 3)

nis Use NIS (NIS version 2), also called YP

dns Use DNS (Domain Name Service)

files Use the local files

db Use the local database (.db) files

compat Use NIS on compat mode

hesiod Use Hesiod for user lookups

[NOTFOUND=return] Stop searching if not found so far

To use db, put the “db” in front of “files” for entries you want to be

looked up first in the databases

Example:

Example - obey only what nisplus tells us…

Related Topics