Hi,
today i install pbs docker and it is running fine but during pbs_mom start , it is failing
[root@pbs /]# /opt/pbs/sbin/pbs_mom
setrlimit NPROC: Operation not permitted
what about this error in docker
regards
soni
Hi , i have directly followed link
https://pbspro.atlassian.net/wiki/spaces/PBSPro/pages/79298561/Using+Docker+to+Instantiate+PBS
and used command
docker run -it --name pbs -h pbs -e PBS_START_MOM=1 pbspro/pbspro bash
even i have created a centos container and manually installed PBS execution but pbs mom service is giving same error
@depaksoni : I have just run the container example provided in this link https://pbspro.atlassian.net/wiki/spaces/PBSPro/pages/79298561/Using+Docker+to+Instantiate+PBS and it worked for me
root@cn1:~# docker run -it --name pbs -h pbs -e PBS_START_MOM=1 pbspro/pbspro bash
Unable to find image 'pbspro/pbspro:latest' locally
latest: Pulling from pbspro/pbspro
256b176beaff: Pull complete
8466b076f0be: Pull complete
2c82593c82f7: Pull complete
260e168d7abe: Pull complete
Digest: sha256:19fde346e51e0db44580c9ff42a60c5a182d533369654b7e3b9fa135c3a45a7e
Status: Downloaded newer image for pbspro/pbspro:latest
Starting PBS
PBS Home directory /var/spool/pbs needs updating.
Running /opt/pbs/libexec/pbs_habitat to update it.
***
*** Setting default queue and resource limits.
***
Connecting to PBS dataservice....connected to PBS dataservice@pbs
*** End of /opt/pbs/libexec/pbs_habitat
Home directory /var/spool/pbs updated.
PBS comm
/opt/pbs/sbin/pbs_comm ready (pid=1226), Proxy Name:pbs:17001, Threads:4
PBS mom
Creating usage database for fairshare.
PBS sched
Connecting to PBS dataservice....connected to PBS dataservice@pbs
Licenses valid for 10000000 Floating hosts
PBS server
[pbsuser@pbs ~]$ cat /etc/pbs.conf
PBS_EXEC=/opt/pbs
PBS_SERVER=pbs
PBS_START_SERVER=1
PBS_START_SCHED=1
PBS_START_COMM=1
PBS_START_MOM=0
PBS_HOME=/var/spool/pbs
PBS_CORE_LIMIT=unlimited
[pbsuser@pbs ~]$ ps -ef | grep pbs_
root 1226 1 0 13:07 ? 00:00:00 /opt/pbs/sbin/pbs_comm
root 1247 1 0 13:07 ? 00:00:00 /opt/pbs/sbin/pbs_mom
root 1250 1 0 13:07 ? 00:00:00 /opt/pbs/sbin/pbs_sched
root 1483 1 0 13:08 ? 00:00:00 /opt/pbs/sbin/pbs_ds_monitor monitor
postgres 1541 1523 0 13:08 ? 00:00:00 postgres: postgres pbs_datastore 172.17.0.3(43018) idle
root 1542 1 0 13:08 ? 00:00:00 /opt/pbs/sbin/pbs_server.bin
pbsuser 1576 1551 0 13:08 pts/0 00:00:00 grep --color=auto pbs_
-
Are you planning to run only the PBS MOM in a container using the above docker image from that link ?
-
You would like to configure PBS_MOM in a new centos container ? , then please see below
root@cn1:~# ls /tmp/*.tar.gz
/tmp/PBSPro_19.x.x-CentOS7_x86_64.tar.gzroot@cn1:~# docker run -it -v /tmp:/sharedtmp centos bash
Unable to find image ‘centos:latest’ locally
latest: Pulling from library/centos
d8d02d457314: Pull complete
Digest: sha256:307835c385f656ec2e2fec602cf093224173c51119bbebd602c53c3653a3d6eb
Status: Downloaded newer image for centos:latest[root@4cb47ea5cc6b /]# cd /sharedtmp/
[root@4cb47ea5cc6b sharedtmp]# ls
PBSPro_19.x.x-CentOS7_x86_64.tar.gz systemd-private-64de12f607854cf2acfef06522bd9b3a-fwupd.service-E36WEo
config-err-vN8tny systemd-private-64de12f607854cf2acfef06522bd9b3a-rtkit-daemon.service-heMNws
ssh-0RaMJEIhir74 systemd-private-64de12f607854cf2acfef06522bd9b3a-systemd-resolved.service-jyAwz9
systemd-private-64de12f607854cf2acfef06522bd9b3a-bolt.service-R2rCv2 systemd-private-64de12f607854cf2acfef06522bd9b3a-systemd-timesyncd.service-YCqFKk
systemd-private-64de12f607854cf2acfef06522bd9b3a-colord.service-kuzIAw vmware-root_546-2999591749[root@4cb47ea5cc6b sharedtmp]# cd
[root@4cb47ea5cc6b ~]# tar -xvzf /sharedtmp/PBSPro_19.x.x-CentOS7_x86_64.tar.gz
PBSPro_19.x.x
PBSPro_19.x.x/PBS_License.txt
PBSPro_19.x.x/pbspro-client-19.x.x.20190726105414-0.el7.x86_64.rpm
PBSPro_19.x.x/pbspro-debuginfo-19.x.x.20190726105414-0.el7.x86_64.rpm
PBSPro_19.x.x/pbspro-execution-19.x.x.20190726105414-0.el7.x86_64.rpm
PBSPro_19.x.x/pbspro-server-19.x.x.20190726105414-0.el7.x86_64.rpm[root@4cb47ea5cc6b ~]# cd PBSPro_19.x.x/
[root@4cb47ea5cc6b PBSPro_19.x.x]# ls
PBS_License.txt pbspro-debuginfo-19.x.x.20190726105414-0.el7.x86_64.rpm pbspro-server-19.x.x.20190726105414-0.el7.x86_64.rpm
pbspro-client-19.x.x.20190726105414-0.el7.x86_64.rpm pbspro-execution-19.x.x.20190726105414-0.el7.x86_64.rpm[root@4cb47ea5cc6b PBSPro_19.x.x]# yum install pbspro-execution-19.x.x.20190726105414-0.el7.x86_64.rpm
Loaded plugins: fastestmirror, ovl
Examining pbspro-execution-19.x.x.20190726105414-0.el7.x86_64.rpm: pbspro-execution-19.x.x.20190726105414-0.el7.x86_64
Marking pbspro-execution-19.x.x.20190726105414-0.el7.x86_64.rpm to be installed
Resolving Dependencies
–> Running transaction check
—> Package pbspro-execution.x86_64 0:19.x.x.20190726105414-0.el7 will be installed
–> Finished Dependency ResolutionDependencies Resolved
=========================================================================================================================================================================
Package Arch Version Repository SizeInstalling:
pbspro-execution x86_64 19.x.x.20190726105414-0.el7 /pbspro-execution-19.x.x.20190726105414-0.el7.x86_64 185 MTransaction Summary
Install 1 Package
Total size: 185 M
Installed size: 185 M
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installation of PBS ProfessionalTerms of use for the software are available online at
http://www.pbspro.com/UserArea/agreement.htmlInstalling : pbspro-execution-19.x.x.20190726105414-0.el7.x86_64 1/1
*** PBS Installation Summary
*** Postinstall script called as follows:
*** /opt/pbs/libexec/pbs_postinstall execution 19.x.x.20190726105414 /opt/pbs /var/spool/pbs
*** No configuration file found.
*** Creating new configuration file: /etc/pbs.conf
*** =======
*** NOTICE:
*** =======
*** The value of PBS_SERVER in /etc/pbs.conf is invalid.
*** PBS_SERVER should be set to the PBS Pro server hostname.
*** Update this value before starting PBS Pro.
*** Replacing /etc/pbs.conf with /etc/pbs.conf.19.x.x.20190726105414
*** /etc/pbs.conf has been created.
*** Registering PBS Pro as a service.
Created symlink /etc/systemd/system/multi-user.target.wants/pbs.service, pointing to /usr/lib/systemd/system/pbs.service.
Failed to get D-Bus connection: Operation not permitted
*** Creating preset file /usr/lib/systemd/system-preset/95-pbs.preset
*** PBS_HOME is /var/spool/pbs
*** Creating new file /var/spool/pbs/pbs_environment
*** WARNING: TZ not set in /var/spool/pbs/pbs_environment
*** The PBS Pro MOM has been installed in /opt/pbs/sbin.
*** =======
*** NOTICE:
*** =======
*** The clienthost entry for the server must be manually
*** modified in /var/spool/pbs/mom_priv/config
*** Update this value before starting PBS Pro.
*** The PBS commands have been installed in /opt/pbs/bin.
*** End of /opt/pbs/libexec/pbs_postinstall
Verifying : pbspro-execution-19.x.x.20190726105414-0.el7.x86_64 1/1Installed:
pbspro-execution.x86_64 0:19.x.x.20190726105414-0.el7Complete!
[root@4cb47ea5cc6b PBSPro_19.x.x]# vi /etc/pbs.conf
[root@4cb47ea5cc6b PBSPro_19.x.x]# vi /var/spool/pbs/mom_priv/config
[root@4cb47ea5cc6b PBSPro_19.x.x]# /etc/init.d/pbs start
Starting PBS
*** The PBS Pro server could not be found:
*** This value must resolve to a valid IP address.
[root@4cb47ea5cc6b PBSPro_19.x.x]# ps -ef | grep pbs_
root 101 1 0 13:21 pts/0 00:00:00 grep --color=auto pbs_[root@4cb47ea5cc6b PBSPro_19.x.x]# vi /etc/hosts ## add the PBS Server host details
[root@4cb47ea5cc6b PBSPro_19.x.x]# /etc/init.d/pbs start
Starting PBS
PBS Home directory /var/spool/pbs needs updating.
Running /opt/pbs/libexec/pbs_habitat to update it.
*** End of /opt/pbs/libexec/pbs_habitat
Home directory /var/spool/pbs updated.
PBS mom[root@4cb47ea5cc6b PBSPro_19.x.x]# ps -ef | grep pbs_mom
root 175 1 0 13:22 ? 00:00:00 /opt/pbs/sbin/pbs_mom
root 179 1 0 13:22 pts/0 00:00:00 grep --color=auto pbs_mom
could you please send me the ulimit -a of node root@cn1
i need to compare it with my vm
regards
deepak
Please find below:
root@cn1:~# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 31641
max locked memory (kbytes, -l) 16384
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 31641
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Thank you
Thanks Adarsh
will check and get back to you
tried with root
[root@grid ~]# docker run -it --name pbs -h pbs -e PBS_START_MOM=1 pbspro/pbspro bash
Starting PBS
PBS Home directory /var/spool/pbs needs updating.
Running /opt/pbs/libexec/pbs_habitat to update it.
*** Setting default queue and resource limits.
Connecting to PBS dataservice…connected to PBS dataservice@pbs
*** End of /opt/pbs/libexec/pbs_habitat
Home directory /var/spool/pbs updated.
PBS comm
/opt/pbs/sbin/pbs_comm ready (pid=1231), Proxy Name:pbs:17001, Threads:4
setrlimit NPROC: Operation not permitted
pbs_mom startup failed, exit 1 aborting.
tried with user
-bash-4.2$ docker run -it --name pbs -h pbs -e PBS_START_MOM=1 pbspro/pbspro bash
Starting PBS
PBS Home directory /var/spool/pbs needs updating.
Running /opt/pbs/libexec/pbs_habitat to update it.
*** Setting default queue and resource limits.
Connecting to PBS dataservice…connected to PBS dataservice@pbs
*** End of /opt/pbs/libexec/pbs_habitat
Home directory /var/spool/pbs updated.
PBS comm
/opt/pbs/sbin/pbs_comm ready (pid=1227), Proxy Name:pbs:17001, Threads:4
setrlimit NPROC: Operation not permitted
pbs_mom startup failed, exit 1 aborting.
may be some minor mistake but not able to identify :-)
This might help
root@cn1:~# ps -ef | grep docker
root 1157 1 0 20:26 ? 00:00:01 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sockroot 1940 1157 0 20:26 ? 00:00:00 /usr/bin/docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 9000 -container-ip 172.17.0.2 -container-port 9000
root 1958 1033 0 20:26 ? 00:00:00 containerd-shim -namespace moby -workdir /var/lib/containerd/io.containerd.runtime.v1.linux/moby/0aaf775d873d095a97649eeabc717d0126f50a051c2de8acb7d2ade30147993f -address /run/containerd/containerd.sock -containerd-binary /usr/bin/containerd -runtime-root /var/run/docker/runtime-runc
root 3271 3248 0 20:31 pts/1 00:00:00 grep --color=auto docker
root@cn1:~# cd /proc/1157/
root@cn1:/proc/1157# cat limits
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size 8388608 unlimited bytes
Max core file size unlimited unlimited bytes
Max resident set unlimited unlimited bytes
Max processes unlimited unlimited processes
Max open files 1048576 1048576 files
Max locked memory 16777216 16777216 bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 31641 31641 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us