# Qsub from different location **URL:** \ **Category:** Users/Site Administrators\ **Created:** [December 18, 2024, 3:40pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047 "2024-12-18T15:40:26Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Bert](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Bert](https://community.openpbs.org/u/Bert)\ **Post date:** [December 18, 2024, 3:40pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/1 "2024-12-18T15:40:26Z")
Running qsub inside the job folder (mounted drive) or on the root gives different results: 1- [saf112092@ip-0A582E84 test14]$ qsub FeaJob.py (inside job folder) 2- [saf112092@ip-0A582E84 /]$ qsub /mnt/data/Public/pbs2/test14/FeaJob.py (outside job folder) 1 Works fine 2 Stagein, Running works fine but Stageout doesn’t work. In case 2, MOM LOG shows: 12/18/2024 14:26:55;0001;pbs\_mom;Fil;copy\_file;Job 26.ip-0A582E84: sys\_copy failed, return value=1 12/18/2024 14:26:55;0004;pbs\_mom;Fil;26.ip-0A582E84.OU;Unable to copy file 26.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o26 12/18/2024 14:26:55;0004;pbs\_mom;Fil;26.ip-0A582E84.OU;ip-0A582E84: Connection refused 12/18/2024 14:26:55;0001;pbs\_mom;Fil;stage\_file;Job 26.ip-0A582E84: no wildcards:remote stageout failed for saf112092 from 26.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o26 12/18/2024 14:26:55;0100;pbs\_mom;Job;26.ip-0A582E84;Job files not copied:----\>\>\>\> 12/18/2024 14:26:55;0100;pbs\_mom;Job;26.ip-0A582E84;Unable to copy file 26.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o26 12/18/2024 14:26:55;0100;pbs\_mom;Job;26.ip-0A582E84;\>\>\> error from copy 12/18/2024 14:26:55;0100;pbs\_mom;Job;26.ip-0A582E84;ip-0A582E84: Connection refused 12/18/2024 14:26:55;0100;pbs\_mom;Job;26.ip-0A582E84;\>\>\> end error output Regards, ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [December 18, 2024, 5:30pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/2 "2024-12-18T17:30:37Z")
Please increase the mom log level and check the detailed mom log. From the above logs it seems the firewall or ports blocked or network issues. It seems staging out of stdout /stderr is failing to the location where the qsub was initiated. Also, if you could share the snippet of your stagein and stageout attribute might help ---
**Author:** ![Bert](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Bert](https://community.openpbs.org/u/Bert)\ **Post date:** [December 19, 2024, 12:28pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/3 "2024-12-19T12:28:01Z")
> [@adarsh](#): > > mom log level I rerun the 2 cases: 1- [saf112092@ip-0A582E84 test14]$ qsub FeaJob.py (job 27) 2- [saf112092@ip-0A582E84 /]$ qsub /mnt/data/Public/pbs2/test14/FeaJob.py (job 28) In case 2 it looks like it is trying to copy: /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU whereas it is supposed to use pbs\_cp In case 1 pbs\_cp works fine 12/19/2024 12:00:05;0100;pbs\_mom;Req;;Type 54 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:00:05;0080;pbs\_mom;Job;27.ip-0A582E84;copy file request received 12/19/2024 12:00:05;0008;pbs\_mom;Job;27.ip-0A582E84;created the job directory /home/saf112092/pbs.27.ip-0A582E84.x8z 12/19/2024 12:00:06;0100;pbs\_mom;Job;27.ip-0A582E84;Staged 1/1 items in over 0:00:01 12/19/2024 12:00:07;0100;pbs\_mom;Req;;Type 1 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:00:07;0100;pbs\_mom;Req;;Type 3 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:00:07;0100;pbs\_mom;Req;;Type 5 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:00:07;0008;pbs\_mom;Job;27.ip-0A582E84;created the job directory /home/saf112092/pbs.27.ip-0A582E84.x8z 12/19/2024 12:00:07;0008;pbs\_mom;Job;27.ip-0A582E84;Started, pid = 12666 12/19/2024 12:05:38;0080;pbs\_mom;Job;27.ip-0A582E84;task 00000001 terminated 12/19/2024 12:05:38;0008;pbs\_mom;Job;27.ip-0A582E84;Terminated 12/19/2024 12:05:38;0100;pbs\_mom;Job;27.ip-0A582E84;task 00000001 cput=00:00:03 12/19/2024 12:05:38;0008;pbs\_mom;Job;27.ip-0A582E84;kill\_job 12/19/2024 12:05:38;0100;pbs\_mom;Job;27.ip-0A582E84;ip-0A582E86 cput=00:00:03 mem=247480kb 12/19/2024 12:05:38;0100;pbs\_mom;Job;27.ip-0A582E84;Obit sent 12/19/2024 12:05:39;0100;pbs\_mom;Req;;Type 54 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:05:39;0080;pbs\_mom;Job;27.ip-0A582E84;copy file request received 12/19/2024 12:05:39;0100;pbs\_mom;Job;27.ip-0A582E84;Staged 3/3 items out over 0:00:00 12/19/2024 12:05:39;0008;pbs\_mom;Job;27.ip-0A582E84;no active tasks 12/19/2024 12:05:39;0100;pbs\_mom;Req;;Type 55 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:05:39;0080;pbs\_mom;Job;27.ip-0A582E84;delete file request received 12/19/2024 12:05:39;0008;pbs\_mom;Job;27.ip-0A582E84;no active tasks 12/19/2024 12:05:39;0100;pbs\_mom;Req;;Type 6 request received from root@10.88.46.132:15001, sock=0 12/19/2024 12:05:39;0080;pbs\_mom;Job;27.ip-0A582E84;delete job request received 12/19/2024 12:05:39;0008;pbs\_mom;Job;27.ip-0A582E84;kill\_job 12/19/2024 12:08:07;0001;pbs\_mom;Svr;pbs\_mom;im\_eof, Premature end of message from addr 10.88.46.132:15001 on stream 0 12/19/2024 12:08:07;0002;pbs\_mom;Svr;im\_eof;Server closed connection. 12/19/2024 12:08:07;0002;pbs\_mom;Svr;pbs\_mom;HELLO sent to server at ip-0A582E84:15001, stream:1 12/19/2024 12:08:07;0001;pbs\_mom;Svr;pbs\_mom;im\_eof, Premature end of message from addr 10.88.46.132:15001 on stream 1 12/19/2024 12:08:07;0002;pbs\_mom;Svr;im\_eof;Server closed connection. 12/19/2024 12:08:08;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Connection to pbs\_comm ip-0A582E84:17001 down 12/19/2024 12:08:08;0001;pbs\_mom;Svr;net\_down\_handler;net down handler called 12/19/2024 12:08:10;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Registering address 10.88.46.134:15003 to pbs\_comm ip-0A582E84:17001 12/19/2024 12:08:10;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Connected to pbs\_comm ip-0A582E84:17001 12/19/2024 12:08:10;0001;pbs\_mom;Svr;net\_restore\_handler;net restore handler called 12/19/2024 12:08:14;0002;pbs\_mom;Svr;pbs\_mom;HELLO sent to server at ip-0A582E84:15001, stream:2 12/19/2024 12:08:14;0002;pbs\_mom;Svr;pbs\_mom;ReplyHello from server at 10.88.46.132:15001 12/19/2024 12:09:18;0100;pbs\_mom;Req;;Type 54 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:09:18;0080;pbs\_mom;Job;28.ip-0A582E84;copy file request received 12/19/2024 12:09:18;0008;pbs\_mom;Job;28.ip-0A582E84;created the job directory /home/saf112092/pbs.28.ip-0A582E84.x8z 12/19/2024 12:09:18;0100;pbs\_mom;Job;28.ip-0A582E84;Staged 1/1 items in over 0:00:00 12/19/2024 12:09:19;0100;pbs\_mom;Req;;Type 1 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:09:19;0100;pbs\_mom;Req;;Type 3 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:09:19;0100;pbs\_mom;Req;;Type 5 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:09:19;0008;pbs\_mom;Job;28.ip-0A582E84;created the job directory /home/saf112092/pbs.28.ip-0A582E84.x8z 12/19/2024 12:09:19;0008;pbs\_mom;Job;28.ip-0A582E84;Started, pid = 12984 12/19/2024 12:12:32;0080;pbs\_mom;Job;28.ip-0A582E84;task 00000001 terminated 12/19/2024 12:12:32;0008;pbs\_mom;Job;28.ip-0A582E84;Terminated 12/19/2024 12:12:32;0100;pbs\_mom;Job;28.ip-0A582E84;task 00000001 cput=00:00:01 12/19/2024 12:12:32;0008;pbs\_mom;Job;28.ip-0A582E84;kill\_job 12/19/2024 12:12:32;0100;pbs\_mom;Job;28.ip-0A582E84;ip-0A582E86 cput=00:00:01 mem=81772kb 12/19/2024 12:12:32;0100;pbs\_mom;Job;28.ip-0A582E84;Obit sent 12/19/2024 12:12:33;0100;pbs\_mom;Req;;Type 54 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:12:33;0080;pbs\_mom;Job;28.ip-0A582E84;copy file request received 12/19/2024 12:13:04;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU saf112092@ip-0a582e84://FeaJob.py.o28 status=1, try=1 12/19/2024 12:13:35;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU saf112092@ip-0a582e84://FeaJob.py.o28 status=1, try=2 12/19/2024 12:14:17;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU saf112092@ip-0a582e84://FeaJob.py.o28 status=1, try=3 12/19/2024 12:14:48;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU saf112092@ip-0a582e84://FeaJob.py.o28 status=1, try=4 12/19/2024 12:15:09;0001;pbs\_mom;Fil;copy\_file;Job 28.ip-0A582E84: sys\_copy failed, return value=1 12/19/2024 12:15:09;0004;pbs\_mom;Fil;28.ip-0A582E84.OU;Unable to copy file 28.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o28 12/19/2024 12:15:09;0004;pbs\_mom;Fil;28.ip-0A582E84.OU;ip-0A582E84: Connection refused 12/19/2024 12:15:09;0001;pbs\_mom;Fil;stage\_file;Job 28.ip-0A582E84: no wildcards:remote stageout failed for saf112092 from 28.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o28 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;Job files not copied:----\>\>\>\> 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;Unable to copy file 28.ip-0A582E84.OU to ip-0a582e84://FeaJob.py.o28 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;\>\>\> error from copy 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;ip-0A582E84: Connection refused 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;\>\>\> end error output 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;----\>\>\>\> 12/19/2024 12:15:09;0100;pbs\_mom;Job;28.ip-0A582E84;Staged 0/3 items out over 0:02:36 12/19/2024 12:15:09;0008;pbs\_mom;Job;28.ip-0A582E84;no active tasks 12/19/2024 12:15:09;0080;pbs\_mom;Req;req\_reject;Reject reply code=15051, aux=0, type=54, from root@10.88.46.132:15001 12/19/2024 12:15:09;0100;pbs\_mom;Req;;Type 55 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:15:09;0080;pbs\_mom;Job;28.ip-0A582E84;delete file request received 12/19/2024 12:15:09;0008;pbs\_mom;Job;28.ip-0A582E84;no active tasks 12/19/2024 12:15:09;0100;pbs\_mom;Req;;Type 6 request received from root@10.88.46.132:15001, sock=2 12/19/2024 12:15:09;0080;pbs\_mom;Job;28.ip-0A582E84;delete job request received 12/19/2024 12:15:09;0008;pbs\_mom;Job;28.ip-0A582E84;kill\_job PBS Script: #!/shared/apps/Python3.12/bin/python3.12 # declare a private sandbox. # all files will be copied to private directory in C:\Users\safxxxxx\Documents\PBS Pro\pbs.####.awesv0061.x8z # #PBS -W sandbox=private # Specify which directory to copy for input and where to get the output # #PBS -W stagein=‘.@10.88.46.132:/mnt/data/Public/pbs2/test14/_’ #PBS -W stageout='_@10.88.46.132:/mnt/data/Public/pbs2/test14/’ # request Abaqus ressources # #PBS -l select=1:ncpus=1:mem=2gb:vm\_size=Standard\_D2ds\_v5 #PBS -l lic\_abaqus\_q=5 # Specify user Account #PBS -A saf112092 # Specify work queue #PBS -q workq Tracejob 28: Job: 28.ip-0A582E84 12/19/2024 12:09:18 L Considering job to run 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_max: entered for workq 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_max: exiting, ret 0 [max\_queued limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_queued: entered for workq 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_max: entered for server 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_max: exiting, ret 0 [max\_queued limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_queued: entered for server 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_ct\_limit\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_max: entered for workq, alt\_res (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_max: exiting, ret 0 [max\_queued\_res limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_queued: entered for workq, alt\_res (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_max: entered for server, alt\_res (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_max: exiting, ret 0 [max\_queued\_res limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_queued: entered for server, alt\_res (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: check\_entity\_resc\_limit\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, INCR on server ip-0A582E84, op\_flag f, alt\_res\_ptr (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_max: exiting, ret 0 [max\_queued limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: exiting, ret 0 [max\_queued\_res limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, INCR on queue workq, op\_flag f, alt\_res\_ptr (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_max: exiting, ret 0 [max\_queued limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: exiting, ret 0 [max\_queued\_res limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 12/19/2024 12:09:18 S Job Queued at request of saf112092@ip-0a582e84, owner = saf112092@ip-0a582e84, job name = FeaJob.py, queue = workq 12/19/2024 12:09:18 S Job Run at request of Scheduler@ip-0a582e84 on exec\_vnode (ip-0A582E86:ncpus=1:mem=2097152kb) 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, DECR on server ip-0A582E84, op\_flag 7, alt\_res\_ptr (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for server] 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, DECR on queue workq, op\_flag 7, alt\_res\_ptr (nil) 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: entered [alt\_res (nil)] 12/19/2024 12:09:18 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_queued: exiting, ret 0 [queued\_jobs\_threshold\_res limit not set for workq] 12/19/2024 12:09:18 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 12/19/2024 12:09:18 L Job run 12/19/2024 12:09:18 S Updated job state to 81 and substate to 11 12/19/2024 12:09:18 S enqueuing into workq, state Q hop 1 12/19/2024 12:09:18 S Updated job state to 82 and substate to 15 12/19/2024 12:09:19 S Updated job state to 82 and substate to 41 12/19/2024 12:09:21 S Received session ID for job: 12984 12/19/2024 12:09:21 S Updated job state to 82 and substate to 42 12/19/2024 12:09:31 S Received the same SID as before: 12984 12/19/2024 12:09:47 S Received the same SID as before: 12984 12/19/2024 12:10:10 S Received the same SID as before: 12984 12/19/2024 12:10:38 S Received the same SID as before: 12984 12/19/2024 12:11:12 S Received the same SID as before: 12984 12/19/2024 12:11:52 S Received the same SID as before: 12984 12/19/2024 12:12:33 S Obit received momhop:1 serverhop:1 state:R substate:42 12/19/2024 12:12:33 S Updated job state to 69 and substate to 50 12/19/2024 12:12:33 S Updated job state to 69 and substate to 51 12/19/2024 12:15:09 S Post job file processing error 12/19/2024 12:15:09 S Updated job state to 69 and substate to 52 12/19/2024 12:15:09 S Updated job state to 69 and substate to 53 12/19/2024 12:15:09 S Exit\_status=0 resources\_used.cpupercent=2 resources\_used.cput=00:00:01 resources\_used.mem=81772kb resources\_used.ncpus=1 resources\_used.vmem=272868kb resources\_used.walltime=00:03:13 12/19/2024 12:15:09 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, DECR on server ip-0A582E84, op\_flag b, alt\_res\_ptr (nil) 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_max: exiting, ret 0 [max\_queued limit not set for server] 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: entered [alt\_res (nil)] 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: exiting, ret 0 [max\_queued\_res limit not set for server] 12/19/2024 12:15:09 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 12/19/2024 12:15:09 S ET\_LIM\_DBG: account\_entity\_limit\_usages: entered, DECR on queue workq, op\_flag b, alt\_res\_ptr (nil) 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_ct\_sum\_max: exiting, ret 0 [max\_queued limit not set for workq] 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: entered [alt\_res (nil)] 12/19/2024 12:15:09 S ET\_LIM\_DBG: set\_entity\_resc\_sum\_max: exiting, ret 0 [max\_queued\_res limit not set for workq] 12/19/2024 12:15:09 S ET\_LIM\_DBG: account\_entity\_limit\_usages: exiting, ret\_error 0 ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [December 19, 2024, 12:35pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/4 "2024-12-19T12:35:33Z")
> [@Bert](#): > > In case 2 it looks like it is trying to copy: > /opt/pbs/sbin/pbs\_rcp -rp 28.ip-0A582E84.OU > whereas it is supposed to use pbs\_cp Thank you for sharing the below details and information. Please update the /etc/pbs.conf (on server and compute nodes as below in the same order) PBS\_RCP=/bin/false PBS\_SCP=/bin/scp PBS\_RSHCOMMAND=/bin/ssh and restart the pbs services and try again. If you would lick to use “cp” then you would need to used $usecp attribute in the $PBS\_HOME/mom\_priv/config. - also the paths used in $usecp should be common across pbs server host and compute nodes [https://help.altair.com/2024.1.0/PBS%20Professional/PBS2024.1.pdf](https://help.altair.com/2024.1.0/PBS%20Professional/PBS2024.1.pdf) - 9.7.1.1 Configuring the $usecp MoM Parameter ---
**Author:** ![Bert](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Bert](https://community.openpbs.org/u/Bert)\ **Post date:** [December 19, 2024, 3:47pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/5 "2024-12-19T15:47:22Z")
I don’t want to use RCP, SCP or SSH. I configured pbs\_cp as follow: /etc/pbs.conf: PBS\_SERVER=ip-0A582E84 PBS\_START\_SERVER=0 PBS\_START\_SCHED=0 PBS\_START\_COMM=0 PBS\_START\_MOM=1 PBS\_EXEC=/opt/pbs PBS\_HOME=/var/spool/pbs PBS\_CORE\_LIMIT=unlimited # PBS\_SCP=/bin/scp PBS\_CP=/usr/bin/pbs\_cp /usr/bin/pbs\_cp: #!/bin/sh /usr/bin/cp -r $2 $3 /var/spool/pbs/mom\_priv/config: $restrict\_user\_maxsysid 999 $usecp \*:/mnt/data/ /mnt/data/ ---
**Author:** ![Bert](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Bert](https://community.openpbs.org/u/Bert)\ **Post date:** [December 19, 2024, 3:52pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/6 "2024-12-19T15:52:41Z")
I found a way around. Since I am using a python script to automates the pbs requests with subprocess, specifying the cwd makes it work: request = ‘qsub /mnt/data/Public/pbs2/test14/FeaJob.py’ path = Path(request.split(’ ‘)[1]) cmd = request.split(’ ')[0] + ’ ’ + path.name proc = subprocess.run(cmd, cwd=path.parent, stdout=subprocess.PIPE, stderr=subprocess.PIPE, universal\_newlines=True, shell=True) This manner makes it to be always case 1. What would it change if changing pbs.conf in my case? PBS\_RCP=/bin/false PBS\_SCP=/bin/scp PBS\_RSHCOMMAND=/bin/ssh Bertrand. ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [December 19, 2024, 3:56pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/7 "2024-12-19T15:56:10Z")
> [@Bert](#): > > What would it change if changing pbs.conf in my case? > PBS\_RCP=/bin/false > PBS\_SCP=/bin/scp > PBS\_RSHCOMMAND=/bin/ssh Please use the lines in this order: we would like to avoid trying pbs\_rcp PBS\_RCP=/bin/false PBS\_CP=/usr/bin/pbs\_cp PBS\_RSHCOMMAND=/bin/ssh ---
**Author:** ![Bert](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Bert](https://community.openpbs.org/u/Bert)\ **Post date:** [December 19, 2024, 5:42pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/8 "2024-12-19T17:42:42Z")
Thanks, I did it. It is not working either: 12/19/2024 17:33:57;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 33.ip-0A582E84.OU saf112092@ip-0a582e84:/opt/ **job\_serv** /FeaJob.py.o33 status=1, try=1 12/19/2024 17:34:28;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 33.ip-0A582E84.OU saf112092@ip-0a582e84:/opt/ **job\_serv** /FeaJob.py.o33 status=1, try=2 12/19/2024 17:35:10;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 33.ip-0A582E84.OU saf112092@ip-0a582e84:/opt/`job_serv`/FeaJob.py.o33 status=1, try=3 12/19/2024 17:35:41;0080;pbs\_mom;Fil;sys\_copy;command: /opt/pbs/sbin/pbs\_rcp -rp 33.ip-0A582E84.OU saf112092@ip-0a582e84:/opt/ **job\_serv** /FeaJob.py.o33 status=1, try=4 I looks like the stageout is pointing to the wrong folder. It is pointing to the folder where I executed the job: [saf112092@ip-0A582E84 **job\_serv**]$ qsub /mnt/data/Public/pbs2/test14/FeaJob.py However the pbs script states: #!/shared/apps/Python3.12/bin/python3.12 #PBS -W sandbox=private #PBS -W stagein=‘.@10.88.46.132:/mnt/data/Public/pbs2/test14/_’ #PBS -W stageout='_@10.88.46.132:/mnt/data/Public/pbs2/test14/’ ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [December 19, 2024, 9:01pm UTC](https://community.openpbs.org/t/qsub-from-different-location/4047/9 "2024-12-19T21:01:32Z")
> [@Bert](#): > > Thanks, I did it. Did you change the /etc/pbs.conf on the Compute Node as well and restarted the pbs services.? > [@Bert](#): > > #!/shared/apps/Python3.12/bin/python3.12 ```auto #PBS -S /shared/apps/Python3.12/bin/python3.12 ``` > [@Bert](#): > > #PBS -W stagein=‘.@10.88.46.132:/mnt/data/Public/pbs2/test14/_’_ _Please could you check whether you can use file names instead of wild characters for stagein_ _```auto #PBS -W stagein=‘file1.txt@10.88.46.132:/mnt/data/Public/pbs2/test14/file1.txt,inputfile.txt@10.88.46.132:/mnt/data/Public/pbs2/test14/inputfile.txt’_ _```_