# How to submit jobs from a remote host to a cluster

**URL:** <https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232>\
**Category:** Users/Site Administrators\
**Created:** [August 2, 2022, 5:19pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232 "2022-08-02T17:19:55Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 5:19pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/1 "2022-08-02T17:19:56Z")

</div>

I am running a cluster called archer. Its running fine. I have a remote machine called Topgun. I installed the server software on Topgun and pointed to Archer as the server. I can do a “qstat” and see jobs running on archer. I would like to submit jobs on Topgun to be run on Archer, but it just sits there.

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [August 2, 2022, 5:30pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/2 "2022-08-02T17:30:03Z")

</div>

Please share the the below command output

```auto
**Archer** :
1. qstat -Bf
2. pbsnodes -aSjv
3. cat /etc/pbs.conf
4. qstat -answ1

**Topgun**
1. qstat -Bf
2. pbsnodes -av
3. cat /etc/pbs.conf
4. qstat -answ1

```

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 5:53pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/3 "2022-08-02T17:53:13Z")

</div>

Hard to provide that info since I am in a classified environment and the commands are providing fully qualified domain names.

If I try to submit an interactive job on topgun I get this:

-bash-4.2$ qsub -I

qsub: waiting for job 194734.archer.xxx.xxx to start

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 6:23pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/4 "2022-08-02T18:23:32Z")

</div>

Qstat on both machines see the jobs running on archer. pbsnodes -a shows only the nodes on Archer, which is what I want. I don’t want jobs to run on Topgun, I only want to run jobs on the Archer cluster,

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 6:43pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/5 "2022-08-02T18:43:21Z")

</div>

08/02/2022 17:51:53;0080;Server@archer;Req;req\_reject;Reject reply code=15139, aux=0, type=8, from ramos@topgun.xxx.xxx.xx

Archer see the request, just refuses it

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 7:09pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/6 "2022-08-02T19:09:38Z")

</div>

PBS\_SERVER=archer.xx.xx.xx  
PBS\_START\_SERVER=1  
PBS\_START\_SCHED=1  
PBS\_START\_COMM=1  
PBS\_START\_MOM=0  
PBS\_EXEC=/opt/pbs  
PBS\_HOME=/var/spool/pbs  
PBS\_CORE\_LIMIT=unlimited  
PBS\_SCP=/bin/scp

pbs.conf is identical on both machines.

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 2, 2022, 10:01pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/7 "2022-08-02T22:01:08Z")

</div>

I am finally able to submit a job after setting up the ssh keys, but interactive jobs fail.

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [August 3, 2022, 7:38am UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/8 "2022-08-03T07:38:55Z")

</div>

Thank you for all the above details and tests.

1. Interactive job might be failing due to firewalls or ports being blocked  
Please refer:  
[Interactive Job errors out with 'apparently deleted' - #13 by scc](https://community.openpbs.org/t/interactive-job-errors-out-with-apparently-deleted/1112/13)  
[Interactive Job errors out with 'apparently deleted' - #16 by adarsh](https://community.openpbs.org/t/interactive-job-errors-out-with-apparently-deleted/1112/16)

> [@brownwrap](#):
>
> 08/02/2022 17:51:53;0080;Server@archer;Req;req\_reject;Reject reply code=15139, aux=0, type=8, from ramos@topgun.xxx.xxx.xx
> 
> Archer see the request, just refuses it

Please refer: [Where to submit a job instead of pbs server - #10 by scc](https://community.openpbs.org/t/where-to-submit-a-job-instead-of-pbs-server/513/10)

Thank you

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [August 3, 2022, 7:40am UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/9 "2022-08-03T07:40:55Z")

</div>

> [@brownwrap](#):
>
> Qstat on both machines see the jobs running on archer. pbsnodes -a shows only the nodes on Archer, which is what I want. I don’t want jobs to run on Topgun, I only want to run jobs on the Archer cluster,

Then the /etc/pbs.conf file on the Topgun should be (as it is only used to submit jobs to Archer and would be like a client node or login node , it would not be running any of the pbs services/daemons but has only the command line tools for job managment)

PBS\_SERVER=archer.xx.xx.xx  
PBS\_START\_SERVER=0  
PBS\_START\_SCHED=0  
PBS\_START\_COMM=0  
PBS\_START\_MOM=0  
PBS\_EXEC=/opt/pbs  
PBS\_HOME=/var/spool/pbs  
PBS\_CORE\_LIMIT=unlimited  
PBS\_SCP=/bin/scp

---

<div class="post-metadata">

**Author:** ![agurban](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.openpbs.org/agurban/32/67_2.png) [@agurban](https://community.openpbs.org/u/agurban)\
**Post date:** [August 5, 2022, 4:58pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/10 "2022-08-05T16:58:33Z")

</div>

Please see the PBS Professional Installation and Upgrade Guide, especially chapter 1, “PBS Architecture”, chapter 2, “Pre-installation Steps”, and chapter 3, “Installation”.

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 5, 2022, 5:17pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/11 "2022-08-05T17:17:28Z")

</div>

I have it working, to a degree. I have another cluster called Maury. It is the conventional cluse with a head node and two login nodes, Maury1 and Maury. We have another machine that doesn’t show up with “pbsnodes -a”, but can submit jobs. That machine can also 'qsub -I" and land on one of the compute nodes. The users is satisfied now that he can submit jobs, but he can’t run an interactive job.

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [August 5, 2022, 6:48pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/12 "2022-08-05T18:48:36Z")

</div>

Please note that  
`pbsnodes -a` # shows only the compute node(s) added to the pbs server using the command  
`qmgr -c "create node node-hostname"`

If you have login nodes (say none of the PBS Services are running on them, but only commands are deployed ) , these would not be part of the compute resources and would not show in pbsnodes -a output.

---

<div class="post-metadata">

**Author:** ![brownwrap](https://avatars.discourse-cdn.com/v4/letter/b/94ad74/32.png) [@brownwrap](https://community.openpbs.org/u/brownwrap)\
**Post date:** [August 5, 2022, 7:09pm UTC](https://community.openpbs.org/t/how-to-submit-jobs-from-a-remote-host-to-a-cluster/3232/13 "2022-08-05T19:09:26Z")

</div>

I understand all of that I made all of that, I installed PBS on it. I know I installed the machine that can submit job remotely, because the PBS software is in my home directory. I was originally based on PBS 13 something. I upgraded that cluster a couple of years ago. It is a paid for version with support. I just don’t understand why I can run interactive jobs on that cluster from a machine that doesn’t show up on “pbsnodes -a”.
