# Configure submission hosts for multiple servers

**URL:** <https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608>\
**Category:** Users/Site Administrators\
**Created:** [July 6, 2023, 11:09pm UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608 "2023-07-06T23:09:42Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![sijisaula](https://avatars.discourse-cdn.com/v4/letter/s/779978/32.png) [@sijisaula](https://community.openpbs.org/u/sijisaula)\
**Post date:** [July 6, 2023, 11:09pm UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/1 "2023-07-06T23:09:42Z")

</div>

Hello,

Currently, we have two independent clusters, say cluster A and cluster B served by PBS servers, serverA and serverB.

Also, we have submission hosts that are currently configured to submit only to their cluster; i.e. submitHostA can submit to serverA and similarly, submitHostB to serverB.

My question is, how can I configure submitHostA to submit jobs both to serverA as well as serverB? Also, any caveats or dangers to this architecture?

---

<div class="post-metadata">

**Author:** ![dtalcott](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.openpbs.org/dtalcott/32/410_2.png) [@dtalcott](https://community.openpbs.org/u/dtalcott)\
**Post date:** [July 7, 2023, 4:25am UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/2 "2023-07-07T04:25:31Z")

</div>

What we did is set up routing queues on submitHostA that just forward jobs to matching queues on serverB.

As to caveats, etc, this setup works best if serverA and serverB share accounts, home directories (e.g., via NFS), and other important file systems. Also, it helps if serverB trusts submitHostA (in addition to serverA). That way, a user on submitHostA can run various PBS commands (qstat, qdel, …) using the `@serverB` syntax. (E.g., `qstat @serverB`, `qdel 1234.serverA@serverB`)

Further, if a submitHostA user knows they are going to be interacting only with serverB for a while, they can set PBS\_DEFAULT=serverB in their environment and all PBS commands will have an implicit `@serverB`.

---

<div class="post-metadata">

**Author:** ![Source](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.openpbs.org/source/32/756_2.png) [@Source](https://community.openpbs.org/u/Source)\
**Post date:** [July 17, 2023, 7:48am UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/3 "2023-07-17T07:48:41Z")

</div>

I personally prefer to set PBS\_SERVER environment right before the call to the qsub/qstat. Be warned that v20+ qcmds might be compaitable with old servers (v19 or less)

---

<div class="post-metadata">

**Author:** ![sijisaula](https://avatars.discourse-cdn.com/v4/letter/s/779978/32.png) [@sijisaula](https://community.openpbs.org/u/sijisaula)\
**Post date:** [July 19, 2023, 6:17pm UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/4 "2023-07-19T18:17:53Z")

</div>

So attempting the basic qstat of the remote server and receiving:

```auto
$ qstat -B $PBS_SERVER

No Permission.

qstat: cannot connect to server master.ib.prime (errno=15007)

```

Any specific perms needing to be granted on the remote server side?

---

<div class="post-metadata">

**Author:** ![sijisaula](https://avatars.discourse-cdn.com/v4/letter/s/779978/32.png) [@sijisaula](https://community.openpbs.org/u/sijisaula)\
**Post date:** [August 8, 2023, 5:16pm UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/5 "2023-08-08T17:16:13Z")

</div>

Hi @adarsh - Say, any help you can provide on the above issue?

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [August 10, 2023, 6:50am UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/6 "2023-08-10T06:50:52Z")

</div>

Please check the server logs, when you run the above command. .  
It might be related to acl\_users set in the server configuration.

---

<div class="post-metadata">

**Author:** ![sijisaula](https://avatars.discourse-cdn.com/v4/letter/s/779978/32.png) [@sijisaula](https://community.openpbs.org/u/sijisaula)\
**Post date:** [October 9, 2023, 6:46pm UTC](https://community.openpbs.org/t/configure-submission-hosts-for-multiple-servers/3608/7 "2023-10-09T18:46:09Z")

</div>

Hi @adarsh

We don’t have server acls for hosts/users enabled. Also, I see no errors in server logs on either server.

Also, here is the error we see when we attempt from the OpenPBS 2021 server (bright03-ib) to the PBS Pro 18.1.4 server (bright01-ib):

> qstat -B bright01-ib
> 
> auth: error returned: -1
> 
> auth: Unable to authenticate connection (bright01-ib:15001)
> 
> qstat: cannot connect to server bright01-ib (errno=-1)

Any additional troubleshooting steps to try?
