# Pbs\_mom adding every IP address as authorized

**URL:** <https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113>\
**Category:** Users/Site Administrators\
**Created:** [June 2, 2022, 7:20am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113 "2022-06-02T07:20:15Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 2, 2022, 7:20am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/1 "2022-06-02T07:20:15Z")

</div>

I have set Ansible to install and configure openpbs for me but when i use it recently i am getting an error where the pbs node does not start.  
when i check the log logs it is adding what looks to be every IP possible IPv4 address as authorized

_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.148 as authorized_  
_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.149 as authorized_  
_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.150 as authorized_  
_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.151 as authorized_  
_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.152 as authorized_  
_06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.153 as authorized_

looking at the logs earlier i can see that it does start talking to the schedular (lsr-pbssched01)  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;Log;Log opened_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;pbs\_version=20.0.0_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;pbs\_build=mach=N/A:security=N/A:configure\_args=N/A_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;hostname=lsr-hpc16;pbs\_leaf\_name=N/A;pbs\_mom\_node\_name=N/A_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;ipv4 interface lo: localhost_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;ipv4 interface bond0: lsr-hpc16.usc.internal_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;ipv6 interface lo: ip6-loopback_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;ipv6 interface bond0: lsr-hpc16_  
_06/02/2022 15:59:51;0100;pbs\_mom;Svr;parse\_config;file config_  
_06/02/2022 15:59:51;0002;pbs\_mom;n/a;set\_restrict\_user\_maxsys;setting 999_  
_06/02/2022 15:59:51;0002;pbs\_mom;n/a;read\_config;max\_check\_poll = 120, min\_check\_poll = 10_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 127.0.0.1 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 127.0.1.1 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 172.23.20.186 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 172.23.20.59 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;set\_checkpoint\_path;Using default checkpoint path._  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;set\_checkpoint\_path;Setting checkpoint path to /var/spool/pbs/checkpoint/_  
_06/02/2022 15:59:51;0400;pbs\_mom;Hook;resourcedef;hooks\_rescdef\_checksum(/var/spool/pbs/mom\_priv/hooks/resourcedef)=0_  
_06/02/2022 15:59:52;0002;pbs\_mom;n/a;ncpus;hyperthreading enabled_  
_06/02/2022 15:59:52;0800;pbs\_mom;Node;mom\_topology;allocated log buffer, len 132129_  
_06/02/2022 15:59:52;0800;pbs\_mom;Node;mom\_topology;topology exported_  
_06/02/2022 15:59:52;0800;pbs\_mom;Node;mom\_topology;attribute 'topology\_info = hwloc\<?xml version=“1.0” encoding="UTF-_  
_8"?\>_  
_06/02/2022 15:59:52;0800;pbs\_mom;Node;mom\_topology;resource ‘resources\_available.mem = 1056838624kb’ added_  
_06/02/2022 15:59:52;0800;pbs\_mom;Node;mom\_topology;resource ‘resources\_available.ncpus = 64’ added_  
_06/02/2022 15:59:52;0002;pbs\_mom;n/a;initialize;pcpus=64, OS reports 64 cpu(s)_  
_06/02/2022 15:59:52;0d80;pbs\_mom;TPP;pbs\_mom(Main Thread);TPP authentication method = resvport_  
_06/02/2022 15:59:52;0c06;pbs\_mom;TPP;pbs\_mom(Main Thread);TPP leaf node names = 172.23.20.186:15003,127.0.0.1:15003,1_  
_72.23.20.186:15003_  
_06/02/2022 15:59:52;0d80;pbs\_mom;TPP;pbs\_mom(Main Thread);Initializing TPP transport Layer_  
_06/02/2022 15:59:52;0d80;pbs\_mom;TPP;pbs\_mom(Main Thread);Max files allowed = 16384_  
_06/02/2022 15:59:52;0d80;pbs\_mom;TPP;pbs\_mom(Main Thread);TPP initialization done_  
_06/02/2022 15:59:52;0d80;pbs\_mom;TPP;pbs\_mom(Main Thread);Connecting to pbs\_comm lsr-pbssched01:17001_  
_06/02/2022 15:59:52;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Thread ready_  
_06/02/2022 15:59:52;0006;pbs\_mom;Fil;pbs\_mom;Version 20.0.0, started, initialization type = 0_  
_06/02/2022 15:59:52;0002;pbs\_mom;Svr;pbs\_mom;Mom pid = 13453 ready, using ports Server:15001 MOM:15002 RM:15003_  
_06/02/2022 15:59:52;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Registering address 172.23.20.186:15003 to pbs\_comm lsr-pbssch_  
_ed01:17001_  
_06/02/2022 15:59:52;0c06;pbs\_mom;TPP;pbs\_mom(Thread 0);Connected to pbs\_comm lsr-pbssched01:17001_  
_06/02/2022 15:59:52;0800;pbs\_mom;n/a;uname2release;uname release: 5.4.0-113-generic_  
_06/02/2022 15:59:52;0800;pbs\_mom;n/a;mom\_get\_sample;nprocs: 743, cantstat: 1, nomem: 0, skipped: 663, cached: 0_  
_06/02/2022 15:59:52;0001;pbs\_mom;Svr;net\_restore\_handler;net restore handler called_  
_06/02/2022 15:59:54;0c00;pbs\_mom;TPP;pbs\_mom(Main Thread);tpp\_send;_\*\*\* sd=0, compr\_len=26, len=26, dest\_sd=429496729\*  
_5_  
_06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;HELLO sent to server at lsr-pbssched01:15001, stream:0_  
_06/02/2022 15:59:54;0400;pbs\_mom;Svr;pbs\_mom;Received request: 8_  
_06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.2 as authorized_  
_06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.3 as authorized_  
_06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.4 as authorized_

but lookig in the server log i see (my node is 172.23.20.186 lsr-hpc16)  
_06/02/2022 15:59:51;0001;Server@lsr-pbssched01;Svr;Server@lsr-pbssched01;stream\_eof, 172.23.20.186 down_  
_06/02/2022 15:59:51;0002;Server@lsr-pbssched01;Node;172.23.20.186;node down: communication closed_  
_06/02/2022 15:59:51;0100;Server@lsr-pbssched01;Node;172.23.20.186;set\_all\_state;txt=node down: communication closed mi\_modtime=0_  
_06/02/2022 15:59:51;0100;Server@lsr-pbssched01;Node;lsr-hpc16;set\_vnode\_state;vnode.state=0x102 vnode\_o.state=0x102 vnode.last\_state\_change\_time=1654149591 vnode\_o.last\_state\_change\_time=1654145570 state\_bits=0x2 state\_bit\_op\_type\_str=Nd\_State\_Or state\_bit\_op\_type\_enum=1_  
_06/02/2022 15:59:54;0002;Server@lsr-pbssched01;Node;172.23.20.186;Hello from MoM on port=15002_  
_06/02/2022 15:59:57;0d80;Server@lsr-pbssched01;TPP;Server@lsr-pbssched01(Thread 0);Received UPDATE from pbs\_comm_  
_06/02/2022 15:59:57;0001;Server@lsr-pbssched01;Svr;net\_restore\_handler;net restore handler called_

the pbs conf log on the node is  
cat /etc/pbs.conf  
_#_  
_PBS\_SERVER=lsr-pbssched01_  
_PBS\_START\_SERVER=0_  
_PBS\_START\_SCHED=0_  
_PBS\_START\_COMM=1_  
_PBS\_START\_MOM=1_  
_PBS\_EXEC=/opt/pbs_  
_PBS\_HOME=/var/spool/pbs_  
_PBS\_CORE\_LIMIT=unlimited_  
_PBS\_SCP=/usr/bin/scp_

the oher nodes are all working fine and the ansible playbook used to work fine, i suspect i am missing something basic but cant put my finger on it, any help will be appericated

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [June 2, 2022, 9:09am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/2 "2022-06-02T09:09:06Z")

</div>

> [@pembleto](#):
>
> PBS\_START\_COMM=1

1. PBS\_START\_COMM=0  
You do not need to run PBS\_COMM on the compute nodes. Please set it to 0 and restart the pbs services on the compute node.

2. 

> [@pembleto](#):
>
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.148 as authorized_  
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.149 as authorized_  
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.150 as authorized_  
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.151 as authorized_  
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.152 as authorized_  
> _06/02/2022 17:08:38;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.14.6.153 as authorized_

This is not an issue, it is recognising all the active interfaces from that compute node  
#ip addr | grep “state UP”  
For example on the compute node with one active network interface:  
06/02/2022 09:52:36;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 192.168.1.100 as authorized  
06/02/2022 09:52:36;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 127.0.0.1 as authorized

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 2, 2022, 9:57am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/3 "2022-06-02T09:57:40Z")

</div>

Thanks for getting back to me,  
That list of authorised IP addresses was just an excerpt, it looks to be literally adding every single ipv4 address from 0.0.0.2 to 0.255.255.255,  
The service does not start while it is iterating through every IP address

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 2, 2022, 9:43pm UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/4 "2022-06-02T21:43:42Z")

</div>

I have set the PBS\_START\_COMM=0 and restarted the pbs service.  
i am still getting it iterating through every IP address

it is adding the ones from the local machine during its initalisation  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 127.0.0.1 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 127.0.1.1 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 172.23.20.186 as authorized_  
_06/02/2022 15:59:51;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 172.23.20.59 as authorized_

but it then gets a message  
_06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;HELLO sent to server at lsr-pbssched01:15001, stream:0_  
_06/02/2022 15:59:54;0400;pbs\_mom;Svr;pbs\_mom;Received request: 8_

which then makes it start to iterate through every IP address, excerpt below  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.29 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.30 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.31 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.32 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.33 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.34 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.35 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.36 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.37 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.38 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.39 as authorized  
06/03/2022 07:42:03;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.7.28.40 as authorized

here is the output of my ip addr command

```auto
 ip addr
*1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000*
* link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00*
* inet 127.0.0.1/8 scope host lo*
* valid_lft forever preferred_lft forever*
* inet6 ::1/128 scope host*
* valid_lft forever preferred_lft forever*
*2: ens160: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000*
* link/ether 00:50:56:99:04:62 brd ff:ff:ff:ff:ff:ff*
* inet 172.23.20.51/24 brd 172.23.20.255 scope global ens160*
* valid_lft forever preferred_lft forever*
* inet6 fe80::250:56ff:fe99:462/64 scope link*
* valid_lft forever preferred_lft forever*

```

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 2, 2022, 9:48pm UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/5 "2022-06-02T21:48:34Z")

</div>

I have set the PBS\_START\_COMM=0 and restarted the service, still no change to the node adding every IP address as authorized.  
this is the output from ip addr

```auto
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 90:b1:1c:42:67:ec brd ff:ff:ff:ff:ff:ff
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 90:b1:1c:42:67:ee brd ff:ff:ff:ff:ff:ff
4: eno3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 90:b1:1c:42:67:f0 brd ff:ff:ff:ff:ff:ff
5: eno4: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 90:b1:1c:42:67:f2 brd ff:ff:ff:ff:ff:ff
6: enp70s0f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 3e:a3:3f:a9:ed:8d brd ff:ff:ff:ff:ff:ff
7: enp70s0f1: <NO-CARRIER,BROADCAST,MULTICAST,SLAVE,UP> mtu 1500 qdisc mq master bond0 state DOWN group default qlen 1000
    link/ether 3e:a3:3f:a9:ed:8d brd ff:ff:ff:ff:ff:ff
8: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 3e:a3:3f:a9:ed:8d brd ff:ff:ff:ff:ff:ff
    inet 172.23.20.186/24 brd 172.23.20.255 scope global bond0
       valid_lft forever preferred_lft forever
    inet6 fe80::3ca3:3fff:fea9:ed8d/64 scope link
       valid_lft forever preferred_lft forever

```

the service is still adding every ip address, excerpt below

```auto
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.0 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.1 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.2 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.3 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.4 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.5 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.6 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.7 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.8 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.9 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.10 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.11 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.12 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.13 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.14 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.15 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.16 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.17 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.18 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.19 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.20 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.21 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.22 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.23 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.24 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.25 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.26 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.27 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.28 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.29 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.30 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.31 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.32 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.33 as authorized
06/03/2022 07:48:03;0002;pbs_mom;Svr;pbs_mom;Adding IP address 0.5.58.34 as authorized

```

---

<div class="post-metadata">

**Author:** ![dtalcott](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.openpbs.org/dtalcott/32/410_2.png) [@dtalcott](https://community.openpbs.org/u/dtalcott)\
**Post date:** [June 5, 2022, 4:45am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/6 "2022-06-05T04:45:46Z")

</div>

> [@pembleto](#):
>
> _06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;HELLO sent to server at lsr-pbssched01:15001, stream:0_  
> _06/02/2022 15:59:54;0400;pbs\_mom;Svr;pbs\_mom;Received request: 8_  
> _06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.2 as authorized_  
> _06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.3 as authorized_  
> _06/02/2022 15:59:54;0002;pbs\_mom;Svr;pbs\_mom;Adding IP address 0.0.0.4 as authorized_

This doesn’t help much, but that sequence of messages says that the server replied to the MoM’s HELLO with a IS\_REPLYHELLO (8) message. One of the parts of the IS\_REPLYHELLO msg is a list of cluster address ranges, which the MoM then adds to its list. This suggests the MoM was fed bad data by the server.

So, either the server and MoM are not running the same version of the protocol, or the server sent the MoM bogus information. Check out the network addresses on the server and check its startup messages for network info.

I think the IS\_REPLYHELLO message might go through pbs\_comm, so it might be involved also. Check its version and logs.

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 5, 2022, 6:10am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/7 "2022-06-05T06:10:30Z")

</div>

Thanks very much for the tip Dale, I will see if I can get anything sensible from a tcpdump and I will also investigate the server version.

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 6, 2022, 3:50am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/8 "2022-06-06T03:50:41Z")

</div>

So the tcpdump was a dry hole, there was nothing there that i could see that looks useful.  
I spun up a new test schedular and did a fresh install and had no issues with adding the new node so i suspect that there is a version issue.  
All of the nodes and servers (working and not working) report _pbs\_version = 20.0.0_ when i run _sudo /opt/pbs/sbin/pbs\_mom --version_

Is it possible there has been a change in the mom protocol since last year (when i buit the server) and the version has not been incremented?  
i tried building older versions from the pbs git (v20.0.0 & release\_20\_0\_branch) but kept getting issues with the python version, it wanted 3.5 and i have 3.8, which is the same on all the nodes (working and not working) so i think i built off roughly the same version.

So barring any other suggestions it seems that i need to rebuild my server?

---

<div class="post-metadata">

**Author:** ![pembleto](https://avatars.discourse-cdn.com/v4/letter/p/ed8c4c/32.png) [@pembleto](https://community.openpbs.org/u/pembleto)\
**Post date:** [June 7, 2022, 6:29am UTC](https://community.openpbs.org/t/pbs-mom-adding-every-ip-address-as-authorized/3113/9 "2022-06-07T06:29:13Z")

</div>

To close the loop on this one I ended up rebuilding the server and it is all fine now, both the old and new nodes connect no worries.  
Thanks for trying to help
