# Vnodes creation **URL:** \ **Category:** Users/Site Administrators\ **Created:** [November 19, 2021, 4:21pm UTC](https://community.openpbs.org/t/vnodes-creation/2868 "2021-11-19T16:21:22Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Fabien](https://avatars.discourse-cdn.com/v4/letter/f/85e7bf/32.png) [@Fabien](https://community.openpbs.org/u/Fabien)\ **Post date:** [November 19, 2021, 4:21pm UTC](https://community.openpbs.org/t/vnodes-creation/2868/1 "2021-11-19T16:21:22Z")
Hi, I deployed openpbs from git master branch and I activated pbs\_cgroups hook in order to get vnodes. At some point during the day, I could see a natural node with 2 vnodes (2 sockets node) but now, I can’t get the vnodes back (I tried kill -HUP pbs\_mom and restarting it). On the mom side, everything looks ok so I guess there’s something wrong on the server. On the natural node, resources\_available.mem has been set resources\_available.mem = 196694128kb but still no vnodes… I looked at my server logs and found these entries: 11/19/2021 11:06:47;0100;Server@nwpbs10;Node;nwpn1120.cm.nrw;set\_all\_state;txt=(null) mi\_modtime=1637337960 11/19/2021 11:06:47;0100;Server@nwpbs10;Node;nwpn1120;set\_vnode\_state;vnode.state=0x0 vnode\_o.state=0x0 vnode.last\_state\_change\_time=1637338007 vnode\_o.last\_state\_change\_time=1637337963 state\_bits=0xfffffffffffffe7f state\_bit\_op\_type\_str=Nd\_State\_And state\_bit\_op\_type\_enum=2 11/19/2021 11:06:47;0002;Server@nwpbs10;Node;nwpn1120.cm.nrw;update2 state:0 ncpus:24 11/19/2021 11:06:47;0100;Server@nwpbs10;Node;nwpn1120.cm.nrw;set\_all\_state;txt=(null) mi\_modtime=1637337960 11/19/2021 11:06:47;0100;Server@nwpbs10;Node;nwpn1120;set\_vnode\_state;vnode.state=0x20 vnode\_o.state=0x0 vnode.last\_state\_change\_time=1637338007 vnode\_o.last\_state\_change\_time=1637337963 state\_bits=0x20 state\_bit\_op\_type\_str=Nd\_State\_Or state\_bit\_op\_type\_enum=1 11/19/2021 11:06:47;0002;Server@nwpbs10;Node;nwpn1120.cm.nrw;Mom reporting 1 vnodes as of Fri Nov 19 11:06:00 2021 11/19/2021 11:06:47;0100;Server@nwpbs10;Node;nwpn1120;set\_vnode\_state;vnode.state=0x0 vnode\_o.state=0x20 vnode.last\_state\_change\_time=1637338007 vnode\_o.last\_state\_change\_time=1637338007 state\_bits=0xfffffffffffffedd state\_bit\_op\_type\_str=Nd\_State\_And state\_bit\_op\_type\_enum=2 To me, it looks like mom is send information about vnode but then server isn’t doing anything with it… Could you explain to me how to interpret these entries ? (Maybe this topic belongs to the developers forum…) Thank you ! ---
**Author:** ![dtalcott](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.openpbs.org/dtalcott/32/410_2.png) [@dtalcott](https://community.openpbs.org/u/dtalcott)\ **Post date:** [November 19, 2021, 10:39pm UTC](https://community.openpbs.org/t/vnodes-creation/2868/2 "2021-11-19T22:39:15Z")
I would check the mom\_logs on the node to see if there are messages from pbs\_cgroups. Perhaps it cannot run for some reason, so the vnodes don’t get created? ---
**Author:** ![Fabien](https://avatars.discourse-cdn.com/v4/letter/f/85e7bf/32.png) [@Fabien](https://community.openpbs.org/u/Fabien)\ **Post date:** [November 20, 2021, 12:13am UTC](https://community.openpbs.org/t/vnodes-creation/2868/3 "2021-11-20T00:13:21Z")
Hi, pbs\_cgroups looks like it can run if I look at mom logs: 11/19/2021 19:06:30;0800;pbs\_python;Hook;pbs\_python;\_discover\_numa\_nodes: {0: {‘devices’: [], ‘cpus’: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], ‘MemTotal’: ‘97630800k’, ‘HugePages\_Total’: 0, ‘hpmem’: 0, ‘mem’: 98363326464, ‘vmem’: 98363326464}, 1: {‘devices’: [], ‘cpus’: [12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23], ‘MemTotal’: ‘99063320k’, ‘HugePages\_Total’: 0, ‘hpmem’: 0, ‘mem’: 99830226944, ‘vmem’: 99830226944}} and at the end of hook execution: 11/19/2021 19:06:30;0800;pbs\_python;Hook;hook\_perf\_stat;label=hook\_exechost\_periodic\_pbs\_cgroups\_133521.in action=run\_code walltime=0.174910 cputime=0.170000 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;pbs\_populate\_svrattrl\_from\_python\_class==\> 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.name al\_resc=null al\_value=nwpn1120 al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.pbs\_version al\_resc=null al\_value=20.0.2 al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.pcpus al\_resc=null al\_value=24 al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.resources\_available al\_resc=mem,size al\_value=196694128kb al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.resources\_available al\_resc=ncpus,long al\_value=24 al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;al\_name=nwpn1120.resources\_available al\_resc=arch,string al\_value=linux al\_flags=0 11/19/2021 19:06:30;0400;pbs\_python;Hook;print\_svrattrl\_list;pbs\_populate\_svrattrl\_from\_python\_class==\> This is from a exechost\_periodic. The vnodes should be created by a exechost\_startup, I tried to restart mom/hup it but no still no vnodes… Perhaps something’s wrong in the exechost\_startup… ---
**Author:** ![Fabien](https://avatars.discourse-cdn.com/v4/letter/f/85e7bf/32.png) [@Fabien](https://community.openpbs.org/u/Fabien)\ **Post date:** [November 22, 2021, 11:22am UTC](https://community.openpbs.org/t/vnodes-creation/2868/4 "2021-11-22T11:22:26Z")
Hi, so I tried with latest stable openpbs release (20.0.1) and I get vnodes automatically and correctly set regarding memory ! I guess there’s something wrong (or I did something wrong) with master branch.