Advance Reservation on custom nodes

Users/Site Administrators
1

Dear All,
Is it possible to create a reservation for a particular range of nodes (eg: node1 to nodes node 50)? If it is possible, please share me the pbs_rsub command syntax.

Thanks,
Jithin

2

Many ways to reserve 50 nodes:

   pbs_rsub  -R 20180601300 -E 201806071800 -N PBSRESERVATION -U root,pbsdata,pbsworksuser -l select=50:ncpus=16

note: 16 cores is assumed as the maximum number of cores available on that system

pbs_rsub  -R 20180601300 -E 201806071800 -N PBSRESERVATION -U root,pbsdata,pbsworksuser -l select=50:ncpus=16 -l place=scatter

Specific nodes :

  • specific 50 nodes

    pbs_rsub  -R 20180601300 -E 201806071800 -N PBSRESERVATION -U root,pbsdata,pbsworksuser -l select=1:host=node1+1:host=node2+...................................+1:host=node50

  • specific 50 nodes that are tagged nodespecifictag=firstfifty

    pbs_rsub  -R 20180601300 -E 201806071800 -N PBSRESERVATION -U root,pbsdata,pbsworksuser -l select=50:ncpus=16:nodespecifictag=firstfifty

Hope this helps.

1 Like
3

Dear Adarsh,
Thank you so much for your prompt replay. I would also like to know whether we can mention a node range like node1- node50 instead of mentioning each and every hostname. Because we are having a machine(cray XC40) with 1444 nodes which are placed in 8 cabinets. I want to create a reservation on nodes except nodes in c5 cabinets.Each cabinet consists of 192 nodes.

Thanks,
Jithin

4

Dear Jithin,

  1. Please create a host level , string_array custom resource and add it to sched_config resources:'s line and kill -HUP

  • Define the custom resource:

     qmgr –c "c r my_node_type type=string_array,flag=h"

  • Append the custom resource to resources: line in sched_config file:

    resources: “ncpus, mem, arch, host, vnode, aoe, my_node_type”

  • Note: after updating sched_config file, it is necessary to kill -HUP the pid of pbs scheduler.

  • Set the value for the new resource at each vnode:

for i in list_of_nodes_in_c1_to_c4_to_c6_to_c9_cabinets:
do
qmgr -c “set node $i resources_available.my_node_type=cae”
done

for i in list_of_nodes_in_c5_cabinets:
do
qmgr -c “set node $i resources_available.my_node_type=weather”
done

  • Create a reservation as below

     pbs_rsub  -R 20180601300 -E 201806071800 -N PBSRESERVATION -U root,pbsdata,pbsworksuser -l select=50:ncpus=16:my_node_type=cae

Hope this helps, thank you