# Adding GPU nodes **URL:** \ **Category:** Users/Site Administrators\ **Created:** [August 8, 2022, 5:06am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235 "2022-08-08T05:06:10Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![vinay](https://avatars.discourse-cdn.com/v4/letter/v/6a8cbe/32.png) [@vinay](https://community.openpbs.org/u/vinay)\ **Post date:** [August 8, 2022, 5:06am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/1 "2022-08-08T05:06:10Z")
We have 4 compute nodes each with one RTX2080 GPU installed on all. I am trying to follow the procedure - > **[PBS\_0047\_Whitepaper\_NVIDIA\_Letter.pdf](https://drive.google.com/file/d/1BKzjZzue5OJSmQeTkG5-3wZsXDH4vj98/view?usp=sharing)** > > Google Drive file. Method I am trying - “Simple GPU Scheduling with Exclusive Node Access” When I run command - qmgr -c “create resource rtx2080 type=Boolean,flag=h” It gives error as below - qmgr obj=rtx2080 svr=default: Illegal attribute or resource value qmgr: Error (15014) returned from server Screenshot - ![Screenshot 2022-08-08 at 10.35.21 AM](https://canada1.discourse-cdn.com/flex030/uploads/pbspro/original/1X/cffb7c19e9088bc1d0350bf0387ce94985fc7f0f.png) Any one can help. ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [August 8, 2022, 6:27am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/2 "2022-08-08T06:27:55Z")
Please try this command (it is recommended to type it , sometimes copy paste has issues ) `qmgr -c "create resource rtx2080 type=boolean,flag=h"` ---
**Author:** ![vinay](https://avatars.discourse-cdn.com/v4/letter/v/6a8cbe/32.png) [@vinay](https://community.openpbs.org/u/vinay)\ **Post date:** [August 8, 2022, 6:48am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/3 "2022-08-08T06:48:58Z")
Hi Adarsh, Thanks it worked. So I added the resource to a node named - b14 Below is output of pbsnodes -a for b14 - Where it shows resources\_available.rtx2080 = True b14 Mom = b14.shukra.aero.iitb.ac.in ntype = PBS state = free pcpus = 32 resources\_available.arch = linux resources\_available.host = b14 resources\_available.mem = 32948660kb resources\_available.ncpus = 32 resources\_available.rtx2080 = True resources\_available.vnode = b14 resources\_assigned.accelerator\_memory = 0kb resources\_assigned.hbmem = 0kb resources\_assigned.mem = 0kb resources\_assigned.naccelerators = 0 resources\_assigned.ncpus = 0 resources\_assigned.vmem = 0kb resv\_enable = True sharing = default\_shared last\_state\_change\_time = Wed Jul 6 09:00:56 2022 * * * Now how do I submit cuda job to that node - Tried as written in the document. but it gives error - ![Screenshot 2022-08-08 at 12.17.48 PM](https://canada1.discourse-cdn.com/flex030/uploads/pbspro/original/1X/b475a64878da2f8319c5235a18444430c3f06690.png) ---
**Author:** ![vinay](https://avatars.discourse-cdn.com/v4/letter/v/6a8cbe/32.png) [@vinay](https://community.openpbs.org/u/vinay)\ **Post date:** [August 8, 2022, 7:34am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/4 "2022-08-08T07:34:55Z")
Hi @adarsh I followed your steps from here - [PBS Single exection host run job using cpu include gpu - #2 by adarsh](https://community.openpbs.org/t/pbs-single-exection-host-run-job-using-cpu-include-gpu/2604/2) And its working fine. I can submit a cuda job. by doing #PBS -l select=1:ncpus=1:ngpus=1 But now a strange line is coming in all output files - /var/spool/pbs/mom\_priv/jobs/187.b0.SC: line 14: =1: command not found ![Screenshot 2022-08-08 at 1.03.40 PM](https://canada1.discourse-cdn.com/flex030/uploads/pbspro/original/1X/ceda9cda250a28dec91eded70af239f744c84945.png) This has started to appear only after this ngpus resource addition. I restarted pbs service. Do i need to check something. ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [August 8, 2022, 10:42am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/5 "2022-08-08T10:42:12Z")
Thank you > [@vinay](#): > > /var/spool/pbs/mom\_priv/jobs/187.b0.SC: line 14: =1: command not found Please share your job submission script or the line number 14 in your job submission script ---
**Author:** ![vinay](https://avatars.discourse-cdn.com/v4/letter/v/6a8cbe/32.png) [@vinay](https://community.openpbs.org/u/vinay)\ **Post date:** [August 9, 2022, 3:19am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/6 "2022-08-09T03:19:13Z")
Hi @adarsh Below is the script - #!/bin/bash #PBS -N testing #PBS -q big #PBS -l select=1:ncpus=1:ngpus=1 #PBS -j oe #PBS -V #PBS -o log.out cd $PBS\_O\_WORKDIR cat $PBS\_NODEFILE \> ./pbsnodes #$PROCS1=`cat ./pbsnodes|wc -l` nvcc -o g.out hello-world.cu $HOME/gpu/g.out /bin/hostname * * * After commenting $PROCS1=`cat ./pbsnodes|wc -l` The error has gone. But earlier it used to work without any error. Not sure why this line has issues now. ---
**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\ **Post date:** [August 9, 2022, 6:12am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/7 "2022-08-09T06:12:14Z")
> [@vinay](#): > > After commenting $PROCS1=`cat ./pbsnodes|wc -l` > The error has gone. But earlier it used to work without any error. Not sure why this line has issues now. Could you plase replace that line with these `PROCS1=$(cat $PBS_NODEFILE | wc -l)` > [@vinay](#): > > cat $PBS\_NODEFILE \> ./pbsnodes You can remove this line ---
**Author:** ![vinay](https://avatars.discourse-cdn.com/v4/letter/v/6a8cbe/32.png) [@vinay](https://community.openpbs.org/u/vinay)\ **Post date:** [August 9, 2022, 11:57am UTC](https://community.openpbs.org/t/adding-gpu-nodes/3235/8 "2022-08-09T11:57:04Z")
> [@adarsh](#): > > PROCS1=$(cat $PBS\_NODEFILE | wc -l) Hi @adarsh Thanks a lot . it worked.