# Waiting time and error handling

**URL:** <https://community.openpbs.org/t/waiting-time-and-error-handling/4212>\
**Category:** Users/Site Administrators\
**Created:** [January 21, 2026, 5:47am UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212 "2026-01-21T05:47:30Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![wakaka](https://avatars.discourse-cdn.com/v4/letter/w/d07c76/32.png) [@wakaka](https://community.openpbs.org/u/wakaka)\
**Post date:** [January 21, 2026, 5:47am UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212/1 "2026-01-21T05:47:30Z")

</div>

I have encountered two problems:

1. There is only one available node in my queue. I submitted two jobs, one to be executed directly and the other to be queued for resources. Then I added a new node to the queue, but the jobs in the queue did not execute immediately. Instead, they waited for about 8 minutes before being scheduled to be used on the new node. Why do I need to wait so long?
2. A node is unable to execute the job assigned to it by PBS due to certain issues. When the job is assigned to the node, it will report an error and terminate after a few seconds. However, PBS did not disable this node, and subsequent queued jobs will still be assigned to this node. As a result, they will all continue to report errors and terminate. I need to manually handle this problem node and resubmit those jobs, which is very bad

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [January 21, 2026, 7:56pm UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212/2 "2026-01-21T19:56:41Z")

</div>

1. adding a new node does not trigger a scheduling cycle.  
Try this :  
qmgr : create node nodename  
qmgr : set server scheduling = true  
Your queued job will run, if the node can accomodate it .

2. you can wirte a periodic mom hook ( kind of a node health check script) that will monitor the node, if any of the monitoring checks fail ( say /home directory not found, disk full, issues with the network) then it can offline the node and update the comment on the node, so that it can be investigated by the administrator and also it prevents other jobs landing on to it.

Reference: [Integrating NHC with PBS Pro](https://livolsi.me/integrating-nhc-pbs-pro/)  
Also, you can check the examples in the administrator guide.

---

<div class="post-metadata">

**Author:** ![wakaka](https://avatars.discourse-cdn.com/v4/letter/w/d07c76/32.png) [@wakaka](https://community.openpbs.org/u/wakaka)\
**Post date:** [January 22, 2026, 9:07am UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212/3 "2026-01-22T09:07:13Z")

</div>

Hi, adarsh, thanks for your reply.

1. The first issue is that I have already created a node and I want it to be associated with my queue (which already has a node associated with it), but the newly added node is not immediately called to the queued job. The attribute `scheduling` of server has been `True`.

```bash
qmgr -c ‘set node n1 resources_available.QList = q1’

qmgr -c ‘set queue q1 default_chunk.QList = q1’

```

1. For the second question, a periodic hook has been set up to check mom, which is a prerequisite for system operation and maintenance. If mom encounters an exception after the periodic check, the error I mentioned will still occur when executing the job, which cannot prevent bad things from happening in a timely manner.

---

<div class="post-metadata">

**Author:** ![adarsh](https://avatars.discourse-cdn.com/v4/letter/a/f07891/32.png) [@adarsh](https://community.openpbs.org/u/adarsh)\
**Post date:** [January 23, 2026, 8:09pm UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212/4 "2026-01-23T20:09:05Z")

</div>

- Suggestion was to run the command `qmgr -c "set server scheduling = true"` again to explicitly trigger a scheduling cycle. Although scheduling is already set to `true`, re-running this command forces a new cycle, allowing the scheduler to detect newly added or reconfigured nodes and consider them for job placement if they meet the job’s requirements.
- We should also consider the corner cases around the periodic hook. In this scenario, the periodic hook encountered an exception, and it is unclear whether the node was successfully offlined as a result. However, PBS continues to schedule jobs onto this node, which suggests that it may still be considered available by the scheduler.  
As a safeguard, it may be useful to add logic that updates a timestamp file on successful hook execution. A cron job could then monitor this `timestamp.txt` file and, if it has not been updated for a defined period, proactively offline the node. This would help ensure that nodes in an uncertain or unhealthy state are not selected for scheduling.

---

<div class="post-metadata">

**Author:** ![wakaka](https://avatars.discourse-cdn.com/v4/letter/w/d07c76/32.png) [@wakaka](https://community.openpbs.org/u/wakaka)\
**Post date:** [January 26, 2026, 6:50am UTC](https://community.openpbs.org/t/waiting-time-and-error-handling/4212/5 "2026-01-26T06:50:21Z")

</div>

> [@adarsh](#):
>
> Suggestion was to run the command `qmgr -c "set server scheduling = true"` again to explicitly trigger a scheduling cycle. Although scheduling is already set to `true`, re-running this command forces a new cycle, allowing the scheduler to detect newly added or reconfigured nodes and consider them for job placement if they meet the job’s requirements.

Thank you very much for your suggestion, Mr. adarsh. It is very useful. I learned that a queue is started can also force a new cycle, but when I set my queue `started = True` or `enabled= True`, it did not work like `qmgr -c "set server scheduling = true"`.
