Unable to get preemption to work with soft limits

Users/Site Administrators
1

Appear to be unable to get preemption to work when trying to use max_run_soft.

qmgr -c “p server”
shows:
set server scheduling = True
set server max_run_soft = [o:PBS_ALL=1]

qmgr -c “p sched”
shows:
set server scheduling = True
set sched preempt_prio = “express_queue, server_softlimits, normal_jobs”
set sched preempt_order = SCR

User1 currently has 4 jobs running.
User2 has submitted a job but in the comment from a qstat -xf

comment = Not Running: Not enough free nodes available.

Must be missing simple, but not sure what or how to debug further.

2

Had the preempt_prio in the incorrect order.

set sched preempt_prio = “express_queue, normal_jobs, server_softlimits”

Does what we wanted.