PBS cgroups and Numa Nodes

Users/Site Administrators
1

Hi All,

I was hoping to get some advice on the open PBS logic when it submits a job?

The scenario we have is a job submitted with an allocated amount of memory (e.g. 50gb)
What then happens is the job is submitted to a cpuset (numa node) that has less than 50gb available for that cpuset. The overall available memory on the server is more the 50gb for info.

The job is then killed by OOM killer with the constraint CONSTRAINT_CPUSET.

My question is does PBS check if the cpuset that a job is assigned to has enough available memory? If not what can we do to correct the logic?

Best regards
Spencer

2

Is anyone able to help?

3

Did you get a chance to go through: https://openpbs.atlassian.net/wiki/spaces/PD/pages/11599882/PP-325+Support+Cgroups

Please share the PBS Version, cgroup configuration file with the community

  • If memory subsystem enabled in the cgroup ?
  • what does the mom log lines before kililng this job ?