Hello,
We are curious to know what might be the theoretical/practical limits for the Open PBS scheduler as we have a couple a few users submitting a couple of thousand jobs at a time.
Is there a known number of submitted jobs the scheduler cannot handle and would likely crash? Or if the limit is based on available hardware resources, are there formulas we could employ in determining the limit for our scheduler and/or PBS server?
Thanks,
Siji
What is your goal of such a use case ? Is there any requirements to know such a limit for your usecase ?
It would be based on your underlying capacity, speed, i/o reponse of your underlying hardware on which PBS Server is hosted. Obvisiously, if 100’s of users are continously (every second) querying the server while 100 users are submitting millions of jobs at the same would have some consequences.
The use case is simply that we have scenarios where a couple users are submitting thousands of jobs at once and while we could restrict the number of jobs users may submit, we’d like to have a solid basis for the restriction. Furthermore, having such a number would help us set the user job submission limits appropriately.
Hopefully, the information in the below might help, also 2020 / 2021 where applicable is much scalable and faster than 19.1
Thank you