Dynamic queue policy

[adarsh]

Interesting discussions here:

Backfill and Fair Share

Could someone please verify for me if I can use fairshare scheduling and backfill using the following configuration or do I need to enable other scheduler parameters. I am trying to have the scheduler be as fair as possible while utilizing idle resources when it can without preempting/suspending active jobs: round_robin: False ALL by_queue: True prime by_queue: True non_prime strict_ordering: False ALL help_starving_jobs: true ALL max_starve: 24:00:00 backfill: true A…

Top job's reservation ignored and postponed by lower priority job

Hi, we are currently facing a very weird behavior. Our system uses multiple “general” queues (for short/normal/long jobs, etc.). These queues have the same priority . Beside that, we have also several “high priority” queues (their priority is higher than for the short, normal and long queues) and job_sort_formula = queue_priority. Moreover, jobs are ordered by fair-share , and by_queue = false, i.e., we do not sort jobs in a queue-by-queue fashion but “all at once” (for the queues with the sam…