Can you please let me know if resources_used.mem that you get when executing qstat -f is the aggreagted amount of memory used by the job or is it the maximum amount of memory?
if the job had peaks and valleys but at its peak it reached 100GB of memory then would resources_used.mem be equal 100GB? or maybe the metric would simply grow in size with some other logic that I’m missing?
And also how can I extract the “temporal” memory usage of each job (for all jobs)?
I want to be able to build a graph of the amount of memory used by each job.