pbs - how to limit number of concurrently running PBS jobs

Question

I have a 64-node cluster, running PBS Pro. If I submit many hundreds of jobs, I can get 64 running at once. This is great, except when all 64 jobs happen to be nearly I/O bound, and are reading/writing to the same disk. In such cases, I'd like to be able to still submit all the jobs, but have a max of (say) 10 jobs running at a given time. Is there an incantation to qsub that will allow me to do such, without having administrative access to the cluster's PBS server?

Answer 1

在 TORQUE 中，您可以通过在作业数组上设置插槽限制来做到这一点，只要您可以将作业安排为数组：

qsub script.sh -t 0-99%10

将限制其中 10 个同时运行。如果 PBSPro 具有与此等效的功能，那么您可以使用它。

Answer 2

你可以让它们相互依赖。或安排他们在不同的时间点开始。

否则，您的管理员可以减少您可以同时运行的同时作业的数量。