The slot limit is exactly what I'm looking for, but:<div><br></div><div>* It is not mentioned in our man pages. I read now the man page on <a href="http://clusterresources.com">clusterresources.com</a>, which is quite different than our installed man page.</div>
<div><br></div><div>* It works on one of our clusters, but on a second one I get "qsub: Bad Job Array Request." Does this feature have to be enabled? Or is it only available from a certain version? The cluster it works on is qsub version: 2.5.10, and the one it does not work on is version: 2.4.12.</div>
<div><br></div><div><br><div class="gmail_quote">On Wed, Apr 18, 2012 at 11:26 AM, Al Taufer <span dir="ltr"><<a href="mailto:ataufer@adaptivecomputing.com">ataufer@adaptivecomputing.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
It sounds like slot limits on a job array would do what you want. The<br>
man page for qsub says<br>
<br>
An optional slot limit can be specified to limit the amount of jobs<br>
that can run concurrently in the job array. The default value is<br>
unlimited. The slot limit must be the last thing specified in the<br>
array_request and is delimited from the array by a percent sign (%).<br>
<div class="im HOEnZb"><br>
qsub script.sh -t 0-299%5<br>
<br>
This sets the slot limit to 5. Only 5 jobs from this array can run at<br>
the same time.<br>
<br>
</div><div class="HOEnZb"><div class="h5">On Wed, Apr 18, 2012 at 8:22 AM, Ashish Agarwal <<a href="mailto:agarwal1975@gmail.com">agarwal1975@gmail.com</a>> wrote:<br>
> I've read some posts about how an admin can limit the maximum number of jobs<br>
> a user can run. But I'd like to know if a user can him/herself limit the<br>
> number of jobs *running*, ideally jobs within the same job array.<br>
><br>
> The use case is that I would like to submit 500 I/O intensive jobs. Each job<br>
> only requires a single core, so potentially all jobs could start running on<br>
> our cluster overloading the storage system. Thus, I'd like to say "amongst<br>
> all 500 jobs in this job array, run at most 20 at a time". Is that possible?<br>
><br>
> Thank you.<br>
><br>
><br>
</div></div><div class="HOEnZb"><div class="h5">> _______________________________________________<br>
> torqueusers mailing list<br>
> <a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
> <a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
><br>
_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
</div></div></blockquote></div><br></div>