Yeah, we needed features 2.1x did not support (have to allow for the submission of interactive jobs from other submit hosts {broken in the version I was using}, need high availability, etc, ad nauseum). We did get this all worked out now with the acl_hosts and this is all working happily and boringly again - seemed to be a version thing - and I simplified my queues - took out the nodect and ncpu info.<br>
<br>Thank you for the reply!!!<br>-Jen<br><br><br><br><div class="gmail_quote">On Tue, Dec 23, 2008 at 12:13 AM, Garrick Staples <span dir="ltr"><<a href="mailto:garrick@usc.edu">garrick@usc.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">On Mon, Dec 22, 2008 at 03:58:08AM -0500, Jen alleged:<br>
<div class="Ih2E3d">> Hi All,<br>
><br>
> I am not sure if this is a torque or Maui question, so please forgive the<br>
> crosspost. :}<br>
><br>
> I used to do this blissfully boringly using acl_hosts. Something has<br>
> changed and this is not working anymore between torque 2.1.x and now. I<br>
> have the following:<br>
><br>
> torque 2.3.5<br>
> maui 3.2.6p21<br>
<br>
</div>Why upgrade from 2.1.x? 2.1.x is the most stable branch. 2.3 certainly has some new features, but if you don't need them, I recomment staying with 2.1.x.<br>
<div class="Ih2E3d"><br>
<br>
> I have a large cluster with several departments and these departments want<br>
> to use the nodes they purchased. In the past, I set up a queue for each of<br>
> these departments and I assigned nodes to the queues in torque. Has the way<br>
> to do this changed? I have seen several messages lately from folks no<br>
> longer able to get it to work...<br>
> I am not married to this method and will happily implement any method that<br>
> will keep my (hundreds) of users separated and on their own nodes. I do not<br>
> want them to have to change their scripts. These are heterogeneous, too, so<br>
> it is not just a policy thing - the infiniband jobs won't run on the non IB<br>
> nodes, and the some are 8proc, some are 2, etc.<br>
><br>
> I have tried the "neednodes" method. It did nothing.<br>
<br>
</div>I've been using the neednodes method for many years. I'm currently using<br>
torque 2.1..10 (with some patches up to 2.1.12) and<br>
maui-3.2.6p20-snap.1223069659.<br>
<div class="Ih2E3d"><br>
<br>
> I've been trying to do partitions in Maui and that seems to be ignored as<br>
> well. This is a 64 bit system, by the way.<br>
<br>
</div>Can you try a 32bit build of maui? I've recently noticed some problems with 64bit maui.<br>
<div class="Ih2E3d"><br>
<br>
> set queue esmg08q resources_max.cput = 10000:00:00<br>
> set queue esmg08q resources_max.ncpus = 179<br>
> set queue esmg08q resources_max.nodect = 22<br>
> set queue esmg08q resources_max.walltime = 10000:00:00<br>
> set queue esmg08q resources_min.cput = 00:00:01<br>
> set queue esmg08q resources_min.ncpus = 1<br>
> set queue esmg08q resources_min.nodect = 1<br>
> set queue esmg08q resources_default.neednodes=altix<br>
> set queue esmg08q resources_min.walltime = 00:00:01<br>
> set queue esmg08q resources_default.cput = 10000:00:00<br>
> set queue esmg08q resources_default.ncpus = 8<br>
> set queue esmg08q resources_default.walltime = 100:00:00<br>
<br>
</div>I'd simply this. ncpus and nodect often don't play well together.<br>
<font color="#888888"><br>
--<br>
Garrick Staples, GNU/Linux HPCC SysAdmin<br>
University of Southern California<br>
<br>
See the Dishonor Roll at <a href="http://www.californiansagainsthate.com/" target="_blank">http://www.californiansagainsthate.com/</a><br>
<br>
</font><br>_______________________________________________<br>
mauiusers mailing list<br>
<a href="mailto:mauiusers@supercluster.org">mauiusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/mauiusers" target="_blank">http://www.supercluster.org/mailman/listinfo/mauiusers</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Use it up; wear it out; make it do or do without! - L Reid<br>