[Mauiusers] Re: [torqueusers] queue limit

Eygene Ryabinkin rea+maui at grid.kiae.ru
Wed Mar 5 08:00:15 MST 2008


Chris, good day.

Thu, Mar 06, 2008 at 01:29:21AM +1100, csamuel at vpac.org wrote:
> I've copied the mauisusers list in on this as this is
> now really just a Maui problem.
> 
> > I finally got around to trying this, and I seem to be limited to half
> > the number I specify:
> > 
> > I have set USERCFG[chris]          MAXPROC=16 in maui.cfg (and
> > restarted maui)
> > I then submitted several ppn=4 jobs and only two are running at a
> > time

How many CPUs are on the nodes?  What does 'qstat -na' tells about
the number of nodes, job with 'ppn=4' is running at?  IIRC, there
is some difference in Torque's and Maui's idea on the nodes and CPU
mapping, so you can run into this problem.

Do you really wanted to run the task on the one quad-way machine
or you wanted something else?  If you want to say 'I need N CPUs
on whatever nodes', you can say 'qsub -l nodes=N', unset
JOBNODEMATCHPOLICY in your Maui's configuration and let Torque
think that it has many nodes via
-----
set server resources_available.nodect = NCPUS
set queue YOUR-QUEUE resources_available.nodect = NCPUS
-----

Without this Torque will not allow to run jobs with 'N' greater
than the number of physical nodes, but as Maui will later map 'nodes'
to raw CPUs, Maui will take care of it.

But your mileage may greatly vary ;))
-- 
Eygene Ryabinkin, RRC KI


More information about the mauiusers mailing list