[Mauiusers] Re: [torqueusers] queue limit

[Bas van der Vlies]

csamuel at vpac.org wrote:

Just a remark what is your NODEACCESSPOLICY?


In the past i have wrote a patch for SINGLEJOB and add new keyword 
NODEALLOCMAXPS. That was calculate wrong, Here is the explanation from 
prevous email conversations:
{{{
At our side we run one job per nodes and have an MAXPS setting of 600
hours and max walltime 120 hours. Our nodes have 2 processors. When the
user submits
an job for eg:
     1) qsub -I -lnodes=60:ppn=1 -lwalltime=10:00:00 ( will run )
     2) qsub -I -lnodes=60:ppn=2 -lwalltime=10:00:00 ( wil not run MAXPS
                                                       violation)

Now when job 1 runs is allocates the whole node and maui sees that it
oocupies 4 task ( 2 nodes and each node two cpu's = 4 tasks). So the
used tme will becalculated as 60 * 2 * 10 = 1200 hours. What is far more
then allowed!

The next example will only run one job instead of 2:
     qsub -I -lnodes=30:ppn=1 -lwalltime=10:00:00 ( will run )
     qsub -I -lnodes=30:ppn=1 -lwalltime=10:00:00 ( will not  run MAXPS
                                                    violation )
In short when i submit a job like 1:ppn=1 and i was scheduled on a node 
with 4 cpu. I was calculate 4 times my maxps time.

}}}
> ----- "Chris Evert" <chris at geodev.com> wrote:
> 
>> Hello Chris, list,
> 
> Hello Chris,
> 
> I've copied the mauisusers list in on this as this is
> now really just a Maui problem.
> 
>> I finally got around to trying this, and I seem to be limited to half
>> the number I specify:
>>
>> I have set USERCFG[chris]          MAXPROC=16 in maui.cfg (and
>> restarted maui)
>> I then submitted several ppn=4 jobs and only two are running at a
>> time
> 
> That's really odd!
> 
>> checking job 204650
>>
> [...]
>> IWD: [NONE]  Executable:  [NONE]
>> Bypass: 0  StartCount: 0
>> PartitionMask: [ALL]
>> PE:  4.00  StartPriority:  4320
>> cannot select job 204650 for partition DEFAULT (job 204650 violates
>> active HARD MAXPROC limit of 16 for user chris  (R: 4, U: 16) )
> 
> I wish I could remember what the U: 16 stood for there.  It
> doesn't make sense to me!
> 
> Does checkjob -v give any extra info ?
> 
>> What am I missing?  (A USERCFG[chris] PREJUDICE=2 configuration,
>> perhaps:-)
> 
> 8-)
> 
>> Should I just multiply the ideal MAXPROC by 2?
> 
> Shouldn't need to, but give it a go.
> 
> Hmm, actually, are you running the latest Maui release ?
> 
> I've got a memory that there was a double accounting bug
> in one of the releases last year - checking the archives
> may shed some light on that.
> 
>> Any help is appreciated,
> 
> No worries, best of luck!
> 
> Chris
> --
> Christopher Samuel - (03) 9925 4751 - Systems Manager
>  The Victorian Partnership for Advanced Computing
>  P.O. Box 201, Carlton South, VIC 3053, Australia
> VPAC is a not-for-profit Registered Research Agency
> _______________________________________________
> mauiusers mailing list
> mauiusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/mauiusers


-- 
--
********************************************************************
*                                                                  *
*  Bas van der Vlies                     e-mail: basv at sara.nl      *
*  SARA - Academic Computing Services    phone:  +31 20 592 8012   *
*  Kruislaan 415                         fax:    +31 20 6683167    *
*  1098 SJ Amsterdam                                               *
*                                                                  *
********************************************************************