<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<TITLE>Standing Reservation Problem</TITLE>
<META content="MSHTML 6.00.2800.1528" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff
size=2>Hello Mauiusers,</FONT></SPAN></DIV>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff
size=2>Following more testing I find that Maui does not seem to like specifying
common subsets of nodes between two or more standing reservations. This is
a major problem if one needs, for instance, to set up access to queues using
different QOS levels for nodes that are shared with other standing
reservations.</FONT></SPAN></DIV>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff size=2>For
example, changing the srcfg configuration from my previous message (listed
below) to:</FONT></SPAN></DIV>
<DIV><SPAN class=274060818-13022006><FONT face=Verdana color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=274060818-13022006>
<P><FONT face=Verdana><FONT size=2>SRCFG[prime]
CLASSLIST=prime<SPAN
class=274060818-13022006>,ghts,test,any,all</SPAN></FONT></FONT><BR><FONT
face=Verdana size=2>SRCFG[prime] PERIOD=INFINITY</FONT>
<BR><FONT face=Verdana size=2>SRCFG[prime]
HOSTLIST=mylnxc1-n001</FONT> </P>
<P><FONT face=Verdana><FONT size=2>SRCFG[glide]
CLASSLIST=glide<SPAN
class=274060818-13022006>,ghts,test,any,all</SPAN></FONT></FONT><BR><FONT
face=Verdana size=2>SRCFG[glide] PERIOD=INFINITY</FONT>
<BR><FONT face=Verdana size=2>SRCFG[glide]
HOSTLIST=mylnxc1-n002</FONT> </P>
<P><FONT face=Verdana><FONT size=2><SPAN
class=274060818-13022006>#</SPAN>SRCFG[ghts]
CLASSLIST=ghts,test,any,all</FONT></FONT> <BR><FONT face=Verdana><FONT
size=2><SPAN
class=274060818-13022006>#</SPAN>SRCFG[ghts]
PERIOD=INFINITY</FONT></FONT> <BR><FONT face=Verdana><FONT size=2><SPAN
class=274060818-13022006>#</SPAN>SRCFG[ghts]
HOSTLIST=mylnxc1-n00[1-2]</FONT></FONT> </P>
<P><FONT face=Verdana size=2><SPAN class=274060818-13022006>Works fine. I
can submit to all queues with prime jobs going only to node mylnxc1-n001, glide
jobs only going to mylnxc1-n002, and all other jobs going to either node.
But this applies all QOSLIST entries in the SRCFG to apply to all
CLASSLIST entries for that SRCFG. Where, what I really want is to apply
specific QOSLIST entries to specific CLASSLIST entries to specific nodes,
using multiple SRCFGs as necessary.</SPAN></FONT></P>
<P><FONT face=Verdana size=2><SPAN class=274060818-13022006>Is anyone doing this
successfully? If so, I would appreciate any help you can
provide.</SPAN></FONT></P>
<P><FONT face=Verdana size=2><SPAN
class=274060818-13022006>
Stewart</SPAN></FONT></P></SPAN></DIV>
<BLOCKQUOTE dir=ltr style="MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader dir=ltr align=left><FONT face=Tahoma
size=2>-----Original Message-----<BR><B>From:</B>
mauiusers-bounces@supercluster.org
[mailto:mauiusers-bounces@supercluster.org]<B>On Behalf Of
</B>Stewart.Samuels@sanofi-aventis.com<BR><B>Sent:</B> Friday, February 10,
2006 5:20 PM<BR><B>To:</B> mauiusers@supercluster.org<BR><B>Subject:</B>
[Mauiusers] Standing Reservation Problem<BR><BR></FONT></DIV><!-- Converted from text/rtf format -->
<P><FONT face=Verdana size=2>Mauiusers,</FONT> </P>
<P><FONT face=Verdana size=2>I seem to be having trouble understanding the
behavior of Maui. We are running Maui on Torque. I have set up
queues via Torque and two Standing Reservations via Maui to direct jobs to a
small cluster containing 1 Master node and 2 compute nodes. All nodes
have a single cpu and 1 GB of RAM.</FONT></P>
<P><FONT face=Verdana size=2>The intent of my test is to execute prime jobs on
mylnxc1-n001 and glide jobs on mylnxc1-n002 anytime. Additionally, I
would like to run ghts, test, any, and all jobs anytime on either node
mylnxc1-n001 or mylnxc1-n002. However, when submitting jobs to the prime
or glide queues, they get stuck in the queue and never execute. Checkjob
shows they are waiting for resources but there is nothing running on the
system (see below). Jobs sent to the other queues execute
properly. If I comment out the 3<SUP>rd</SUP> standing reservation, then
the prime and glide jobs execute properly but all other jobs now get stuck in
the queues with the same message from checkjob. It would appear that
maui won’t let me map multiple queues onto the nodes. Is anyone else
experiencing this behavior?</FONT></P>
<P><FONT face=Verdana size=2>Is this a function of the policy? I’ve
tried a few different node policy options with the same result for all.
It doesn't seem to matter if I change it or not. And, I have the same
problem using Maui 3.2.6p11 on Torque 1.2.0p1 as well as on Maui 3.2.6p14 on
Torque 2.0.0p4.</FONT></P>
<P><FONT face=Verdana size=2>I also have the maui log set to 9 but it
essentially confirms the same deferred message as checkjob. I haven’t
included it in this set of data because of the volume, but I can provide it if
required.</FONT></P>
<P><FONT face=Verdana size=2>Any help would be greatly
appreciated.</FONT> <FONT face=Verdana><FONT color=#0000ff><FONT
size=2><SPAN class=274060818-13022006> </SPAN><SPAN
class=274060818-13022006> </SPAN></FONT></FONT></FONT></P>
<DIV><SPAN class=274060818-13022006>
<P><B><I><FONT face="Script MT Bold"></FONT></I> <FONT
face="Script MT Bold"> <U>
</U></FONT><U><FONT face="Script MT Bold" color=#0000ff>Stewart
Samuels</FONT></U></B> <BR><B><FONT
face="Script MT Bold">
Infrastructure Evolution and Integration</FONT></B> <BR><B><FONT
face="Script MT Bold">
Scientific and Medical Affairs </FONT></B><BR><B><FONT
face="Script MT Bold">
Sanofi-Aventis
Pharmaceutical </FONT></B>
<FONT face=Arial size=2> </FONT><B></B><B></B><B> </B><BR><B><FONT
face="Script MT Bold">
1041 Route 202-206
</FONT></B><BR><B><FONT
face="Script MT Bold">
Bridgewater, NJ 08807</FONT></B> </P>
<P><B><FONT
face="Script MT Bold">
</FONT><FONT face="Script MT Bold" color=#0000ff>Phone:
(908) 231-4762</FONT></B> <BR><B><FONT
face="Script MT Bold">
</FONT><FONT face="Script MT Bold"
color=#0000ff>Fax:
(908) 231-3488</FONT></B>
<BR><B><FONT face="Script MT Bold"
color=#0000ff>
email:
Stewart.Samuels@Sanofi-Aventis.com</FONT></B> </P> </SPAN><BR></DIV>
<P><FONT face=Verdana
size=2>---------------------------------------------------------------------------------------------</FONT>
</P>
<P><FONT face=Verdana size=2>[root@mylnxc1-a log]# qmgr -c 'p s'</FONT>
<BR><FONT face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2># Create
queues and set their attributes.</FONT> <BR><FONT face=Verdana size=2>#</FONT>
<BR><FONT face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2># Create
and define queue glide</FONT> <BR><FONT face=Verdana size=2>#</FONT> <BR><FONT
face=Verdana size=2>create queue glide</FONT> <BR><FONT face=Verdana
size=2>set queue glide queue_type = Execution</FONT> <BR><FONT face=Verdana
size=2>set queue glide resources_max.nodect = 1</FONT> <BR><FONT face=Verdana
size=2>set queue glide enabled = True</FONT> <BR><FONT face=Verdana size=2>set
queue glide started = True</FONT> <BR><FONT face=Verdana size=2>#</FONT>
<BR><FONT face=Verdana size=2># Create and define queue prime</FONT> <BR><FONT
face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2>create queue
prime</FONT> <BR><FONT face=Verdana size=2>set queue prime queue_type =
Execution</FONT> <BR><FONT face=Verdana size=2>set queue prime
resources_max.nodect = 1</FONT> <BR><FONT face=Verdana size=2>set queue prime
enabled = True</FONT> <BR><FONT face=Verdana size=2>set queue prime started =
True</FONT> <BR><FONT face=Verdana size=2>#</FONT> <BR><FONT face=Verdana
size=2># Create and define queue test</FONT> <BR><FONT face=Verdana
size=2>#</FONT> <BR><FONT face=Verdana size=2>create queue test</FONT>
<BR><FONT face=Verdana size=2>set queue test queue_type = Execution</FONT>
<BR><FONT face=Verdana size=2>set queue test resources_max.nodect = 2</FONT>
<BR><FONT face=Verdana size=2>set queue test enabled = True</FONT> <BR><FONT
face=Verdana size=2>set queue test started = True</FONT> <BR><FONT
face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2># Create and define
queue ghts</FONT> <BR><FONT face=Verdana size=2>#</FONT> <BR><FONT
face=Verdana size=2>create queue ghts</FONT> <BR><FONT face=Verdana size=2>set
queue ghts queue_type = Execution</FONT> <BR><FONT face=Verdana size=2>set
queue ghts resources_max.nodect = 2</FONT> <BR><FONT face=Verdana size=2>set
queue ghts enabled = True</FONT> <BR><FONT face=Verdana size=2>set queue ghts
started = True</FONT> <BR><FONT face=Verdana size=2>#</FONT> <BR><FONT
face=Verdana size=2># Create and define queue any</FONT> <BR><FONT
face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2>create queue
any</FONT> <BR><FONT face=Verdana size=2>set queue any queue_type =
Execution</FONT> <BR><FONT face=Verdana size=2>set queue any
resources_max.nodect = 2</FONT> <BR><FONT face=Verdana size=2>set queue any
enabled = True</FONT> <BR><FONT face=Verdana size=2>set queue any started =
True</FONT> <BR><FONT face=Verdana size=2>#</FONT> <BR><FONT face=Verdana
size=2># Create and define queue all</FONT> <BR><FONT face=Verdana
size=2>#</FONT> <BR><FONT face=Verdana size=2>create queue all</FONT>
<BR><FONT face=Verdana size=2>set queue all queue_type = Execution</FONT>
<BR><FONT face=Verdana size=2>set queue all resources_max.nodect = 2</FONT>
<BR><FONT face=Verdana size=2>set queue all enabled = True</FONT> <BR><FONT
face=Verdana size=2>set queue all started = True</FONT> <BR><FONT face=Verdana
size=2>#</FONT> <BR><FONT face=Verdana size=2># Set server attributes.</FONT>
<BR><FONT face=Verdana size=2>#</FONT> <BR><FONT face=Verdana size=2>set
server scheduling = True</FONT> <BR><FONT face=Verdana size=2>set server
default_queue = ghts</FONT> <BR><FONT face=Verdana size=2>set server
log_events = 511</FONT> <BR><FONT face=Verdana size=2>set server mail_from =
adm</FONT> <BR><FONT face=Verdana size=2>set server query_other_jobs =
True</FONT> <BR><FONT face=Verdana size=2>set server
resources_default.neednodes = 1</FONT> <BR><FONT face=Verdana size=2>set
server resources_default.nodect = 1</FONT> <BR><FONT face=Verdana size=2>set
server resources_default.nodes = 1</FONT> <BR><FONT face=Verdana size=2>set
server scheduler_iteration = 600</FONT> <BR><FONT face=Verdana size=2>set
server node_ping_rate = 300</FONT> <BR><FONT face=Verdana size=2>set server
node_check_rate = 600</FONT> <BR><FONT face=Verdana size=2>set server
tcp_timeout = 6</FONT> <BR><FONT face=Verdana size=2>set server node_pack =
False</FONT> <BR><FONT face=Verdana size=2>[root@mylnxc1-a log]#</FONT>
</P><BR>
<P><FONT face=Verdana
size=2>------------------------------------------------------------------------------------------</FONT>
</P>
<P><FONT face=Verdana size=2>[root@mylnxc1-a log]# My maui.cfg</FONT> </P>
<P><FONT face=Verdana
size=2>QUEUETIMEWEIGHT 10</FONT> </P>
<P><FONT face=Verdana
size=2>BACKFILLPOLICY
FIRSTFIT</FONT> <BR><FONT face=Verdana
size=2>RESERVATIONPOLICY CURRENTHIGHEST</FONT> </P>
<P><FONT face=Verdana size=2>#NODEALLOCATIONPOLICY
MINRESOURCE</FONT> <BR><FONT face=Verdana
size=2>JOBNODEMATCHPOLICY EXACTNODE</FONT>
<BR><FONT face=Verdana
size=2>NODEACCESSPOLICY
SHARED</FONT> </P>
<P><FONT face=Verdana
size=2>CLASSCFG[glide]
MAXPROC=1</FONT> <BR><FONT face=Verdana
size=2>CLASSCFG[prime]
MAXPROC=1</FONT> <BR><FONT face=Verdana
size=2>CLASSCFG[test]
MAXPROC=2</FONT> <BR><FONT face=Verdana
size=2>CLASSCFG[ghts]
MAXPROC=2</FONT> <BR><FONT face=Verdana
size=2>CLASSCFG[all]
MAXPROC=2</FONT> <BR><FONT face=Verdana
size=2>CLASSCFG[any]
MAXPROC=2</FONT> </P>
<P><FONT face=Verdana size=2>CREDWEIGHT 1</FONT>
<BR><FONT face=Verdana size=2>CLASSWEIGHT 1</FONT>
<BR><FONT face=Verdana size=2>QOSWEIGHT
1</FONT> <BR><FONT face=Verdana size=2>XFACTORWEIGHT 1</FONT> </P>
<P><FONT face=Verdana size=2>SRCFG[prime]
CLASSLIST=prime</FONT> <BR><FONT face=Verdana
size=2>SRCFG[prime] PERIOD=INFINITY</FONT> <BR><FONT
face=Verdana size=2>SRCFG[prime]
HOSTLIST=mylnxc1-n001</FONT> </P>
<P><FONT face=Verdana size=2>SRCFG[glide]
CLASSLIST=glide</FONT> <BR><FONT face=Verdana
size=2>SRCFG[glide] PERIOD=INFINITY</FONT> <BR><FONT
face=Verdana size=2>SRCFG[glide]
HOSTLIST=mylnxc1-n002</FONT> </P>
<P><FONT face=Verdana size=2>SRCFG[ghts]
CLASSLIST=ghts,test,any,all</FONT> <BR><FONT face=Verdana
size=2>SRCFG[ghts] PERIOD=INFINITY</FONT> <BR><FONT
face=Verdana size=2>SRCFG[ghts]
HOSTLIST=mylnxc1-n00[1-2]</FONT> </P>
<P><FONT face=Verdana size=2>[nm67109@mylnxc1-a nm67109]$ checkjob 108</FONT>
</P><BR>
<P><FONT face=Verdana size=2>checking job 108</FONT> </P>
<P><FONT face=Verdana size=2>State: Idle EState: Deferred</FONT>
<BR><FONT face=Verdana size=2>Creds: user:nm67109
group:lgdgis class:prime qos:DEFAULT</FONT> <BR><FONT face=Verdana
size=2>WallTime: 00:00:00 of 99:23:59:59</FONT> <BR><FONT face=Verdana
size=2>SubmitTime: Fri Feb 10 17:04:49</FONT> <BR><FONT face=Verdana
size=2> (Time Queued Total: 00:00:45 Eligible:
00:00:01)</FONT> </P>
<P><FONT face=Verdana size=2>Total Tasks: 1</FONT> </P>
<P><FONT face=Verdana size=2>Req[0] TaskCount: 1 Partition:
ALL</FONT> <BR><FONT face=Verdana size=2>Network: [NONE] Memory >=
0 Disk >= 0 Swap >= 0</FONT> <BR><FONT face=Verdana
size=2>Opsys: [NONE] Arch: [NONE] Features: [NONE]</FONT> </P><BR>
<P><FONT face=Verdana size=2>IWD: [NONE] Executable: [NONE]</FONT>
<BR><FONT face=Verdana size=2>Bypass: 0 StartCount: 0</FONT> <BR><FONT
face=Verdana size=2>PartitionMask: [ALL]</FONT> <BR><FONT face=Verdana
size=2>Flags: RESTARTABLE</FONT> </P>
<P><FONT face=Verdana size=2>job is deferred. Reason:
NoResources (cannot create reservation for job '108'</FONT> <BR><FONT
face=Verdana size=2> (intital reservation attempt)</FONT> <BR><FONT
face=Verdana size=2>)</FONT> <BR><FONT face=Verdana
size=2>Holds: Defer (hold reason:
NoResources)</FONT> <BR><FONT face=Verdana size=2>PE: 1.00
StartPriority: 1</FONT> <BR><FONT face=Verdana size=2>cannot select job
108 for partition DEFAULT (job hold active)</FONT> </P><BR>
<P><FONT face=Verdana size=2>[nm67109@mylnxc1-a nm67109]$</FONT> </P><BR><BR>
<P><B><I><FONT face="Script MT Bold"></FONT></I> <FONT
face="Script MT Bold"> <U>
</U></FONT><U><FONT face="Script MT Bold" color=#0000ff>Stewart
Samuels</FONT></U></B> <BR><B><FONT
face="Script MT Bold">
Infrastructure Evolution and Integration</FONT></B> <BR><B><FONT
face="Script MT Bold">
Scientific and Medical Affairs </FONT></B><BR><B><FONT
face="Script MT Bold">
Sanofi-Aventis
Pharmaceutical </FONT></B>
<FONT face=Arial size=2> </FONT><B></B><B></B><B> </B><BR><B><FONT
face="Script MT Bold">
1041 Route 202-206
</FONT></B><BR><B><FONT
face="Script MT Bold">
Bridgewater, NJ 08807</FONT></B> </P>
<P><B><FONT
face="Script MT Bold">
</FONT><FONT face="Script MT Bold" color=#0000ff>Phone:
(908) 231-4762</FONT></B> <BR><B><FONT
face="Script MT Bold">
</FONT><FONT face="Script MT Bold"
color=#0000ff>Fax:
(908) 231-3488</FONT></B>
<BR><B><FONT face="Script MT Bold"
color=#0000ff>
email:
Stewart.Samuels@Sanofi-Aventis.com</FONT></B> </P></BLOCKQUOTE></BODY></HTML>