<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.6000.16481" name=GENERATOR></HEAD>
<BODY>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>Hi,</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>I have been trying
for a few days now to partition our cluster using QoS rather than Maui
partitions but have been unsuccessful.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>I am using OpenPBS
2.3.12 and Maui 3.2.6p13.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>We have a
heterogenous cluster consisting of 22 nodes.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>Nodes 1 - 8 are
older, single core, dual CPU machines and are available for the whole
centre to run on. For these nodes I have a number of queues: cpu1, cpu2, cpu4
and cpu8 with differing maximum runtimes for each (the numbers are maximum
number of CPUs). For these nodes I also try stop queue stuffing by
using:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>USERCFG[DEFAULT]
MAXPROC=8 MAXJOB=4 MAXIPROC=8 MAXIJOB=4</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>Nodes 9 - 22 have
recently been purchased by a particular research group and are dual-cpu, dual
core machines with faster CPUs. These machines, at least for the short
term, will only be accessible to a small group of users. These nodes have one
queue, cfd, which will have less restrictive limits, e.g.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>USERCFG[DEFAULT]
MAXPROC=32 MAXJOB=32 MAXIPROC=32 MAXIJOB=32</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>In the near future
the cluster will be extended again by another group with the same provisos that
their nodes will be for their own group for the forseeable
future.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>I was hoping to
achieve this by setting up two standing reservations, public and cfd, which
would reserve all of the nodes:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>SRCFG[public_res]
CLASSLIST=cpu1,cpu2,cpu4,cpu8 HOSTLIST="^node[1-8]$" PERIOD=INFINITY
QOSLIST=public_qos</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>SRCFG[cfd_res]
CLASSLIST=cfd HOSTLIST="^node(9|1[0-9]|2[0-1])$" PERIOD=INFINITY
QOSLIST=cfd_qos</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>then define two QoS,
one for each reservation, that restricts jobs to the appropriate set of
nodes:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>QOSCFG[public_qos]
FLAGS=USERESERVED:public</SPAN></FONT><FONT face=Arial size=2><SPAN
class=800011413-28062007>_res.0.0</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2>QOSCFG[<SPAN
class=800011413-28062007>cfd</SPAN>_qos] <SPAN
class=800011413-28062007>
</SPAN> FLAGS=USERESERVED:<SPAN
class=800011413-28062007>cfd</SPAN>_res.0.0</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial size=2>then set up each
class to have the appropriate default QoS and use the appropriate
reservation:</FONT></SPAN></DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial
size=2>CLASSCFG[cpu1]
FLAGS=ADVRES:public_res.0.0
QDEF=public_qos<BR>CLASSCFG[cpu2]
FLAGS=ADVRES:public_res.0.0
QDEF=public_qos<BR>CLASSCFG[cpu4]
FLAGS=ADVRES:public_res.0.0
QDEF=public_qos<BR>CLASSCFG[cpu8]
FLAGS=ADVRES:public_res.0.0
QDEF=public_qos<BR>CLASSCFG[cfd]
FLAGS=ADVRES:cfd_res.0.0 QDEF=cfd_qos</FONT></SPAN></DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial size=2>then set differing
throttles for users in the diferent QoS's:</FONT></SPAN></DIV>
<DIV><SPAN class=800011413-28062007><FONT face=Arial
size=2></FONT></SPAN> </DIV><FONT face=Arial
size=2>USERCFG[DEFAULT] QDEF=<SPAN
class=800011413-28062007>public</SPAN>_qos MAXPROC[QOS:<SPAN
class=800011413-28062007>public</SPAN>_qos]=8 MAXJOB[QOS:<SPAN
class=800011413-28062007>public</SPAN>_qos]=4 MAXIPROC[QOS:<SPAN
class=800011413-28062007>public</SPAN>_qos]=8 MAXIJOB[QOS:<SPAN
class=800011413-28062007>public</SPAN>_qos]=4<BR></FONT>
<DIV><SPAN class=800011413-28062007><FONT face=Arial
size=2>USERCFG[DEFAULT]
MAXPROC[QOS:cfd_qos]=32 MAXJOB[QOS:cfd_qos]=32 MAXIPROC[QOS:cfd_qos]=32
MAXIJOB[QOS:cfd_qos]=32</FONT></SPAN></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>and then finally
allow the users of the CFD group access to their resources by
either:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>GROUPCFG[cfd] QDEF=cfd_qos,
QLIST=public_qos, cfd_qos</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>or lots
of:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>USERCFG[username]
QDEF=cfd_qos, QLIST=public_qos, cfd_qos</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>the GROUP one being
favourite as there are a lot of users.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>The end result I
wanted was to automatically:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>- Set any jobs in
queues cpu[1-8] to use the first set of nodes</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>- Set any jobs in
queue cfd to use the second set of nodes</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>- Allow any user to
subkit to queues cpu[1-8] with the MAXJOB, MAXPROC values being more
restrictive</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>- Allow the cfd
group to submit to the cpu[1-8] queues and the cfd queue, with the MAXJOB,
MAXPROC values being less restrictive.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=800011413-28062007>Any help would be
appreciated as I am coming up blank.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007>Jason</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=800011413-28062007></SPAN></FONT> </DIV>
<DIV> </DIV>
<DIV align=left>
<TABLE id=AutoNumber1
style="BORDER-TOP-WIDTH: 0px; BORDER-LEFT-WIDTH: 0px; BORDER-BOTTOM-WIDTH: 0px; BORDER-COLLAPSE: collapse; BORDER-RIGHT-WIDTH: 0px"
borderColor=#111111 cellPadding=2 align=left border=1>
<TBODY>
<TR>
<TD
style="BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT face=Arial>Dr Jason W
Jones</FONT></P>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"><FONT
face=Arial>School of Engineering</FONT></P>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"><FONT
face=Arial>University of Wales Swansea </FONT></P>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"><FONT
face=Arial>Singleton Park</FONT></P>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"><FONT
face=Arial>Swansea</FONT></P>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"><FONT
face=Arial>SA2 8PP UK</FONT></P></TD>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: #111111; BORDER-LEFT: 1px solid; BORDER-BOTTOM: #111111"
noWrap>
<P
style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"> </P>
<TABLE id=AutoNumber3
style="BORDER-TOP-WIDTH: 0px; BORDER-LEFT-WIDTH: 0px; BORDER-BOTTOM-WIDTH: 0px; BORDER-COLLAPSE: collapse; BORDER-RIGHT-WIDTH: 0px"
borderColor=#111111 cellSpacing=0 cellPadding=0 border=1>
<TBODY>
<TR>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT face=Arial
color=#3366ff> Tel:</FONT></P></TD>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT
face=Arial>+44-1792-295869</FONT></P></TD></TR>
<TR>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT face=Arial
color=#3366ff> Fax:</FONT></P></TD>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT
face=Arial>+44-1792-295676</FONT></P></TD></TR>
<TR>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px"><FONT face=Arial
color=#3366ff> E-mail: </FONT></P></TD>
<TD
style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none"
noWrap>
<P
style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 0px; MARGIN-RIGHT: 2px"><FONT
face=Arial><A
href="mailto:j.w.jones@swansea.ac.uk">j.w.jones@swansea.ac.uk</A>
</FONT></P></TD></TR></TBODY></TABLE>
<P
style="MARGIN-TOP: 1px; MARGIN-BOTTOM: 1px; MARGIN-LEFT: 2px"> </P></TD></TR></TBODY></TABLE></DIV>
<P> </P>
<DIV> </DIV></BODY></HTML>