<html><body><div style="color:#000; background-color:#fff; font-family:arial, helvetica, sans-serif;font-size:12pt">Specifying pmem need to know the amount of memory which is a bit difficult to predict. It seems that <span style="color:black;">NODEALLOCATIONPOLICY can help. I will investigate further. <br><br>Thanks</span><div>&nbsp;</div><div><div><font style="BACKGROUND-COLOR:#ffffff;" color="#0080ff" face="arial, helvetica, sans-serif" size="2"><span style="color:rgb(0, 0, 0);">Regards,<br>Mahmood</span><b><br></b></font></div></div><div><br></div>  <div style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <hr size="1">  <font face="Arial" size="2"> <b><span style="font-weight:bold;">From:</span></b> "Moye,Roger V" &lt;RVMoye@mdanderson.org&gt;<br> <b><span style="font-weight: bold;">To:</span></b> Torque Users Mailing List
 &lt;torqueusers@supercluster.org&gt;; Mahmood Naderan &lt;nt_mahmood@yahoo.com&gt; <br> <b><span style="font-weight: bold;">Sent:</span></b> Wednesday, September 18, 2013 7:07 PM<br> <b><span style="font-weight: bold;">Subject:</span></b> RE: [torqueusers] setting an upper value for available memory on a node<br> </font> </div> <div class="y_msg_container"><br><div id="yiv9510746242">

 
 
<style><!--
#yiv9510746242  
 _filtered #yiv9510746242 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;}
 _filtered #yiv9510746242 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;}
#yiv9510746242  
#yiv9510746242 p.yiv9510746242MsoNormal, #yiv9510746242 li.yiv9510746242MsoNormal, #yiv9510746242 div.yiv9510746242MsoNormal
        {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;font-family:"Times New Roman", "serif";}
#yiv9510746242 a:link, #yiv9510746242 span.yiv9510746242MsoHyperlink
        {color:blue;text-decoration:underline;}
#yiv9510746242 a:visited, #yiv9510746242 span.yiv9510746242MsoHyperlinkFollowed
        {color:purple;text-decoration:underline;}
#yiv9510746242 p.yiv9510746242MsoAcetate, #yiv9510746242 li.yiv9510746242MsoAcetate, #yiv9510746242 div.yiv9510746242MsoAcetate
        {margin:0in;margin-bottom:.0001pt;font-size:8.0pt;font-family:"Tahoma", "sans-serif";}
#yiv9510746242 span.yiv9510746242EmailStyle17
        {font-family:"Calibri", "sans-serif";color:#1F497D;}
#yiv9510746242 span.yiv9510746242EmailStyle18
        {font-family:"Calibri", "sans-serif";color:#1F497D;}
#yiv9510746242 span.yiv9510746242BalloonTextChar
        {font-family:"Tahoma", "sans-serif";}
#yiv9510746242 .yiv9510746242MsoChpDefault
        {font-size:10.0pt;}
 _filtered #yiv9510746242 {margin:1.0in 1.0in 1.0in 1.0in;}
#yiv9510746242 div.yiv9510746242WordSection1
        {}
--></style>

<div>
<div class="yiv9510746242WordSection1">
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">I believe you can also encourage the users to use the pmem option in their submissions to request the amount of memory that they need.&nbsp; Then a job will not
 be assigned to a node with insufficient memory.&nbsp; Of course, this means that you are relying on the user to specify pmem, and that the value they request is accurate.</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">-Roger</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div>
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">-----------------------------------------------------------</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Roger V. Moye</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Systems Analyst III</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">XSEDE Campus Champion</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">University of Texas - MD Anderson Cancer Center</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Division of Quantitative Sciences</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Pickens Academic Tower - FCT4.6109</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Houston, Texas</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">(713) 792-2134</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">-----------------------------------------------------------</span></div> 
</div>
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in;">
<div class="yiv9510746242MsoNormal"><b><span style="font-size:10.0pt;">From:</span></b><span style="font-size:10.0pt;"> torqueusers-bounces@supercluster.org [mailto:torqueusers-bounces@supercluster.org]
<b>On Behalf Of </b>Andrus, Brian Contractor<br>
<b>Sent:</b> Wednesday, September 18, 2013 10:21 AM<br>
<b>To:</b> Mahmood Naderan; Torque Users Mailing List<br>
<b>Cc:</b> mauiusers-request@supercluster.org<br>
<b>Subject:</b> Re: [torqueusers] setting an upper value for available memory on a node</span></div> 
</div>
</div>
<div class="yiv9510746242MsoNormal"> &nbsp;</div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">If you are using Maui (which I assume you are since you sent your request to that list as well), you should look at NODEALLOCATIONPOLICY.</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">If you set that to PRIORITY and then use AMEM to set the priority of nodes, jobs go to the node with the most available memory first.</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Here is an example from the manual:</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:13.5pt;color:black;">Example 1: Favor the fastest nodes with the most available memory which are running the fewest jobs</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div style="color: rgb(31, 73, 125); font-size: 11pt; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;" class="yiv9510746242MsoNormal"><span style="color:black;">NODEALLOCATIONPOLICY PRIORITY<br>
NODECFG[DEFAULT] PRIORITYF='SPEED+ .01 * AMEM - 10 * JOBCOUNT'</span><span style="font-size:11.0pt;color:#1F497D;"></span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Brian Andrus</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">ITACS/Research Computing</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Naval Postgraduate School</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">Monterey, California</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;">voice: 831-656-6238</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div class="yiv9510746242MsoNormal"><span style="font-size:11.0pt;color:#1F497D;"> &nbsp;</span></div> 
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt;">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in;">
<div class="yiv9510746242MsoNormal"><b><span style="font-size:10.0pt;">From:</span></b><span style="font-size:10.0pt;">
<a rel="nofollow" ymailto="mailto:torqueusers-bounces@supercluster.org" target="_blank" href="mailto:torqueusers-bounces@supercluster.org">torqueusers-bounces@supercluster.org</a> [<a rel="nofollow" ymailto="mailto:torqueusers-bounces@supercluster.org" target="_blank" href="mailto:torqueusers-bounces@supercluster.org">mailto:torqueusers-bounces@supercluster.org</a>]
<b>On Behalf Of </b>Mahmood Naderan<br>
<b>Sent:</b> Saturday, September 14, 2013 10:12 PM<br>
<b>To:</b> torque cluster<br>
<b>Cc:</b> <a rel="nofollow" ymailto="mailto:mauiusers-request@supercluster.org" target="_blank" href="mailto:mauiusers-request@supercluster.org">mauiusers-request@supercluster.org</a><br>
<b>Subject:</b> [torqueusers] setting an upper value for available memory on a node</span></div> 
</div>
</div>
<div class="yiv9510746242MsoNormal"> &nbsp;</div> 
<div>
<div class="yiv9510746242MsoNormal" style="background:white;"><span style="color:black;">Dear all,<br>
Is there any way to set a maximum value for used memory on a node? Assume a node has 32 cores with 64GB total shared memory. Now there are 20 running jobs (12 cores are idle) but 60GB of memory is used. Now I want to set a policy to defer an incoming job because
 there is not enough memory. <br>
<br>
Any idea to accomplish that?</span></div> 
<div>
<div class="yiv9510746242MsoNormal" style="background:white;"><span style="color:black;"> &nbsp;</span></div> 
</div>
<div>
<div class="yiv9510746242MsoNormal" style="background:white;"><span style="color:black;">&nbsp;</span></div> 
</div>
<div>
<div>
<div class="yiv9510746242MsoNormal" style="background:white;"><span style="font-size:10.0pt;color:black;background:white;">Regards,<br>
Mahmood</span><span style="color:black;"></span></div> 
</div>
</div>
</div>
</div>
</div>
</div>
</div><br><br></div> </div> </div>  </div></body></html>