<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<div>It looks like torque is configured not to run jobs on the admin / main node (in this case, "cluster").  Thats why you get only 3 hosts available, because it will launch mpd on the c0-0, c0-1, and c0-2 nodes, but not cluster. </div><div><br></div><div>By default, torque is setup not to allow jobs to run on the admin / main node, but this can be enabled, and will have to be in your case.</div><div><br class="webkit-block-placeholder"></div><br><div> <span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">- Donald Tripp</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">  <a href="mailto:dtripp@hawaii.edu"><font class="Apple-style-span" color="#001FE6"><span class="Apple-style-span" style="color: rgb(0, 31, 230); -khtml-text-decorations-in-effect: underline; ">dtripp@hawaii.edu</span></font></a></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">----------------------------------------------</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">HPC Systems Administrator</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">High Performance Computing Center</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">University of Hawai'i at Hilo</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">200 W. Kawili Street</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Hilo,   Hawaii   96720</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><a href="http://www.hpc.uhh.hawaii.edu/"><span class="Apple-style-span" style="color: rgb(0, 0, 238); -khtml-text-decorations-in-effect: underline; ">http://www.hpc.uhh.hawaii.edu</span></a></div><br class="Apple-interchange-newline"></span> </div><br><div><div>On Jun 26, 2007, at 10:38 PM, Chaucer Cao wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><o:smarttagtype namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="chsdate" downloadurl=""> <o:smarttagtype namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="chmetcnv" downloadurl=""> <o:smarttagtype namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="PersonName"> <!--[if !mso]> <style> st1\:*{behavior:url(#default#ieooui) } </style> <![endif]--> <div class="Section1" style="layout-grid:15.6pt"><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Hi all,<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">In the pbs script file I can’t start the mpd (intel mpi ) useing the following command<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">****************************************************************************<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">mpdboot  --rsh=ssh -v -n `cat mpd.hosts|wc -l`  -f mpd.hosts<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">****************************************************************************<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">It gives:<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">--------------------------------------------------------------------------------------------------<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">totalnum=4  numhosts=3<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">there are not enough hosts on which to start all processes<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">--------------------------------------------------------------------------------------------------<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">But I can manually start mpd using the same command. <o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">-------------------------------------------------------------------------------------------------<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">[mpp@cluster std]$  mpdboot --rsh=ssh -v -n 4 -f mpd.hosts<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">running mpdallexit on cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">LAUNCHED mpd on cluster  via<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">RUNNING: mpd on cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">LAUNCHED mpd on c0-0  via  cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">LAUNCHED mpd on c0-1  via  cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">LAUNCHED mpd on c0-2  via  cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">RUNNING: mpd on c0-0<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">RUNNING: mpd on c0-1<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">RUNNING: mpd on c0-2<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">-------------------------------------------------------------------------------------------------<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Does any one know how to fix? Many thanks!<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Best wishes,<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Chaucer<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div class="MsoNormal" align="center" style="text-align:center"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"> <hr size="2" width="100%" align="center" tabindex="-1"> </span></font></div><p class="MsoNormal" align="left" style="text-align:left"><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family:宋体;font-weight:bold">发件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> Chaucer Cao [<a href="mailto:ccao@sgi.com">mailto:ccao@sgi.com</a>] <br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">发送时间<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> <st1:chsdate isrocdate="False" islunardate="False" day="26" month="6" year="2007" w:st="on">2007<span lang="EN-US"><span lang="EN-US">年6</span></span><span lang="EN-US"><span lang="EN-US">月26</span></span><span lang="EN-US"><span lang="EN-US">日</span></span></st1:chsdate> 14:12<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">收件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> 'Krause, Roland'<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">主题<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> </span></font><font size="2" face="宋体"><span style="font-size:10.0pt;font-family:宋体">答复<span lang="EN-US">: [torqueusers] how to get Environment Variables</span></span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p> </div><p class="MsoNormal" align="left" style="text-align:left"><font size="2" face="Times New Roman"><span lang="EN-US" style="font-size:10.5pt"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Hi Roland,<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Maybe the pbsnodes give the ntype cluster info. You :<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">c0-2<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     state = free<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     np = 4<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     ntype = cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     status = opsys=linux,uname=Linux </span></font><b><font size="1" color="red" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:red;font-weight:bold">compute-0-2.local</span></font></b><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"> <st1:chsdate isrocdate="False" islunardate="False" day="30" month="12" year="1899" w:st="on">2.6.9</st1:chsdate>-42.0.2.ELsmp #1 SMP Wed Aug 23 13:38:27 BST 2006 x86_64,sessions=14316,nsessions=1,nusers=1,idletime=105210,totmem=5045676kb,availmem=4608468kb,physmem=4025560kb,ncpus=4,loadave=4.00,netload=483100398328,state=free,jobs=,varattr=,rectime=1182836318<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">c0-1<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     state = free<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     np = 4<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     ntype = cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     status = opsys=linux,uname=Linux </span></font><b><font size="1" color="red" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:red;font-weight:bold">compute-0-1.local</span></font></b><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"> <st1:chsdate isrocdate="False" islunardate="False" day="30" month="12" year="1899" w:st="on">2.6.9</st1:chsdate>-42.0.2.ELsmp #1 SMP Wed Aug 23 13:38:27 BST 2006 x86_64,sessions=26709,nsessions=1,nusers=1,idletime=234995,totmem=5045672kb,availmem=4592532kb,physmem=4025556kb,ncpus=4,loadave=4.00,netload=697953068235,state=free,jobs=,varattr=,rectime=1182836316<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">c0-0<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     state = free<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     np = 4<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     ntype = cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     status = opsys=linux,uname=Linux </span></font><b><font size="1" color="red" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:red;font-weight:bold">compute-0-0.local</span></font></b><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"> <st1:chsdate isrocdate="False" islunardate="False" day="30" month="12" year="1899" w:st="on">2.6.9</st1:chsdate>-42.0.2.ELsmp #1 SMP Wed Aug 23 13:38:27 BST 2006 x86_64,sessions=28348,nsessions=1,nusers=1,idletime=220618,totmem=5045676kb,availmem=4557852kb,physmem=4025560kb,ncpus=4,loadave=4.00,netload=588068945521,state=free,jobs=,varattr=,rectime=1182836318<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     state = free<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     np = 4<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     ntype = cluster<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">     status = opsys=linux,uname=Linux </span></font><b><font size="1" color="red" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:red;font-weight:bold">cluster.hpc.org</span></font></b><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"> <st1:chsdate isrocdate="False" islunardate="False" day="30" month="12" year="1899" w:st="on">2.6.9</st1:chsdate>-42.0.2.ELsmp #1 SMP Wed Aug 23 13:38:27 BST 2006 x86_64,sessions=2993 24894 25052 25158 25307,nsessions=5,nusers=3,idletime=92734,totmem=5045676kb,availmem=4130016kb,physmem=4025560kb,ncpus=4,loadave=4.48,netload=678702222035,state=free,jobs=,varattr=,rectime=1182836315<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">It seems the head node get the different domain. In the /etc/hosts<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">#<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"># Do NOT Edit (generated by dbreport)<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">#<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">127.0.0.1       localhost.localdomain   localhost<o:p></o:p></span></font></p><p class="MsoNormal"><st1:chsdate isrocdate="False" islunardate="False" day="30" month="12" year="1899" w:st="on"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">10.1.1</span></font></st1:chsdate><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt; font-family:Arial;color:navy">.1        cluster.local cluster # originally frontend-0-0<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">10.255.255.254  compute-0-0.local compute-0<st1:chmetcnv tcsc="0" numbertype="1" negative="True" hasspace="True" sourcevalue="0" unitname="C" w:st="on">-0 c</st1:chmetcnv>0-0<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">10.255.255.253  compute-0-1.local compute-0<st1:chmetcnv tcsc="0" numbertype="1" negative="True" hasspace="True" sourcevalue="1" unitname="C" w:st="on">-1 c</st1:chmetcnv>0-1<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">10.255.255.252  compute-0-2.local compute-0<st1:chmetcnv tcsc="0" numbertype="1" negative="True" hasspace="True" sourcevalue="2" unitname="C" w:st="on">-2 c</st1:chmetcnv>0-2<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">192.168.1.1     cluster.hpc.org<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">But I don’t how tell the pbs_server he should use the cluster.local. </span></font><font size="1" color="navy" face="Wingdings"><span lang="EN-US" style="font-size:9.0pt;font-family: Wingdings;color:navy">J</span></font><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"> thanks!<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Best wishes,<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy">Chaucer<o:p></o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial;color:navy"><o:p> </o:p></span></font></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div class="MsoNormal" align="center" style="text-align:center"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"> <hr size="2" width="100%" align="center" tabindex="-1"> </span></font></div><p class="MsoNormal" align="left" style="text-align:left"><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family:宋体;font-weight:bold">发件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> Krause, Roland [<a href="mailto:Roland.Krause@amtc-dresden.com">mailto:Roland.Krause@amtc-dresden.com</a>] <br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">发送时间<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> <st1:chsdate isrocdate="False" islunardate="False" day="25" month="6" year="2007" w:st="on">2007<span lang="EN-US"><span lang="EN-US">年6</span></span><span lang="EN-US"><span lang="EN-US">月25</span></span><span lang="EN-US"><span lang="EN-US">日</span></span></st1:chsdate> 19:37<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">收件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> Chaucer Cao<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">主题<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> RE: [torqueusers] how to get Environment Variables</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p> </div><p class="MsoNormal" align="left" style="text-align:left"><font size="2" face="Times New Roman"><span lang="EN-US" style="font-size:10.5pt"><o:p> </o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">Hi Chaucer,</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"> <o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">beside our production system we have a test system with two nodes. One of them is server,</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">but I can run jobs with qsub -l nodes=2.</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">Do all your nodes have the "ntype" "cluster"?</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"> <o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">Regards,</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt;font-family:Arial; color:blue">Roland</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p> <blockquote style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt; margin-left:3.75pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"><p class="MsoNormal" align="left" style="text-align:left"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p> </o:p></span></font></p> <div class="MsoNormal" align="center" style="text-align:center"><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"> <hr size="2" width="100%" align="center" tabindex="-1"> </span></font></div><p class="MsoNormal" align="left" style="margin-bottom:12.0pt;text-align:left"><b><font size="2" face="Tahoma"><span lang="EN-US" style="font-size:10.0pt;font-family:Tahoma; font-weight:bold">From:</span></font></b><font size="2" face="Tahoma"><span lang="EN-US" style="font-size:10.0pt;font-family:Tahoma"> Chaucer Cao [<a href="mailto:ccao@sgi.com">mailto:ccao@sgi.com</a>] <br> <b><span style="font-weight:bold">Sent:</span></b> Monday, June 25, 2007 10:33 AM<br> <b><span style="font-weight:bold">To:</span></b> Krause, Roland<br> <b><span style="font-weight:bold">Subject:</span></b> ??: [torqueusers] how to get Environment Variables</span></font><font size="3" face="宋体"><span lang="EN-US" style="font-size:12.0pt;font-family:宋体"><o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">Hi Roland,<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">The Environment variables problem is OK now. but I encounter another problem:<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">There are four nodes including the head node. But I only can submit 3-node job by qsub. When I submit a 4-node job it gives:<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">c0-0<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">c0-1<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">c0-2<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">cluster<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">totalnum=4  numhosts=3<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">there are not enough hosts on which to start all processes<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">  1. no mpd is running on this host<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">  2. an mpd is running but was started without a "console" (-n option)<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">mpdtrace: cannot connect to local mpd (/tmp/mpd2.console_ccao); possible causes:<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">mpdallexit: cannot connect to local mpd (/tmp/mpd2.console_ccao); possible causes:<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">  1. no mpd is running on this host<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">  2. an mpd is running but was started without a "console" (-n option)<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">It seems I can’t run the job on head node(cluster) with pbs. But I can run 4-node job directly (without qsub). <o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">When I use pbsnodes to check it seems all nodes are in free status. Can you help me on this? Many thanks!<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">Best wishes,<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy">Chaucer<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"><o:p> </o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" color="navy" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial; color:navy"><o:p> </o:p></span></font></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt"> <div> <div class="MsoNormal" align="center" style="text-align:center;layout-grid-mode: char"><font size="3" face="Times New Roman"><span lang="EN-US" style="font-size: 12.0pt"> <hr size="2" width="100%" align="center" tabindex="-1"> </span></font></div><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family:宋体;font-weight:bold">发件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> Krause, Roland [<a href="mailto:Roland.Krause@amtc-dresden.com">mailto:Roland.Krause@amtc-dresden.com</a>] <br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">发送时间<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> <st1:chsdate isrocdate="False" islunardate="False" day="25" month="6" year="2007" w:st="on">2007<span lang="EN-US"><span lang="EN-US">年6</span></span><span lang="EN-US"><span lang="EN-US">月25</span></span><span lang="EN-US"><span lang="EN-US">日</span></span></st1:chsdate> 15:13<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">收件人<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> Chaucer Cao<br> </span></font><b><font size="2" face="宋体"><span style="font-size:10.0pt;font-family: 宋体;font-weight:bold">主题<span lang="EN-US">:</span></span></font></b><font size="2" face="宋体"><span lang="EN-US" style="font-size:10.0pt;font-family:宋体"> RE: [torqueusers] how to get Environment Variables</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p> </div><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="2" face="Times New Roman"><span lang="EN-US" style="font-size:10.5pt"><o:p> </o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt; font-family:Arial;color:blue">Hi Chaucer,</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="3" face="Times New Roman"><span lang="EN-US" style="font-size:12.0pt"> <o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt; font-family:Arial;color:blue">Could you provide  the part of your script, which is reading PBS env variables?</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="3" face="Times New Roman"><span lang="EN-US" style="font-size:12.0pt"> <o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt; font-family:Arial;color:blue">Regards,</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="2" color="blue" face="Arial"><span lang="EN-US" style="font-size:10.0pt; font-family:Arial;color:blue">Roland</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p> <blockquote style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt; margin-left:3.75pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"><p class="MsoNormal" align="left" style="text-align:left;layout-grid-mode:char"><font size="3" face="Times New Roman"><span lang="EN-US" style="font-size:12.0pt"><o:p> </o:p></span></font></p> <div class="MsoNormal" align="center" style="text-align:center;layout-grid-mode: char"><font size="3" face="Times New Roman"><span lang="EN-US" style="font-size: 12.0pt"> <hr size="2" width="100%" align="center" tabindex="-1"> </span></font></div><p class="MsoNormal" align="left" style="margin-bottom:12.0pt;text-align:left; layout-grid-mode:char"><b><font size="2" face="Tahoma"><span lang="EN-US" style="font-size:10.0pt;font-family:Tahoma;font-weight:bold">From:</span></font></b><font size="2" face="Tahoma"><span lang="EN-US" style="font-size:10.0pt;font-family:Tahoma"> torqueusers-bounces@supercluster.org [<a href="mailto:torqueusers-bounces@supercluster.org">mailto:torqueusers-bounces@supercluster.org</a>] <b><span style="font-weight:bold">On Behalf Of </span></b>Chaucer Cao<br> <b><span style="font-weight:bold">Sent:</span></b> Wednesday, June 20, 2007 7:16 PM<br> <b><span style="font-weight:bold">To:</span></b> <st1:personname w:st="on"><a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a></st1:personname><br> <b><span style="font-weight:bold">Subject:</span></b> [torqueusers] how to get Environment Variables</span></font><font size="3"><span lang="EN-US" style="font-size:12.0pt"><o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">Hi all,<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">Does any one know how can I get the the PBS environment variables in the run script file. When I qsub my script file it gives:<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">PBS_NODEFILE: Undefined variable.<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">PBS_ENVIRONMENT: Undefined variable.<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">Many thanks!<o:p></o:p></span></font></p><p class="MsoNormal" style="layout-grid-mode:char"><font size="1" face="Arial"><span lang="EN-US" style="font-size:9.0pt;font-family:Arial">Chaucer<o:p></o:p></span></font></p> </blockquote> </div> </blockquote> </div> </div> </div> </o:smarttagtype></o:smarttagtype></o:smarttagtype><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">_______________________________________________</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">torqueusers mailing list</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><a href="http://www.supercluster.org/mailman/listinfo/torqueusers">http://www.supercluster.org/mailman/listinfo/torqueusers</a></div> </blockquote></div><br></body></html>