<p class="MsoNormal">Hello, </p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">I am trying
out the new PBSpro_7.0.0-solaris_sparc and maui3.2.6p13 on a </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">SunOS 5.10
Generic_118822-11 sun4u sparc SUNW, Sun-Fire-V240 box. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Installation
of PBS went smoothly and here's my PBS configuration:</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">qmgr</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Max open
servers: 4</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Qmgr: print
server</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Create
queues and set their attributes.</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Create
and define queue masternode</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">create
queue masternode</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
masternode queue_type = Execution</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
masternode enabled = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
masternode started = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Create
and define queue workq</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">create
queue workq</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
workq queue_type = Execution</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
workq enabled = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
workq started = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Create
and define queue default</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">create
queue default</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
default queue_type = Execution</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
default enabled = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
default started = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Create
and define queue GIGOgene</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">create
queue GIGOgene</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
GIGOgene queue_type = Execution</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
GIGOgene enabled = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set queue
GIGOgene started = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;"># Set
server attributes.</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">#</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
scheduling = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_host_enable = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_hosts = *.gds.unomaha.edu</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_user_enable = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_users = nazo</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_users += <a href="mailto:root@bfmaster.gds.unomaha.edu">root@bfmaster.gds.unomaha.edu</a></span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
acl_roots = <a href="mailto:root@bfmaster.gds.unomaha.edu">root@bfmaster.gds.unomaha.edu</a></span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
managers = <a href="mailto:root@bfmaster.gds.unomaha.edu">root@bfmaster.gds.unomaha.edu</a></span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
default_queue = default</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
log_events = 511</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
mail_from = adm</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
query_other_jobs = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
resources_default.ncpus = 1</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
scheduler_iteration = 600</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
resv_enable = True</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
node_fail_requeue = 310</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">set server
max_array_size = 10000</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">I have 20
nodes I am allocating for job submissions and they belong to a certain</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Queue defined
above. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">When
compiling maui I changed the following in the Makefile:</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">export
OSCCFLAGS=-m64 -g</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">export
OSLDFLAGS=-m64 -lsocket -lnsl –lresolv</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">The problem
I encounter is when I specify a pbs defined queue to run a job in. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Maui</span><span style="font-size: 10pt; font-family: Arial;"> for some reason is assigning all the nodes it's own
built-in DEFAULT queue which</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Is not
recognized by PBS and the job never runs and stays in queue. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Here's
portion of the maui.log that I think is relevant:</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">(e.g. It's
machine 3 we are talking about)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 __MPBSGetNodeState(Name,State,PNode)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node blackforest3
set to state Idle (free)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeFind(blackforest3,N)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeAdd(blackforest3,N)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeFind(blackforest3,N)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MRMNodePreLoad(blackforest3,Idle,BFMASTER)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MPBSNodeLoad(blackforest3,blackforest3,Idle,BFMASTER)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'Host'<span style="">&nbsp; </span>value: 'blackforest3'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'Port'<span style="">&nbsp; </span>value: '15002'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'ntype'<span style="">&nbsp; </span>value: 'cluster'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'state'<span style="">&nbsp; </span>value: 'free'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'license'<span style="">&nbsp; </span>value: 'l'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUMAGetIndex(GRes,l,ADD)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>adding
MAList[GRes][1]: 'l'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'pcpus'<span style="">&nbsp; </span>value: '2'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'properties'<span style="">&nbsp; </span>value: 'node3'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUGetMAttr(Feature,node3,ADD,16)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>added
MAList[Feature][1]: 'node3'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resources_available'<span style="">&nbsp; </span>value:
'linux'<span style="">&nbsp; </span>(r: arch)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUMAGetIndex(Arch,linux,ADD)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>adding
MAList[Arch][1]: 'linux'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resources_available'<span style="">&nbsp; </span>value:
'1035664kb'<span style="">&nbsp; </span>(r: mem)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resources_available'<span style="">&nbsp; </span>value: '2'<span style="">&nbsp; </span>(r: ncpus)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resources_assigned'<span style="">&nbsp; </span>value: '0kb'<span style="">&nbsp; </span>(r: mem)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resources_assigned'<span style="">&nbsp; </span>value: '0'<span style="">&nbsp; </span>(r: ncpus)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'queue'<span style="">&nbsp; </span>value: 'default'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>PBS node attribute
'resv_enable'<span style="">&nbsp; </span>value: 'True'<span style="">&nbsp; </span>(r: NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUMAGetIndex(Opsys,DEFAULT,ADD)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>adding
MAList[Opsys][1]: 'DEFAULT'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUMAGetBM(Network,DEFAULT,3)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>adding
MAList[Network][1]: 'DEFAULT'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>MNode[000] '<span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span>blackforest3'<span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span>Idle VM:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>1011 Mem:<span style="">&nbsp;
</span>1011 Dk:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>1 Cl: [NONE] [node3]</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>MNode[000] '<span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span>blackforest3' C/A/D procs:<span style="">&nbsp; </span>2/2/-1</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MRMNodePostLoad(blackforest3)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeLoadConfig(blackforest3,NULL)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MCfgGetSVal(Buf,CurPtr,NODECFG,blackforest3,Index,Value,SymTable)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MCfgGetVal(Buf,NODECFG,blackforest3,Index,Value,1024,SymTable)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MCPRestore(NODE,blackforest3,Optr)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeLoadCP(NP,NODE <span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</span>blackforest3 1127809549 &lt;node
STATACTIVETIME=&quot;0&quot; STATTOTALTIME=&quot;884539&quot;
STATUPTIME=&quot;884539&quot;&gt;&lt;/node&gt;)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUGetIndex(STATACTIVETIME,ValList,0)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUGetIndex(STATTOTALTIME,ValList,0)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MUGetIndex(STATUPTIME,ValList,0)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeUpdateResExpression(blackforest3)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeGetLocation(blackforest3)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>RMName 'blackforest3'
set for node[01][01] 'blackforest3'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>node slot not set on
node 'blackforest3'</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 INFO:<span style="">&nbsp;&nbsp;&nbsp;&nbsp; </span>node 'blackforest3'
assigned to location F:1/S:1</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">09/27
12:05:06 MNodeShow(blackforest3)</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">[000]
blackforest3: (P:2,S:1011,M:1011,D:1) [Idle][DEFAULT][linux]&lt;0.000000&gt;
C:[NONE][DEFAULT] [node3] [NONE]</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">I even
manually tried to assign nodes a specific partition</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">NODECFG[blackforest3]<span style="">&nbsp; </span><span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span>PARTITION=default<span style="">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span>(different than DEFAULT)
</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">It did not
work. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">&nbsp;</span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">This is
driving me crazy. Please email me if you have faced such a condition before or
if you need more info on this. </span></p>


<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial;">Thank you. </span></p>
<br>----------------------------------------------------------<br>Mohammad Shafiullah&nbsp;&nbsp;<br>Research
Systems
Assistant&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<br>Blackforest Cluster Computing Project&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <br>University of Nebraska at Omaha<br>----------------------------------------------------------