<html><head></head><body bgcolor="#FFFFFF"><div>Hi Rainer,</div><div><br></div><div>Like Ken wrote it is possible with feature property. I use this feature heavily to place jobs on specific nodes.&nbsp;</div><div><br></div><div>To add feature to nodes</div><div><br></div><div>for i in {0..5}; do qmgr -c "set node node0$i properties += arrays"; done</div><div><br></div><div>Here feature is arrays. You can replace that with whatever you like.&nbsp;</div><div><br></div><div>Once you've done this you can get array jobs placed on these nodes by requesting this feature in qsub such as</div><div><br></div><div><blockquote type="cite"><div><blockquote type="cite"><blockquote type="cite"><font class="Apple-style-span" color="#000000">qsub the_script.sub -t 1-10 -l feature='arrays'</font></blockquote></blockquote></div></blockquote><div><br></div>This would put your jobs on the nodes that have property arrays. In this case the nodes are 0 to 5.</div><div><br></div><div>In my case I wrote a qsub wrapper which goes through the pbs scripts and command line and adds this feature line such as #PBS -l feature=&lt;feature name&gt; to the script so that they are placed on right nodes. This comes very handy especially when you have nodes with diiferent amounts of memory under the same queue.&nbsp;</div><div><br></div><div>If your scheduler is moab you can do really cool stuff using this feature property.&nbsp;</div><div><br></div><div>Hope this helps.&nbsp;</div><div><br></div><div>Sreedhar.&nbsp;<br><br><br></div><div><br>On 10-Feb-2012, at 2:49 AM, Rainer M Krug &lt;<a href="mailto:R.M.Krug@gmail.com">R.M.Krug@gmail.com</a>&gt; wrote:<br><br></div><div></div><blockquote type="cite"><div><span>-----BEGIN PGP SIGNED MESSAGE-----</span><br><span>Hash: SHA1</span><br><span></span><br><span>On 09/02/12 23:39, Ken Nielson wrote:</span><br><blockquote type="cite"><span></span><br></blockquote><blockquote type="cite"><span></span><br></blockquote><blockquote type="cite"><span>----- Original Message -----</span><br></blockquote><blockquote type="cite"><blockquote type="cite"><span>From: "Rainer M Krug" &lt;<a href="mailto:R.M.Krug@gmail.com">R.M.Krug@gmail.com</a>&gt; To:</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span><a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a> Sent: Thursday, February 9, 2012</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>2:16:07 AM Subject: [torqueusers] Specifying nodes which can be</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>used in array job</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>Hi</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>assuming I have cluster of 10 nodes (node01, ... node10), of</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>which I am not the administrator.</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>Some nodes are setup slightly different, so that a certain job</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>only runs on nodes node01 to node05.</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>So I would like to submit an array job and specify "only use the </span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>node01, node02, node03, node04 or node05 to run the each</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>individual job".</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>How can I do that? I know that I can use -l to specify resource </span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>requirements, but if I specify nodes=..., *each* job will</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>allocate *all* nodes for the job, which is not what I want - each</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>individual job should run on one of the nodes.</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>so:</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>qsub the_script.sub -t 1-10</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>and how do I specify the nodes?</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>Thanks,</span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span></span><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><span>Rainer</span><br></blockquote></blockquote><blockquote type="cite"><span></span><br></blockquote><blockquote type="cite"><span>Rainer,</span><br></blockquote><blockquote type="cite"><span></span><br></blockquote><blockquote type="cite"><span>Are there feature (properties) in the nodes files of those hosts</span><br></blockquote><blockquote type="cite"><span>which would allow you to specify a feature on the qsub line?</span><br></blockquote><span></span><br><span>No - unfortunately not.</span><br><span></span><br><blockquote type="cite"><span></span><br></blockquote><blockquote type="cite"><span>Ken</span><br></blockquote><span></span><br><span>-----BEGIN PGP SIGNATURE-----</span><br><span>Version: GnuPG v1.4.11 (GNU/Linux)</span><br><span>Comment: Using GnuPG with Mozilla - <a href="http://enigmail.mozdev.org/">http://enigmail.mozdev.org/</a></span><br><span></span><br><span>iEYEARECAAYFAk80zBgACgkQoYgNqgF2egri1wCfUUqDmOigKB8hCyCvt30pu5jZ</span><br><span>kewAnjfVc6o7rIjFua0ukEBhkaNe5McS</span><br><span>=nBnt</span><br><span>-----END PGP SIGNATURE-----</span><br><span></span><br><span>_______________________________________________</span><br><span>torqueusers mailing list</span><br><span><a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a></span><br><span><a href="http://www.supercluster.org/mailman/listinfo/torqueusers">http://www.supercluster.org/mailman/listinfo/torqueusers</a></span><br></div></blockquote></body></html>