<font face="verdana,sans-serif">Hi All,<br><br>I have figured out that maui allocating correct number of processors but torque does not.<br>I am using torque 2.3.6 and maui 3.2.6p21<br><br>This is my basic test script<br>
====================<br>#PBS -q long<br>#PBS -l nodes=4:ppn=4<br># Check the number of nodes and their names<br>echo "Number of nodes:"<br>echo `wc -l < $PBS_NODEFILE`<br>echo "Node list:"<br>cat $PBS_NODEFILE<br>
===================<br><br></font>The job output and tracejob show a single node<br>========================<br>Number of nodes:<br>4<br>Node list:<br>node53.beowulf.cluster<br>node53.beowulf.cluster<br>node53.beowulf.cluster<br>
node53.beowulf.cluster<br>=================<br><br>Maui (showq, checkjob) shows total 16 proc alloacted <br>==============<br> checkjob -v 192520<br><br>checking job 192520 (RM job '<a href="http://192520.pbs1.pp.rhul.ac.uk">192520.pbs1.pp.rhul.ac.uk</a>')<br>
<br>State: Running<br>Creds: user:gsongara group:hep2 class:long qos:DEFAULT<br>WallTime: 00:00:22 of 2:12:00:00<br>SubmitTime: Fri Nov 26 16:14:34<br> (Time Queued Total: 00:00:01 Eligible: 00:00:01)<br><br>StartTime: Fri Nov 26 16:14:35<br>
Total Tasks: 16<br><br>Req[0] TaskCount: 16 Partition: DEFAULT<br>Network: [NONE] Memory >= 0 Disk >= 0 Swap >= 0<br>Opsys: [NONE] Arch: [NONE] Features: [NONE]<br>Exec: '' ExecSize: 0 ImageSize: 0<br>
Dedicated Resources Per Task: PROCS: 1<br>Utilized Resources Per Task: [NONE]<br>Avg Util Resources Per Task: PROCS: 0.01<br>Max Util Resources Per Task: [NONE]<br>Average Utilized Procs: 16.00<br>NodeAccess: SHARED<br>
TasksPerNode: 4 NodeCount: 4<br>Allocated Nodes:<br>[node56.beowulf.clust:4][node55.beowulf.clust:4][node54.beowulf.clust:4][node53.beowulf.clust:4]<br><br>Task Distribution: node56.beowulf.clust,node56.beowulf.clust,node56.beowulf.clust,node56.beowulf.clust,node55.beowulf.clust,node55.beowulf.clust,node55.beowulf.clust,node55.beowulf.clust,node54.beowulf.clust,node54.beowulf.clust,node54.beowulf.clust,...<br>
<br>========================================<br><br>I having basic queue config<br>set queue long resources_max.nodes = 4<br>set queue long resources_default.nodes = 1<br><br>Could you please advise, i think torque is bottleneck here.<br>
<br><br><br>Regards<br>Govind<br><br><br><br><br><br><br><div class="gmail_quote">On Wed, Nov 24, 2010 at 7:18 AM, Christopher Samuel <span dir="ltr"><<a href="mailto:samuel@unimelb.edu.au">samuel@unimelb.edu.au</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div class="im">-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
</div><div class="im">On 24/11/10 18:15, Govind wrote:<br>
<br>
> We are using both openmpi (complied with torque support) and mpich.<br>
> In both the cases it run jobs on single slot only. Please advise if i<br>
> required need any specific configuration on torque.<br>
<br>
</div>For Open-MPI you need to specify --with-tm=$PATH_TO_TORQUE<br>
for it to recognise and use the Torque build.<br>
<br>
Other than that it works fine, we've been using it for<br>
ages without any issues.<br>
<br>
cheers,<br>
<div class="im">Chris<br>
- --<br>
Christopher Samuel - Senior Systems Administrator<br>
VLSCI - Victorian Life Sciences Computational Initiative<br>
Email: <a href="mailto:samuel@unimelb.edu.au">samuel@unimelb.edu.au</a> Phone: +61 (0)3 903 55545<br>
<a href="http://www.vlsci.unimelb.edu.au/" target="_blank">http://www.vlsci.unimelb.edu.au/</a><br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v1.4.10 (GNU/Linux)<br>
Comment: Using GnuPG with Mozilla - <a href="http://enigmail.mozdev.org/" target="_blank">http://enigmail.mozdev.org/</a><br>
<br>
</div>iEYEARECAAYFAkzsvFoACgkQO2KABBYQAh/rhwCglzJBmQVSeXbbVufNJr4rElFD<br>
laoAmwTi1yUTymLu8R4FNI7gp92Pwiv6<br>
=M2Nr<br>
<div><div></div><div class="h5">-----END PGP SIGNATURE-----<br>
_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
</div></div></blockquote></div><br>