<div dir="ltr">Hi all,<div><br></div><div>I'm configuring a recent torque/maui installation and I'm having trouble with submitting MPI jobs. I would like for MPI jobs to specify the number of processors they require and have those come from any available physical machine, the users shouldn't need to specify processors per node etc.</div>
<div><br></div><div>The torque manual says that the nodes option is mapped to virtual processors, so for example:</div><div><br></div><div style> #PBS -l nodes=8</div><div style><br></div><div style>should request 8 virtual processors. The problem I'm having is that our cluster currently has only 5 physical machines (nodes), and setting nodes to anything greater than 5 gives the error:</div>
<div style><br></div><div style> qsub: Job exceeds queue resource limits MSG=cannot locate feasible nodes (nodes file is empty or all systems are busy)<br></div><div><br></div><div style>I'm confused by this, we have 33 virtual processors available across the 5 nodes (4 8-core machines and one single core) so my interpretation of the manual is that I should be able to request 8 nodes, since these should be understood as virtual processors? Am I doing something wrong?</div>
<div style><br></div><div style>I tried setting</div><div style><br></div><div style>#PBS -l procs=8</div><div style><br></div><div style>but that doesn't seem to do anything, MPI stops due to having only 1 worker available (single core allocated to the job).</div>
<div style><br></div><div style>Thanks,</div><div style>Andrew</div><div style><br></div><div style>p.s.</div><div style><br></div><div style>The queue I'm submitting jobs to is defined as:</div><div style><br></div><div style>
<div>create queue normal</div><div>set queue normal queue_type = Execution</div><div>set queue normal resources_min.cput = 12:00:00</div><div>set queue normal resources_default.cput = 24:00:00</div><div>set queue normal disallowed_types = interactive</div>
<div>set queue normal enabled = True</div><div>set queue normal started = True</div><div><br></div></div><div>and we are using torque version 2.5.12 and we are using maui 3.3.1 for scheduling<br clear="all"><div><br></div>
</div></div>