<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
On 12/28/2010 11:14 AM, Steve Crusan wrote:
<blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
type="cite">
<title>Re: [torqueusers] [torquedev] TORQUE 2.5.4 released</title>
<font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;">Nice work!<br>
<br>
<br>
Just to be clear, at the moment, one cannot set an attribute
in the queue configuration (or the server’s nodes file) for
GPUs, but only in the node’s mom_config file? I couldn’t find
anything in the source to support something similar to setting
resource attributes for a node: set node bh001 gpus = $<br>
</span></font></blockquote>
Currently, the number of GPUs can only be set in the
TORQUE_HOME/server_priv nodes file. Nothing is currently available
to do a configuration on the MOM node.<br>
<blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;">
<br>
As for the second part about qrun (this may be a question for
the maui list...), is it necessary to use the qrun to manually
run a job with a nodes=$:ppn=$:gpu=$ in the resource listing?
I was under the impression that using GRES (in Maui) could
support this type of functionality, at least in a limited way.<br>
</span></font></blockquote>
GRES is separate from the nodes=$:ppn=$:gpu=$. GPUs can still be
scheduled as a GRES and the :gpu=$ syntax not used. If you use the
new syntax Moab 5.x will not run the job. It does not know what to
do with it. I have not tried Maui but I expect it will do the same
thing.<br>
<blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;">
<br>
Sorry rather basic questions, we’ve just gotten some GPUs in,
and we’re working to integrate them with the rest of our
cluster as seamlessly as possible.<br>
</span></font></blockquote>
<br>
Who is the vendor of your GPU? We plan to have auto-detection
support for NVIDIA soon.<br>
<br>
<blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;">
<br>
Thanks!<br>
<br>
~Steve<br>
<br>
<br>
On 12/28/10 12:45 PM, "Ken Nielson" <<a
moz-do-not-send="true" href="knielson@adaptivecomputing.com">knielson@adaptivecomputing.com</a>>
wrote:<br>
<br>
</span></font>
<blockquote><font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;"> It needs to be noted that
currently, only the Moab 6.0 scheduler is able to schedule
jobs using GPU support. If jobs are submitted with
schedulers other than Moab 6.0 the jobs can be executed
using the qrun command.<br>
<br>
Ken Nielson<br>
Adaptive Computing<br>
<br>
<br>
On 12/28/2010 10:24 AM, Ken Nielson wrote: <br>
</span></font>
<blockquote><font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;"> TORQUE 2.5.4 has been released.
<br>
<br>
GPGPU support is a new feature that has been added to
this release. GPUs can be allocated and consumed similar
to the way np (processors) are allocated and consumed. The
current support is configured in the
$TORQUE_HOME/server_priv/nodes file. Future versions of
TORQUE will add auto-detection of GPUs plus report
statistics for GPUs. For more information about how to use
GPU support in Torque visit <a moz-do-not-send="true"
href="http://www.clusterresources.com/products/torque/docs/1.5nodeconfig.shtml">http://www.clusterresources.com/products/torque/docs/1.5nodeconfig.shtml</a><br>
and also section 2.1.2 at <a moz-do-not-send="true"
href="http://www.clusterresources.com/products/torque/docs/2.1jobsubmission.shtml#resources">http://www.clusterresources.com/products/torque/docs/2.1jobsubmission.shtml#resources</a>
<br>
<br>
Several bug fixes were made to this version of TORQUE.
See the CHANGELOG in the distribution to review these
fixes.<br>
<br>
The tarball can be downloaded from <a
moz-do-not-send="true"
href="http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz">http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz</a>
<<a moz-do-not-send="true"
href="http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz">http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz</a>>
<br>
<br>
Thanks to everyone who helped get this build ready for
release.<br>
<br>
Ken Nielson<br>
Adaptive Computing<br>
<br>
<br>
<br>
_______________________________________________<br>
torquedev mailing list<br>
<a moz-do-not-send="true"
href="torquedev@supercluster.org">torquedev@supercluster.org</a><br>
<a moz-do-not-send="true"
href="http://www.supercluster.org/mailman/listinfo/torquedev">http://www.supercluster.org/mailman/listinfo/torquedev</a><br>
<br>
</span></font></blockquote>
<font face="Calibri, Verdana, Helvetica, Arial"><span
style="font-size: 11pt;"> <br>
<br>
<hr align="CENTER" size="3" width="95%"></span></font><font
size="2"><font face="Consolas, Courier New, Courier"><span
style="font-size: 10pt;">_______________________________________________<br>
torqueusers mailing list<br>
<a moz-do-not-send="true"
href="torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
<a moz-do-not-send="true"
href="http://www.supercluster.org/mailman/listinfo/torqueusers">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
</span></font></font></blockquote>
<font size="2"><font face="Consolas, Courier New, Courier"><span
style="font-size: 10pt;"><br>
</span></font></font><font face="Calibri, Verdana, Helvetica,
Arial"><span style="font-size: 11pt;"><br>
<br>
----------------------<br>
Steve Crusan<br>
System Administrator<br>
Center for Research Computing<br>
University of Rochester<br>
<a moz-do-not-send="true"
href="https://www.crc.rochester.edu/">https://www.crc.rochester.edu/</a><br>
</span></font>
<pre wrap="">
</pre>
</blockquote>
<br>
</body>
</html>