<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#ffffff" text="#000000">
    On 12/28/2010 11:14 AM, Steve Crusan wrote:
    <blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
      type="cite">
      <title>Re: [torqueusers] [torquedev] TORQUE 2.5.4 released</title>
      <font face="Calibri, Verdana, Helvetica, Arial"><span
          style="font-size: 11pt;">Nice work!<br>
          <br>
          <br>
          Just to be clear, at the moment, one cannot set an attribute
          in the queue configuration (or the server&#8217;s nodes file) for
          GPUs, but only in the node&#8217;s mom_config file? I couldn&#8217;t find
          anything in the source to support something similar to setting
          resource attributes for a node: &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;set node bh001 gpus = $<br>
        </span></font></blockquote>
    Currently, the number of GPUs can only be set in the
    TORQUE_HOME/server_priv nodes file. Nothing is currently available
    to do a configuration on the MOM node.<br>
    <blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
      type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
          style="font-size: 11pt;">
          <br>
          As for the second part about qrun (this may be a question for
          the maui list...), is it necessary to use the qrun to manually
          run a job with a nodes=$:ppn=$:gpu=$ in the resource listing?
          I was under the impression that using GRES (in Maui) could
          support this type of functionality, at least in a limited way.<br>
        </span></font></blockquote>
    GRES is separate from the nodes=$:ppn=$:gpu=$. GPUs can still be
    scheduled as a GRES and the :gpu=$ syntax not used. If you use the
    new syntax Moab 5.x will not run the job. It does not know what to
    do with it. I have not tried Maui but I expect it will do the same
    thing.<br>
    <blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
      type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
          style="font-size: 11pt;">
          <br>
          Sorry rather basic questions, we&#8217;ve just gotten some GPUs in,
          and we&#8217;re working to integrate them with the rest of our
          cluster as seamlessly as possible.<br>
        </span></font></blockquote>
    <br>
    Who is the vendor of your GPU? We plan to have auto-detection
    support for NVIDIA soon.<br>
    <br>
    <blockquote cite="mid:C93F9321.D16E%25scrusan@ur.rochester.edu"
      type="cite"><font face="Calibri, Verdana, Helvetica, Arial"><span
          style="font-size: 11pt;">
          <br>
          Thanks!<br>
          <br>
          ~Steve<br>
          <br>
          <br>
          On 12/28/10 12:45 PM, "Ken Nielson" &lt;<a
            moz-do-not-send="true" href="knielson@adaptivecomputing.com">knielson@adaptivecomputing.com</a>&gt;
          wrote:<br>
          <br>
        </span></font>
      <blockquote><font face="Calibri, Verdana, Helvetica, Arial"><span
            style="font-size: 11pt;"> &nbsp;&nbsp;It needs to be noted that
            currently, only the Moab 6.0 scheduler is able to schedule
            jobs using GPU support. &nbsp;If jobs are submitted with
            schedulers other than Moab 6.0 the jobs can be executed
            using the qrun command.<br>
            &nbsp;<br>
            &nbsp;Ken Nielson<br>
            &nbsp;Adaptive Computing<br>
            &nbsp;<br>
            &nbsp;<br>
            &nbsp;On 12/28/2010 10:24 AM, Ken Nielson wrote: <br>
          </span></font>
        <blockquote><font face="Calibri, Verdana, Helvetica, Arial"><span
              style="font-size: 11pt;"> &nbsp;TORQUE 2.5.4 has been released.
              <br>
              &nbsp;<br>
              &nbsp;GPGPU support is a new feature that has been added to
              this release. GPUs can be allocated and consumed similar
              to the way np (processors) are allocated and consumed. The
              current support is configured in the
              $TORQUE_HOME/server_priv/nodes file. Future versions of
              TORQUE will add auto-detection of GPUs plus report
              statistics for GPUs. For more information about how to use
              GPU support in Torque visit &nbsp;<a moz-do-not-send="true"
href="http://www.clusterresources.com/products/torque/docs/1.5nodeconfig.shtml">http://www.clusterresources.com/products/torque/docs/1.5nodeconfig.shtml</a><br>
              &nbsp;and also section 2.1.2 at <a moz-do-not-send="true"
href="http://www.clusterresources.com/products/torque/docs/2.1jobsubmission.shtml#resources">http://www.clusterresources.com/products/torque/docs/2.1jobsubmission.shtml#resources</a>
              <br>
              &nbsp;<br>
              &nbsp;Several bug fixes were made to this version of TORQUE.
              See the CHANGELOG in the distribution to review these
              fixes.<br>
              &nbsp;<br>
              &nbsp;The tarball can be downloaded from <a
                moz-do-not-send="true"
href="http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz">http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz</a>
              &lt;<a moz-do-not-send="true"
href="http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz">http://www.clusterresources.com/downloads/torque/torque-2.5.4.tar.gz</a>&gt;
              &nbsp;<br>
              &nbsp;<br>
              &nbsp;Thanks to everyone who helped get this build ready for
              release.<br>
              &nbsp;<br>
              &nbsp;Ken Nielson<br>
              &nbsp;Adaptive Computing<br>
              &nbsp;<br>
              <br>
              <br>
              _______________________________________________<br>
              torquedev mailing list<br>
              <a moz-do-not-send="true"
                href="torquedev@supercluster.org">torquedev@supercluster.org</a><br>
              <a moz-do-not-send="true"
                href="http://www.supercluster.org/mailman/listinfo/torquedev">http://www.supercluster.org/mailman/listinfo/torquedev</a><br>
              &nbsp;<br>
            </span></font></blockquote>
        <font face="Calibri, Verdana, Helvetica, Arial"><span
            style="font-size: 11pt;"> <br>
            &nbsp;<br>
            <hr align="CENTER" size="3" width="95%"></span></font><font
          size="2"><font face="Consolas, Courier New, Courier"><span
              style="font-size: 10pt;">_______________________________________________<br>
              torqueusers mailing list<br>
              <a moz-do-not-send="true"
                href="torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
              <a moz-do-not-send="true"
                href="http://www.supercluster.org/mailman/listinfo/torqueusers">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
            </span></font></font></blockquote>
      <font size="2"><font face="Consolas, Courier New, Courier"><span
            style="font-size: 10pt;"><br>
          </span></font></font><font face="Calibri, Verdana, Helvetica,
        Arial"><span style="font-size: 11pt;"><br>
          <br>
          ----------------------<br>
          Steve Crusan<br>
          System Administrator<br>
          Center for Research Computing<br>
          University of Rochester<br>
          <a moz-do-not-send="true"
            href="https://www.crc.rochester.edu/">https://www.crc.rochester.edu/</a><br>
        </span></font>
      <pre wrap="">
</pre>
    </blockquote>
    <br>
  </body>
</html>