<div dir="ltr"><div>Thanks Gus  and James. It solved my problem.<br><br></div>Amjad<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Oct 24, 2013 at 9:34 PM, Gus Correa <span dir="ltr">&lt;<a href="mailto:gus@ldeo.columbia.edu" target="_blank">gus@ldeo.columbia.edu</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Did you enable scheduling?<br>
On the Torque server:<br>
<br>
qmgr -c &#39;set server scheduling = True&#39;<br>
<br>
I hope it helps,<br>
Gus Correa<br>
<div><div class="h5"><br>
On 10/24/2013 02:10 PM, Amjad Syed wrote:<br>
&gt; Hello<br>
&gt;<br>
&gt; We are having a small 60 node cluster with 12 cores each.<br>
&gt;<br>
&gt; We are using Torque 2.5.12 and Maui 3.3<br>
&gt;<br>
&gt; When i submit jobs on torque using multi-core  using #PBS directive ,<br>
&gt; the jobs get queued in the queue. I can run the job with qsub in<br>
&gt; Interactive mode.<br>
&gt;<br>
&gt; #PBS -l &quot;nodes=1:ppn=4&quot;<br>
&gt;<br>
&gt; The error i get in  maui log file as follows :<br>
&gt;<br>
&gt;<br>
&gt; 10/24 20:16:10 ALERT:    job 427 cannot run in any partition<br>
&gt; 10/24 20:16:10 ALERT:    cannot create new reservation for job 427<br>
&gt; (shape[1] 4)<br>
&gt; 10/24 20:16:10 ALERT:    cannot create new reservation for job 427<br>
&gt; 10/24 20:16:10 ALERT:    job &#39;427&#39; cannot run (deferring job for 3600<br>
&gt; seconds)<br>
&gt;<br>
&gt; -----------------------------------------------------------------------------------------------------<br>
&gt; The  showref  shows the following<br>
&gt;<br>
&gt; Reservations<br>
&gt;<br>
&gt; ReservationID       Type S       Start         End    Duration    N/P<br>
&gt; StartTime<br>
&gt;<br>
&gt;<br>
&gt; 0 reservations located<br>
&gt;<br>
&gt; ---------------------------------------------------------------------------------------------------------------------<br>
&gt;<br>
&gt; Showbf gives the following error:<br>
&gt;<br>
&gt; Node is blocked  by reservation NONE in INFINITY<br>
&gt;<br>
&gt; ----------------------------------------------------------------------------------------------------------------------------------------------------------------------<br>
&gt;<br>
&gt; checkjob  gives the following<br>
&gt;<br>
&gt; checking job 427<br>
&gt;<br>
&gt; State: Idle  EState: Deferred<br>
&gt; Creds:  user:guestuser2  group:guestuser2  class:p60  qos:DEFAULT<br>
&gt; WallTime: 00:00:00 of 1:00:00<br>
&gt; SubmitTime: Thu Oct 24 11:11:50<br>
&gt;    (Time Queued  Total: 10:03:14  Eligible: 00:00:00)<br>
&gt;<br>
&gt; Total Tasks: 4<br>
&gt;<br>
&gt; Req[0]  TaskCount: 4  Partition: ALL<br>
&gt; Network: [NONE]  Memory &gt;= 0  Disk &gt;= 0  Swap &gt;= 0<br>
&gt; Opsys: [NONE]  Arch: [NONE]  Features: [NONE]<br>
&gt;<br>
&gt;<br>
&gt; IWD: [NONE]  Executable:  [NONE]<br>
&gt; Bypass: 0  StartCount: 0<br>
&gt; PartitionMask: [ALL]<br>
&gt; Flags:       RESTARTABLE<br>
&gt;<br>
&gt; job is deferred.  Reason:  NoResources  (cannot create reservation for<br>
&gt; job &#39;427&#39; (intital reservation attempt)<br>
&gt; )<br>
&gt; Holds:    Defer  (hold reason:  NoResources)<br>
&gt; PE:  4.00  StartPriority:  58<br>
&gt; cannot select job 427 for partition DEFAULT (job hold active)<br>
&gt;<br>
&gt; -----------------------------------------------------------------------------------------------------------------------------------------------<br>
&gt;<br>
&gt; My queue configuration is as follows<br>
&gt;<br>
&gt;   queue_type = Execution<br>
&gt;          max_queuable = 120<br>
&gt;          max_user_queuable = 120<br>
&gt;          total_jobs = 3<br>
&gt;          state_count = Transit:0 Queued:-2 Held:0 Waiting:0 Running:5<br>
&gt; Exiting:0<br>
&gt;          max_running = 20<br>
&gt;          resources_max.ncpus = 64<br>
&gt;          resources_max.walltime = 48:00:00<br>
&gt;          resources_default.neednodes = 1<br>
&gt;          resources_default.nodect = 1<br>
&gt;          resources_default.nodes = 1<br>
&gt;          resources_default.walltime = 01:00:00<br>
&gt;          mtime = Thu Oct 24 15:28:41 2013<br>
&gt;          resources_assigned.nodect = 0<br>
&gt;          max_user_run = 10<br>
&gt;          enabled = True<br>
&gt;          started = True<br>
&gt; ----------------------------------------------------------------------------------------------------------------------------------<br>
&gt;<br>
&gt; My Pbs server configuration is as follows<br>
&gt;<br>
&gt;   server_state = Idle<br>
&gt;          total_jobs = 3<br>
&gt;          state_count = Transit:0 Queued:-129 Held:127 Waiting:0<br>
&gt; Running:5 Exiting:0<br>
&gt;          acl_hosts = krplpadul001<br>
&gt;          default_queue = p60<br>
&gt;          log_events = 511<br>
&gt;          mail_from = adm<br>
&gt;          resources_assigned.nodect = 0<br>
&gt;          scheduler_iteration = 600<br>
&gt;          node_check_rate = 150<br>
&gt;          tcp_timeout = 6<br>
&gt;          pbs_version = 2.5.12<br>
&gt;          auto_node_np = False<br>
&gt;          next_job_number = 428<br>
&gt;          net_counter = 12 4 2<br>
&gt;          record_job_info = True<br>
&gt;          record_job_script = True<br>
&gt;          job_log_keep_days = 7<br>
&gt;<br>
&gt;<br>
&gt; -------------------------------------------------------------------------------------------------------------------------------------------------------<br>
&gt; Maui schedctl shows the following<br>
&gt;<br>
&gt;<br>
&gt; REJECTNEGPRIOJOBS[0]              FALSE<br>
&gt; ENABLENEGJOBPRIORITY[0]           FALSE<br>
&gt; ENABLEMULTINODEJOBS[0]            TRUE<br>
&gt; ENABLEMULTIREQJOBS[0]             FALSE<br>
&gt; BFPRIORITYPOLICY[0]               [NONE]<br>
&gt; JOBPRIOACCRUALPOLICY            QUEUEPOLICY<br>
&gt; NODELOADPOLICY                  ADJUSTSTATE<br>
&gt; USEMACHINESPEED                 FALSE<br>
&gt; USESYSTEMQUEUETIME              TRUE<br>
&gt; USELOCALMACHINEPRIORITY         FALSE<br>
&gt; NODEUNTRACKEDLOADFACTOR         1.2<br>
&gt; JOBNODEMATCHPOLICY[0]<br>
&gt;<br>
&gt; JOBMAXSTARTTIME[0]                  INFINITY<br>
&gt;<br>
&gt; METAMAXTASKS[0]                   0<br>
&gt; NODESETPOLICY[0]                  [NONE]<br>
&gt; NODESETATTRIBUTE[0]               [NONE]<br>
&gt; NODESETLIST[0]<br>
&gt; NODESETDELAY[0]                   00:00:00<br>
&gt; NODESETPRIORITYTYPE[0]            MINLOSS<br>
&gt; NODESETTOLERANCE[0]                 0.00<br>
&gt;<br>
&gt; BACKFILLPOLICY[0]                 FIRSTFIT<br>
&gt; BACKFILLDEPTH[0]                  0<br>
&gt; BACKFILLPROCFACTOR[0]             0<br>
&gt; BACKFILLMAXSCHEDULES[0]           10000<br>
&gt; BACKFILLMETRIC[0]                 PROCS<br>
&gt;<br>
&gt; BFCHUNKDURATION[0]                00:00:00<br>
&gt; BFCHUNKSIZE[0]                    0<br>
&gt; PREEMPTPOLICY[0]                  REQUEUE<br>
&gt; MINADMINSTIME[0]                  00:00:00<br>
&gt; RESOURCELIMITPOLICY[0]<br>
&gt; NODEAVAILABILITYPOLICY[0]         COMBINED:[DEFAULT]<br>
</div></div>&gt; NODEALLOCATION POLICY[0]           MINRESOURCE<br>
<div><div class="h5">&gt; TASKDISTRIBUTIONPOLICY[0]         DEFAULT<br>
&gt; RESERVATIONPOLICY[0]              CURRENTHIGHEST<br>
&gt; RESERVATIONRETRYTIME[0]           00:00:00<br>
&gt; RESERVATIONTHRESHOLDTYPE[0]       NONE<br>
&gt; RESERVATIONTHRESHOLDVALUE[0]      0<br>
&gt;<br>
&gt; FSPOLICY                        [NONE]<br>
&gt; FSPOLICY                        [NONE]<br>
&gt; FSINTERVAL                      12:00:00<br>
&gt; FSDEPTH                         8<br>
&gt; FSDECAY                         1.00<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; # Priority Weights<br>
&gt;<br>
&gt; SERVICEWEIGHT[0]                  1<br>
&gt; TARGETWEIGHT[0]                   1<br>
&gt; CREDWEIGHT[0]                     1<br>
&gt; ATTRWEIGHT[0]                     1<br>
&gt; FSWEIGHT[0]                       1<br>
&gt; RESWEIGHT[0]                      1<br>
&gt; USAGEWEIGHT[0]                    1<br>
&gt; QUEUETIMEWEIGHT[0]                1<br>
&gt; XFACTORWEIGHT[0]                  0<br>
&gt; SPVIOLATIONWEIGHT[0]              0<br>
&gt; BYPASSWEIGHT[0]                   0<br>
&gt; TARGETQUEUETIMEWEIGHT[0]          0<br>
&gt; TARGETXFACTORWEIGHT[0]            0<br>
&gt; USERWEIGHT[0]                     0<br>
&gt; GROUPWEIGHT[0]                    0<br>
&gt; ACCOUNTWEIGHT[0]                  0<br>
&gt; QOSWEIGHT[0]                      0<br>
&gt; CLASSWEIGHT[0]                    0<br>
&gt; FSUSERWEIGHT[0]                   0<br>
&gt; FSGROUPWEIGHT[0]                  0<br>
&gt; FSACCOUNTWEIGHT[0]                0<br>
&gt; FSQOSWEIGHT[0]                    0<br>
&gt; FSCLASSWEIGHT[0]                  0<br>
&gt; ATTRATTRWEIGHT[0]                 0<br>
&gt; ATTRSTATEWEIGHT[0]                0<br>
&gt; NODEWEIGHT[0]                     0<br>
&gt; PROCWEIGHT[0]                     0<br>
&gt; MEMWEIGHT[0]                      0<br>
&gt; SWAPWEIGHT[0]                     0<br>
&gt; DISKWEIGHT[0]                     0<br>
&gt; PSWEIGHT[0]                       0<br>
&gt; PEWEIGHT[0]                       0<br>
&gt; WALLTIMEWEIGHT[0]                 0<br>
&gt; UPROCWEIGHT[0]                    0<br>
&gt; UJOBWEIGHT[0]                     0<br>
&gt; CONSUMEDWEIGHT[0]                 0<br>
&gt; USAGEEXECUTIONTIMEWEIGHT[0]       0<br>
&gt; REMAININGWEIGHT[0]                0<br>
&gt; PERCENTWEIGHT[0]                  0<br>
&gt; XFMINWCLIMIT[0]                   00:02:00<br>
&gt;<br>
&gt;<br>
&gt; # partition DEFAULT policies<br>
&gt;<br>
&gt; REJECTNEGPRIOJOBS[1]              FALSE<br>
&gt; ENABLENEGJOBPRIORITY[1]           FALSE<br>
&gt; ENABLEMULTINODEJOBS[1]            TRUE<br>
&gt; ENABLEMULTIREQJOBS[1]             FALSE<br>
&gt; BFPRIORITYPOLICY[1]               [NONE]<br>
&gt; JOBPRIOACCRUALPOLICY            QUEUEPOLICY<br>
&gt; NODELOADPOLICY                  ADJUSTSTATE<br>
&gt; JOBNODEMATCHPOLICY[1]<br>
&gt;<br>
&gt; JOBMAXSTARTTIME[1]                  INFINITY<br>
&gt;<br>
&gt; METAMAXTASKS[1]                   0<br>
&gt; NODESETPOLICY[1]                  [NONE]<br>
&gt; NODESETATTRIBUTE[1]               [NONE]<br>
&gt; NODESETLIST[1]<br>
&gt; NODESETDELAY[1]                   00:00:00<br>
&gt; NODESETPRIORITYTYPE[1]            MINLOSS<br>
&gt; NODESETTOLERANCE[1]                 0.00<br>
&gt;<br>
&gt; # Priority Weights<br>
&gt;<br>
&gt; XFMINWCLIMIT[1]                   00:00:00<br>
&gt;<br>
&gt; RMAUTHTYPE[0]                     CHECKSUM<br>
&gt;<br>
&gt; CLASSCFG[[NONE]]  DEFAULT.FEATURES=[NONE]<br>
&gt; CLASSCFG[[ALL]]  DEFAULT.FEATURES=[NONE]<br>
&gt; CLASSCFG[p60]  DEFAULT.FEATURES=[NONE]<br>
&gt; CLASSCFG[long]  DEFAULT.FEATURES=[NONE]<br>
&gt; QOSPRIORITY[0]                    0<br>
&gt; QOSQTWEIGHT[0]                    0<br>
&gt; QOSXFWEIGHT[0]                    0<br>
&gt; QOSTARGETXF[0]                      0.00<br>
&gt; QOSTARGETQT[0]                    00:00:00<br>
&gt; QOSFLAGS[0]<br>
&gt; QOSPRIORITY[1]                    0<br>
&gt; QOSQTWEIGHT[1]                    0<br>
&gt; QOSXFWEIGHT[1]                    0<br>
&gt; QOSTARGETXF[1]                      0.00<br>
&gt; QOSTARGETQT[1]                    00:00:00<br>
&gt; QOSFLAGS[1]<br>
&gt; # SERVER MODULES:  MX<br>
&gt; SERVERMODE                      NORMAL<br>
&gt; SERVERNAME<br>
&gt; SERVERHOST                      krplpadul001<br>
&gt; SERVERPORT                      42559<br>
&gt; LOGFILE                         maui.log<br>
&gt; LOGFILEMAXSIZE                  10000000<br>
&gt; LOGFILEROLLDEPTH                1<br>
&gt; LOGLEVEL                        3<br>
&gt; LOGFACILITY                     fALL<br>
&gt; SERVERHOMEDIR                   /usr/local/maui/<br>
&gt; TOOLSDIR                        /usr/local/maui/tools/<br>
&gt; LOGDIR                          /usr/local/maui/log/<br>
&gt; STATDIR                         /usr/local/maui/stats/<br>
&gt; LOCKFILE                        /usr/local/maui/maui.pid<br>
&gt; SERVERCONFIGFILE                /usr/local/maui/maui.cfg<br>
</div></div>&gt; CHECKPOINTFILE                  /usr/local/maui/<a href="http://maui.ck" target="_blank">maui.ck</a> &lt;<a href="http://maui.ck" target="_blank">http://maui.ck</a>&gt;<br>
<div class="HOEnZb"><div class="h5">&gt; CHECKPOINTINTERVAL              00:05:00<br>
&gt; CHECKPOINTEXPIRATIONTIME        3:11:20:00<br>
&gt; TRAPJOB<br>
&gt; TRAPNODE<br>
&gt; TRAPFUNCTION<br>
&gt; RESDEPTH                        24<br>
&gt;<br>
&gt; RMPOLLINTERVAL                  00:00:30<br>
&gt; NODEACCESSPOLICY                SHARED<br>
&gt; ALLOCLOCALITYPOLICY             [NONE]<br>
&gt; SIMTIMEPOLICY                   [NONE]<br>
&gt; ADMIN1                          root<br>
&gt; ADMINHOSTS                      ALL<br>
&gt; NODEPOLLFREQUENCY               0<br>
&gt; DISPLAYFLAGS<br>
&gt; DEFAULTDOMAIN<br>
&gt; DEFAULTCLASSLIST                [DEFAULT:1]<br>
&gt; FEATURENODETYPEHEADER<br>
&gt; FEATUREPROCSPEEDHEADER<br>
&gt; FEATUREPARTITIONHEADER<br>
&gt; DEFERTIME                       1:00:00<br>
&gt; DEFERCOUNT                      24<br>
&gt; DEFERSTARTCOUNT                 1<br>
&gt; JOBPURGETIME                    0<br>
&gt; NODEPURGETIME                   2140000000<br>
&gt; APIFAILURETHRESHHOLD            6<br>
&gt; NODESYNCTIME                    600<br>
&gt; JOBSYNCTIME                     600<br>
&gt; JOBMAXOVERRUN                   00:10:00<br>
&gt; NODEMAXLOAD                     0.0<br>
&gt;<br>
&gt; PLOTMINTIME                     120<br>
&gt; PLOTMAXTIME                     245760<br>
&gt; PLOTTIMESCALE                   11<br>
&gt; PLOTMINPROC                     1<br>
&gt; PLOTMAXPROC                     512<br>
&gt; PLOTPROCSCALE                   9<br>
&gt; SCHEDCFG[]                        MODE=NORMAL SERVER=krplpadul001:42559<br>
&gt; # RM MODULES: PBS SSS WIKI NATIVE<br>
&gt; RMCFG[KRPLPADUL001] AUTHTYPE=CHECKSUM EPORT=15004 TIMEOUT=00:00:09 TYPE=PBS<br>
&gt; SIMWORKLOADTRACEFILE            workload<br>
&gt; SIMRESOURCETRACEFILE            resource<br>
&gt; SIMAUTOSHUTDOWN                 OFF<br>
&gt; SIMSTARTTIME                    0<br>
&gt; SIMSCALEJOBRUNTIME              FALSE<br>
&gt; SIMFLAGS<br>
&gt; SIMJOBSUBMISSIONPOLICY          CONSTANTJOBDEPTH<br>
&gt; SIMINITIALQUEUEDEPTH            16<br>
&gt; SIMWCACCURACY                   0.00<br>
&gt; SIMWCACCURACYCHANGE             0.00<br>
&gt; SIMNODECOUNT                    0<br>
&gt; SIMNODECONFIGURATION            NORMAL<br>
&gt; SIMWCSCALINGPERCENT             100<br>
&gt; SIMCOMRATE                      0.10<br>
&gt; SIMCOMTYPE                      ROUNDROBIN<br>
&gt; COMINTRAFRAMECOST               0.30<br>
&gt; COMINTERFRAMECOST               0.30<br>
&gt; SIMSTOPITERATION                -1<br>
&gt; SIMEXITITERATION                -1<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; What am i missing here that maui can not schedule jobs?<br>
&gt;<br>
&gt; Sincerely,<br>
&gt; Amjad<br>
&gt;<br>
&gt;<br>
</div></div><div class="HOEnZb"><div class="h5">&gt; _______________________________________________<br>
&gt; torqueusers mailing list<br>
&gt; <a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
&gt; <a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
<br>
_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
</div></div></blockquote></div><br></div>