<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div><div class="h5">
Fernando Caba wrote:<br>
&gt; Hi Gus, here are the results of all commands you mention:<br>
&gt;<br>
&gt; [root@fe ~]# qmgr -c &#39;p s&#39;<br>
&gt; #<br>
&gt; # Create queues and set their attributes.<br>
&gt; #<br>
&gt; #<br>
&gt; # Create and define queue batch<br>
&gt; #<br>
&gt; create queue batch<br>
&gt; set queue batch queue_type = Execution<br>
&gt; set queue batch resources_default.nodes = 1<br>
&gt; set queue batch resources_default.walltime = 2400:00:00<br>
&gt; set queue batch enabled = True<br>
&gt; set queue batch started = True<br>
&gt; #<br>
&gt; # Set server attributes.<br>
&gt; #<br>
&gt; set server scheduling = True<br>
&gt; set server acl_hosts = fe<br>
&gt; set server managers = root@fe<br>
&gt; set server operators = root@fe<br>
&gt; set server default_queue = batch<br>
&gt; set server log_events = 511<br>
&gt; set server mail_from = adm<br>
&gt; set server scheduler_iteration = 600<br>
&gt; set server node_check_rate = 150<br>
&gt; set server tcp_timeout = 6<br>
&gt; set server mom_job_sync = True<br>
&gt; set server keep_completed = 300<br>
&gt; set server auto_node_np = True<br>
&gt; set server next_job_number = 182<br>
&gt; set server record_job_info = True<br>
&gt; [root@fe ~]#<br>
&gt;<br>
&gt;<br>
&gt; ${TORQUE}/bin/pbsnodes<br>
&gt;<br>
&gt; [root@fe ~]# pbsnodes<br>
&gt; n10<br>
&gt;       state = free<br>
&gt;       np = 12<br>
&gt;       ntype = cluster<br>
&gt;       jobs = 0/121.fe<br>
&gt;       status =<br>
&gt; rectime=1317298640,varattr=,jobs=121.fe,state=free,netload=261129374581,gres=,loadave=4.00,ncpus=12,physmem=16360208kb,availmem=62484756kb,totmem=83471736kb,idletime=63369,nusers=2,nsessions=2,sessions=4394<br>
&gt; 8087,uname=Linux n10 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010<br>
&gt; x86_64,opsys=linux<br>
&gt;       mom_service_port = 15002<br>
&gt;       mom_manager_port = 15003<br>
&gt;       gpus = 0<br>
&gt;<br>
&gt; n11<br>
&gt;       state = free<br>
&gt;       np = 12<br>
&gt;       ntype = cluster<br>
&gt;       jobs = 0/143.fe<br>
&gt;       status =<br>
&gt; rectime=1317298637,varattr=,jobs=143.fe,state=free,netload=12864227236,gres=,loadave=8.00,ncpus=12,physmem=16360208kb,availmem=78708424kb,totmem=83469060kb,idletime=1354314,nusers=2,nsessions=2,sessions=4583<br>
&gt; 20253,uname=Linux n11 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010<br>
&gt; x86_64,opsys=linux<br>
&gt;       mom_service_port = 15002<br>
&gt;       mom_manager_port = 15003<br>
&gt;       gpus = 0<br>
&gt;<br>
&gt; n12<br>
&gt;       state = free<br>
&gt;       np = 12<br>
&gt;       ntype = cluster<br>
&gt;       jobs = 0/144.fe<br>
&gt;       status =<br>
&gt; rectime=1317298647,varattr=,jobs=144.fe,state=free,netload=953102292987,gres=,loadave=8.01,ncpus=12,physmem=16360208kb,availmem=78740696kb,totmem=83469060kb,idletime=1168354,nusers=2,nsessions=2,sessions=4635<br>
&gt; 20289,uname=Linux n12 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010<br>
&gt; x86_64,opsys=linux<br>
&gt;       mom_service_port = 15002<br>
&gt;       mom_manager_port = 15003<br>
&gt;       gpus = 0<br>
&gt;<br>
&gt; n13<br>
&gt;       state = free<br>
&gt;       np = 12<br>
&gt;       ntype = cluster<br>
&gt;       jobs = 0/181.fe<br>
&gt;       status =<br>
&gt; rectime=1317298672,varattr=,jobs=181.fe,state=free,netload=1010169147229,gres=,loadave=4.00,ncpus=12,physmem=15955108kb,availmem=81150100kb,totmem=83066636kb,idletime=138726,nusers=2,nsessions=2,sessions=4407<br>
&gt; 29186,uname=Linux n13 2.6.18-194.el5xen #1 SMP Fri Apr 2 15:34:40 EDT<br>
&gt; 2010 x86_64,opsys=linux<br>
&gt;       mom_service_port = 15002<br>
&gt;       mom_manager_port = 15003<br>
&gt;       gpus = 0<br>
&gt;<br>
&gt; [root@fe ~]#<br>
&gt;<br>
&gt; ${MAUI}/bin/showconfig<br>
&gt;<br>
&gt; [root@fe ~]# which showconfig<br>
&gt; /usr/local/maui/bin/showconfig<br>
&gt; [root@fe ~]# showconfig<br>
&gt; # Maui version 3.3.1 (PID: 18407)<br>
&gt; # global policies<br>
&gt;<br>
&gt; REJECTNEGPRIOJOBS[0]              FALSE<br>
&gt; ENABLENEGJOBPRIORITY[0]           FALSE<br>
&gt; ENABLEMULTINODEJOBS[0]            TRUE<br>
&gt; ENABLEMULTIREQJOBS[0]             FALSE<br>
&gt; BFPRIORITYPOLICY[0]               [NONE]<br>
&gt; JOBPRIOACCRUALPOLICY            QUEUEPOLICY<br>
&gt; NODELOADPOLICY                  ADJUSTSTATE<br>
&gt; USEMACHINESPEEDFORFS            FALSE<br>
&gt; USEMACHINESPEED                 FALSE<br>
&gt; USESYSTEMQUEUETIME              TRUE<br>
&gt; USELOCALMACHINEPRIORITY         FALSE<br>
&gt; NODEUNTRACKEDLOADFACTOR         1.2<br>
&gt; JOBNODEMATCHPOLICY[0]             EXACTNODE<br>
&gt;<br>
&gt; JOBMAXSTARTTIME[0]                  INFINITY<br>
&gt;<br>
&gt; METAMAXTASKS[0]                   0<br>
&gt; NODESETPOLICY[0]                  [NONE]<br>
&gt; NODESETATTRIBUTE[0]               [NONE]<br>
&gt; NODESETLIST[0]<br>
&gt; NODESETDELAY[0]                   00:00:00<br>
&gt; NODESETPRIORITYTYPE[0]            MINLOSS<br>
&gt; NODESETTOLERANCE[0]                 0.00<br>
&gt;<br>
&gt; BACKFILLPOLICY[0]                 FIRSTFIT<br>
&gt; BACKFILLDEPTH[0]                  0<br>
&gt; BACKFILLPROCFACTOR[0]             0<br>
&gt; BACKFILLMAXSCHEDULES[0]           10000<br>
&gt; BACKFILLMETRIC[0]                 PROCS<br>
&gt;<br>
&gt; BFCHUNKDURATION[0]                00:00:00<br>
&gt; BFCHUNKSIZE[0]                    0<br>
&gt; PREEMPTPOLICY[0]                  REQUEUE<br>
&gt; MINADMINSTIME[0]                  00:00:00<br>
&gt; RESOURCELIMITPOLICY[0]<br>
&gt; NODEAVAILABILITYPOLICY[0]         COMBINED:[DEFAULT]<br>
&gt; NODEALLOCATIONPOLICY[0]           MINRESOURCE<br>
&gt; TASKDISTRIBUTIONPOLICY[0]         DEFAULT<br>
&gt; RESERVATIONPOLICY[0]              CURRENTHIGHEST<br>
&gt; RESERVATIONRETRYTIME[0]           00:00:00<br>
&gt; RESERVATIONTHRESHOLDTYPE[0]       NONE<br>
&gt; RESERVATIONTHRESHOLDVALUE[0]      0<br>
&gt;<br>
&gt; FSPOLICY                        [NONE]<br>
&gt; FSPOLICY                        [NONE]<br>
&gt; FSINTERVAL                      12:00:00<br>
&gt; FSDEPTH                         8<br>
&gt; FSDECAY                         1.00<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; # Priority Weights<br>
&gt;<br>
&gt; SERVICEWEIGHT[0]                  1<br>
&gt; TARGETWEIGHT[0]                   1<br>
&gt; CREDWEIGHT[0]                     1<br>
&gt; ATTRWEIGHT[0]                     1<br>
&gt; FSWEIGHT[0]                       1<br>
&gt; RESWEIGHT[0]                      1<br>
&gt; USAGEWEIGHT[0]                    1<br>
&gt; QUEUETIMEWEIGHT[0]                1<br>
&gt; XFACTORWEIGHT[0]                  0<br>
&gt; SPVIOLATIONWEIGHT[0]              0<br>
&gt; BYPASSWEIGHT[0]                   0<br>
&gt; TARGETQUEUETIMEWEIGHT[0]          0<br>
&gt; TARGETXFACTORWEIGHT[0]            0<br>
&gt; USERWEIGHT[0]                     0<br>
&gt; GROUPWEIGHT[0]                    0<br>
&gt; ACCOUNTWEIGHT[0]                  0<br>
&gt; QOSWEIGHT[0]                      0<br>
&gt; CLASSWEIGHT[0]                    0<br>
&gt; FSUSERWEIGHT[0]                   0<br>
&gt; FSGROUPWEIGHT[0]                  0<br>
&gt; FSACCOUNTWEIGHT[0]                0<br>
&gt; FSQOSWEIGHT[0]                    0<br>
&gt; FSCLASSWEIGHT[0]                  0<br>
&gt; ATTRATTRWEIGHT[0]                 0<br>
&gt; ATTRSTATEWEIGHT[0]                0<br>
&gt; NODEWEIGHT[0]                     0<br>
&gt; PROCWEIGHT[0]                     0<br>
&gt; MEMWEIGHT[0]                      0<br>
&gt; SWAPWEIGHT[0]                     0<br>
&gt; DISKWEIGHT[0]                     0<br>
&gt; PSWEIGHT[0]                       0<br>
&gt; PEWEIGHT[0]                       0<br>
&gt; WALLTIMEWEIGHT[0]                 0<br>
&gt; UPROCWEIGHT[0]                    0<br>
&gt; UJOBWEIGHT[0]                     0<br>
&gt; CONSUMEDWEIGHT[0]                 0<br>
&gt; USAGEEXECUTIONTIMEWEIGHT[0]       0<br>
&gt; REMAININGWEIGHT[0]                0<br>
&gt; PERCENTWEIGHT[0]                  0<br>
&gt; XFMINWCLIMIT[0]                   00:02:00<br>
&gt;<br>
&gt;<br>
&gt; # partition DEFAULT policies<br>
&gt;<br>
&gt; REJECTNEGPRIOJOBS[1]              FALSE<br>
&gt; ENABLENEGJOBPRIORITY[1]           FALSE<br>
&gt; ENABLEMULTINODEJOBS[1]            TRUE<br>
&gt; ENABLEMULTIREQJOBS[1]             FALSE<br>
&gt; BFPRIORITYPOLICY[1]               [NONE]<br>
&gt; JOBPRIOACCRUALPOLICY            QUEUEPOLICY<br>
&gt; NODELOADPOLICY                  ADJUSTSTATE<br>
&gt; JOBNODEMATCHPOLICY[1]<br>
&gt;<br>
&gt; JOBMAXSTARTTIME[1]                  INFINITY<br>
&gt;<br>
&gt; METAMAXTASKS[1]                   0<br>
&gt; NODESETPOLICY[1]                  [NONE]<br>
&gt; NODESETATTRIBUTE[1]               [NONE]<br>
&gt; NODESETLIST[1]<br>
&gt; NODESETDELAY[1]                   00:00:00<br>
&gt; NODESETPRIORITYTYPE[1]            MINLOSS<br>
&gt; NODESETTOLERANCE[1]                 0.00<br>
&gt;<br>
&gt; # Priority Weights<br>
&gt;<br>
&gt; XFMINWCLIMIT[1]                   00:00:00<br>
&gt;<br>
&gt; RMAUTHTYPE[0]                     CHECKSUM<br>
&gt;<br>
&gt; CLASSCFG[[NONE]]  DEFAULT.FEATURES=[NONE]<br>
&gt; CLASSCFG[[ALL]]  DEFAULT.FEATURES=[NONE]<br>
&gt; CLASSCFG[batch]  DEFAULT.FEATURES=[NONE]<br>
&gt; QOSPRIORITY[0]                    0<br>
&gt; QOSQTWEIGHT[0]                    0<br>
&gt; QOSXFWEIGHT[0]                    0<br>
&gt; QOSTARGETXF[0]                      0.00<br>
&gt; QOSTARGETQT[0]                    00:00:00<br>
&gt; QOSFLAGS[0]<br>
&gt; QOSPRIORITY[1]                    0<br>
&gt; QOSQTWEIGHT[1]                    0<br>
&gt; QOSXFWEIGHT[1]                    0<br>
&gt; QOSTARGETXF[1]                      0.00<br>
&gt; QOSTARGETQT[1]                    00:00:00<br>
&gt; QOSFLAGS[1]<br>
&gt; # SERVER MODULES:  MX<br>
&gt; SERVERMODE                      NORMAL<br>
&gt; SERVERNAME<br>
&gt; SERVERHOST                      fe<br>
&gt; SERVERPORT                      42559<br>
&gt; LOGFILE                         maui.log<br>
&gt; LOGFILEMAXSIZE                  10000000<br>
&gt; LOGFILEROLLDEPTH                1<br>
&gt; LOGLEVEL                        3<br>
&gt; LOGFACILITY                     fALL<br>
&gt; SERVERHOMEDIR                   /usr/local/maui/<br>
&gt; TOOLSDIR                        /usr/local/maui/tools/<br>
&gt; LOGDIR                          /usr/local/maui/log/<br>
&gt; STATDIR                         /usr/local/maui/stats/<br>
&gt; LOCKFILE                        /usr/local/maui/maui.pid<br>
&gt; SERVERCONFIGFILE                /usr/local/maui/maui.cfg<br>
&gt; CHECKPOINTFILE                  /usr/local/maui/<a href="http://maui.ck" target="_blank">maui.ck</a><br>
&gt; CHECKPOINTINTERVAL              00:05:00<br>
&gt; CHECKPOINTEXPIRATIONTIME        3:11:20:00<br>
&gt; TRAPJOB<br>
&gt; TRAPNODE<br>
&gt; TRAPFUNCTION<br>
&gt; RESDEPTH                        24<br>
&gt;<br>
&gt; RMPOLLINTERVAL                  00:00:30<br>
&gt; NODEACCESSPOLICY                SHARED<br>
&gt; ALLOCLOCALITYPOLICY             [NONE]<br>
&gt; SIMTIMEPOLICY                   [NONE]<br>
&gt; ADMIN1                          root<br>
&gt; ADMINHOSTS                      ALL<br>
&gt; NODEPOLLFREQUENCY               0<br>
&gt; DISPLAYFLAGS<br>
&gt; DEFAULTDOMAIN<br>
&gt; DEFAULTCLASSLIST                [DEFAULT:1]<br>
&gt; FEATURENODETYPEHEADER<br>
&gt; FEATUREPROCSPEEDHEADER<br>
&gt; FEATUREPARTITIONHEADER<br>
&gt; DEFERTIME                       1:00:00<br>
&gt; DEFERCOUNT                      24<br>
&gt; DEFERSTARTCOUNT                 1<br>
&gt; JOBPURGETIME                    0<br>
&gt; NODEPURGETIME                   2140000000<br>
&gt; APIFAILURETHRESHHOLD            6<br>
&gt; NODESYNCTIME                    600<br>
&gt; JOBSYNCTIME                     600<br>
&gt; JOBMAXOVERRUN                   00:10:00<br>
&gt; NODEMAXLOAD                     0.0<br>
&gt;<br>
&gt; PLOTMINTIME                     120<br>
&gt; PLOTMAXTIME                     245760<br>
&gt; PLOTTIMESCALE                   11<br>
&gt; PLOTMINPROC                     1<br>
&gt; PLOTMAXPROC                     512<br>
&gt; PLOTPROCSCALE                   9<br>
&gt; SCHEDCFG[]                        MODE=NORMAL SERVER=fe:42559<br>
&gt; # RM MODULES: PBS SSS WIKI NATIVE<br>
&gt; RMCFG[FE] AUTHTYPE=CHECKSUM EPORT=15004 TIMEOUT=00:00:09 TYPE=PBS<br>
&gt; SIMWORKLOADTRACEFILE            workload<br>
&gt; SIMRESOURCETRACEFILE            resource<br>
&gt; SIMAUTOSHUTDOWN                 OFF<br>
&gt; SIMSTARTTIME                    0<br>
&gt; SIMSCALEJOBRUNTIME              FALSE<br>
&gt; SIMFLAGS<br>
&gt; SIMJOBSUBMISSIONPOLICY          CONSTANTJOBDEPTH<br>
&gt; SIMINITIALQUEUEDEPTH            16<br>
&gt; SIMWCACCURACY                   0.00<br>
&gt; SIMWCACCURACYCHANGE             0.00<br>
&gt; SIMNODECOUNT                    0<br>
&gt; SIMNODECONFIGURATION            NORMAL<br>
&gt; SIMWCSCALINGPERCENT             100<br>
&gt; SIMCOMRATE                      0.10<br>
&gt; SIMCOMTYPE                      ROUNDROBIN<br>
&gt; COMINTRAFRAMECOST               0.30<br>
&gt; COMINTERFRAMECOST               0.30<br>
&gt; SIMSTOPITERATION                -1<br>
&gt; SIMEXITITERATION                -1<br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; [root@fe ~]# ps -ef |grep  maui<br>
&gt; root     18407     1  0 Sep28 ?        00:00:04 /usr/local/maui/sbin/maui<br>
&gt; root     22527 22463  0 09:19 pts/2    00:00:00 grep maui<br>
&gt; [root@fe ~]# service maui status<br>
&gt; maui (pid 18407) is running...<br>
&gt; [root@fe ~]# service pbs_server status<br>
&gt; pbs_server (pid 4147) is running...<br>
&gt; [root@fe ~]#<br>
&gt;<br>
&gt; service pbs_sched status [just in case it is also running ...]<br>
&gt; service pbs_mom status<br>
&gt; service pbs status<br>
&gt;<br>
&gt; none of those 3 services are installed<br>
&gt;<br>
&gt; Thank you very much<br>
&gt;<br></div></div></blockquote><div><br>When you shoot a -lnodes=1:ppn=12 against a node, what&#39;s the output of pbsnodes for that node?<br>
<br>
Does it show that 12 cores are in use?<br>
<br>
When you issue a qstat -f, does it show that your job is really using 12 cores?<br>
<br>
<br>
<br> </div><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div><div class="h5">
&gt; ----------------------------------------------------<br>
&gt; Ing. Fernando Caba<br>
&gt; Director General de Telecomunicaciones<br>
&gt; Universidad Nacional del Sur<br>
&gt; <a href="http://www.dgt.uns.edu.ar" target="_blank">http://www.dgt.uns.edu.ar</a><br>
&gt; Tel/Fax: (54)-291-4595166<br>
&gt; Tel: (54)-291-4595101 int. 2050<br>
&gt; Avda. Alem 1253, (B8000CPB) Bahía Blanca - Argentina<br>
&gt; ----------------------------------------------------<br>
&gt;<br clear="all"></div></div></blockquote></div><br>cheers,<br>-- <br>Denis Anjos,<br><a href="http://www.versatushpc.com.br">www.versatushpc.com.br</a><br>