<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div><br></div><div>qrun circumvents whatever policies you put in place with Maui so it will ignore things like queue to host mappings in Maui, reservations, etc</div><div><br>Sent from my iPhone</div><div><br>On Nov 26, 2013, at 4:32 PM, Ricardo Román Brenes &lt;<a href="mailto:roman.ricardo@gmail.com">roman.ricardo@gmail.com</a>&gt; wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr">thanks to everyone for your input!<div><br></div><div>@Gus:</div><div>Im runnning maui 3.3.1 and torque server 2.5.7 on the server and torque client 2.2.1 on the compute node.</div><div><br></div><div>scheduling is enabled</div>

<div><br></div><div>@Sree:</div><div>thanks, ive been forcing it jsut for test!</div><div><br></div><div>@aaron:</div><div>i was thinking on reconfiguring but there are users logged on right now :O</div></div><div class="gmail_extra">

<br><br><div class="gmail_quote">On Tue, Nov 26, 2013 at 3:15 PM, Aaron Cordero <span dir="ltr">&lt;<a href="mailto:cordero.aaron@gene.com" target="_blank">cordero.aaron@gene.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir="ltr">Just verified what I posted on my Torque 4.2.6 cluster and it worked as expected (echo sleep 60 |&nbsp;<span style="font-family:arial,sans-serif;font-size:13px">qsub -q batch -l&nbsp;</span><span style="font-family:arial,sans-serif;font-size:13px">nodes=node1:ppn=2)</span>.<div>


<br></div><div>Is the server_priv/nodes file correct? &nbsp;</div><div><br></div><div>Also, I have noticed that sometimes the torque database gets corrupted. &nbsp;Its an easy fix.</div><div><br></div><div>Do a: &nbsp;echo p s @default | qmgr &gt; /tmp/config.out</div>


<div>Shutdown the server.</div><div>Issue pbs_server -t create</div><div>type y to overwrite</div><div><br></div><div>then do: &nbsp;cat /tmp/config.out | qmgr</div><div><br></div><div>type qterm</div><div><br></div><div>then restart pbs_server</div>


<div><br></div><div>If you dont want to spend a bunch of time troubleshooting-sometimes uninstalling, deleting the torque home dir (/var/spool/torque) and reinstalling is quicker (on everything server/sched/moms). &nbsp;</div>


<div><br></div><div>But what you are seeing is definitely not normal. &nbsp;Just the fact that submitting a job to a particular node does not work is suspicious.</div><span class="HOEnZb"><font color="#888888"><div><br></div>

<div>ac</div><div><br></div><div><br></div></font></span></div><div class="HOEnZb"><div class="h5">
<div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Nov 26, 2013 at 12:47 PM, Ricardo Román Brenes <span dir="ltr">&lt;<a href="mailto:roman.ricardo@gmail.com" target="_blank">roman.ricardo@gmail.com</a>&gt;</span> wrote:<br>


<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">ive tried with -l nodes=NODENAME<br>and still not working&nbsp;<div><br></div><div>but i can live with torque not sending the jobs to the specified nodes, but sending them to OTHER nodes? thats just not right&nbsp;</div>




</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Nov 26, 2013 at 2:27 PM, Aaron Cordero <span dir="ltr">&lt;<a href="mailto:cordero.aaron@gene.com" target="_blank">cordero.aaron@gene.com</a>&gt;</span> wrote:<br>




<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Try-<div><br></div><div>qsub -q ps3 -l&nbsp;<span style="font-family:arial,sans-serif;font-size:13px">nodes=&lt;nodename&gt;:ppn=2</span></div>




<div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote"><div><div>On Tue, Nov 26, 2013 at 12:15 PM, Ricardo Román Brenes <span dir="ltr">&lt;<a href="mailto:roman.ricardo@gmail.com" target="_blank">roman.ricardo@gmail.com</a>&gt;</span> wrote:<br>





</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hello everyone.<div><br></div><div>I got a server running torque and a lot of nodes. Im trying to make ONE of those nodes run something.</div>





<div><br></div><div>im issuing</div><div><br></div><div>[rroman@meta ~]$ qsub -I -q ps3 -l nodes=1:ppn=2<br>

</div>
<div><br></div><div>and the job never runs.</div><div><br></div><div>i tried to force-run it with qrun but oddly... it started the interactive job in a node that does not belong to that queue...<br></div><div><br></div><div>







<div>[rroman@meta ~]$ qsub -I -q ps3 -l nodes=1:ppn=2</div><div>qsub: waiting for job 1038.meta.cnca to start</div><div>qsub: job 1038.meta.cnca ready</div><div><br></div><div>[rroman@cadejos-0 ~]$ qstat -f 1038</div><div>







Job Id: 1038.meta.cnca</div><div>&nbsp; &nbsp; Job_Name = STDIN</div><div>&nbsp; &nbsp; Job_Owner = <a href="mailto:rroman@meta.cnca">rroman@meta.cnca</a></div><div>&nbsp; &nbsp; job_state = R</div><div>&nbsp; &nbsp; queue = ps3</div><div>&nbsp; &nbsp; server = meta.cnca</div><div>&nbsp; &nbsp; Checkpoint = u</div><div>







&nbsp; &nbsp; ctime = Tue Nov 26 20:27:26 2013</div><div>&nbsp; &nbsp; Error_Path = /dev/pts/0</div><div>&nbsp; &nbsp; exec_host = cadejos-0.cnca/1+cadejos-0.cnca/0</div><div>&nbsp; &nbsp; Hold_Types = n</div><div>&nbsp; &nbsp; interactive = True</div><div>&nbsp; &nbsp; Join_Path = n</div>







<div>&nbsp; &nbsp; Keep_Files = n</div><div>&nbsp; &nbsp; Mail_Points = a</div><div>&nbsp; &nbsp; mtime = Tue Nov 26 20:38:17 2013</div><div>&nbsp; &nbsp; Output_Path = /dev/pts/0</div><div>&nbsp; &nbsp; Priority = 0</div><div>&nbsp; &nbsp; qtime = Tue Nov 26 20:27:26 2013</div><div>







&nbsp; &nbsp; Rerunable = False</div><div>&nbsp; &nbsp; Resource_List.nodect = 1</div><div>&nbsp; &nbsp; Resource_List.nodes = 1:ppn=2</div><div>&nbsp; &nbsp; Resource_List.walltime = 01:00:00</div><div>&nbsp; &nbsp; session_id = 1668</div><div>&nbsp; &nbsp; Variable_List = PBS_O_QUEUE=ps3,PBS_O_HOME=/home/rroman,</div>







<div><span style="white-space:pre-wrap">        </span>PBS_O_LANG=en_US.UTF-8,PBS_O_LOGNAME=rroman,</div><div><span style="white-space:pre-wrap">        </span>PBS_O_PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/lo</div>







<div><span style="white-space:pre-wrap">        </span>cal/sbin:/usr/sbin:/sbin:/home/rroman/bin,</div><div><span style="white-space:pre-wrap">        </span>PBS_O_MAIL=/var/spool/mail/rroman,PBS_O_SHELL=/bin/bash,</div><div><span style="white-space:pre-wrap">        </span>PBS_O_HOST=meta.cnca,PBS_SERVER=meta.cnca,PBS_O_WORKDIR=/home/rroman,</div>







<div><span style="white-space:pre-wrap">        </span>HOSTNAME=meta.cnca,TERM=xterm,SHELL=/bin/bash,HISTSIZE=1000,</div><div><span style="white-space:pre-wrap">        </span>SSH_CLIENT=10.4.255.9 59203 22,QTDIR=/usr/lib64/qt-3.3,</div>







<div><span style="white-space:pre-wrap">        </span>QTINC=/usr/lib64/qt-3.3/include,SSH_TTY=/dev/pts/1,USER=rroman,</div><div><span style="white-space:pre-wrap">        </span>LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=</div>







<div><span style="white-space:pre-wrap">        </span>40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=3</div><div><span style="white-space:pre-wrap">        </span>0;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj</div>







<div><span style="white-space:pre-wrap">        </span>=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.</div><div><span style="white-space:pre-wrap">        </span>zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01</div>







<div><span style="white-space:pre-wrap">        </span>;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.bz=01;31:*.tz=01;31:*.deb=0</div><div><span style="white-space:pre-wrap">        </span>1;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpi</div>







<div><span style="white-space:pre-wrap">        </span>o=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.b</div><div><span style="white-space:pre-wrap">        </span>mp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*</div>







<div><span style="white-space:pre-wrap">        </span>.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;</div><div><span style="white-space:pre-wrap">        </span>35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=</div>







<div><span style="white-space:pre-wrap">        </span>01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.v</div><div><span style="white-space:pre-wrap">        </span>ob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.r</div>







<div><span style="white-space:pre-wrap">        </span>mvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*</div><div><span style="white-space:pre-wrap">        </span>.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:</div>







<div><span style="white-space:pre-wrap">        </span>*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36</div><div><span style="white-space:pre-wrap">        </span>:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=0</div>







<div><span style="white-space:pre-wrap">        </span>1;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=</div><div><span style="white-space:pre-wrap">        </span>01;36:*.xspf=01;36:,MAIL=/var/spool/mail/rroman,</div>







<div><span style="white-space:pre-wrap">        </span>PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sb</div><div><span style="white-space:pre-wrap">        </span>in:/usr/sbin:/sbin:/home/rroman/bin,PWD=/home/rroman,LANG=en_US.UTF-8,</div>







<div><span style="white-space:pre-wrap">        </span>SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass,</div><div><span style="white-space:pre-wrap">        </span>HISTCONTROL=ignoredups,SHLVL=1,HOME=/home/rroman,LOGNAME=rroman,</div>







<div><span style="white-space:pre-wrap">        </span>QTLIB=/usr/lib64/qt-3.3/lib,CVS_RSH=ssh,</div><div><span style="white-space:pre-wrap">        </span>SSH_CONNECTION=10.4.255.9 59203 192.168.0.2 22,</div><div><span style="white-space:pre-wrap">        </span>LESSOPEN=|/usr/bin/lesspipe.sh %s,DISPLAY=localhost:11.0,</div>







<div><span style="white-space:pre-wrap">        </span>G_BROKEN_FILENAMES=1,_=/usr/bin/qsub</div><div>&nbsp; &nbsp; etime = Tue Nov 26 20:27:26 2013</div><div>&nbsp; &nbsp; submit_args = -V -I -q ps3 -l nodes=1:ppn=2</div><div>&nbsp; &nbsp; start_time = Tue Nov 26 20:38:17 2013</div>







<div>&nbsp; &nbsp; Walltime.Remaining = 3585</div><div>&nbsp; &nbsp; start_count = 1</div><div>&nbsp; &nbsp; fault_tolerant = False</div><div>&nbsp; &nbsp; submit_host = meta.cnca</div><div>&nbsp; &nbsp; init_work_dir = /home/rroman</div><div><br></div><div>[rroman@cadejos-0 ~]$&nbsp;</div>







</div><div><br></div><div><br></div><div>my nodes file:</div><div><div>[root@meta server_priv]# cat nodes</div><div>cadejos-0.cnca <span style="white-space:pre-wrap">        </span>np=8 <span style="white-space:pre-wrap">        </span>tesla xeon</div>







<div>cadejos-1.cnca <span style="white-space:pre-wrap">        </span>np=8 <span style="white-space:pre-wrap">        </span>tesla xeon</div><div>cadejos-2.cnca <span style="white-space:pre-wrap">        </span>np=8<span style="white-space:pre-wrap">        </span>tesla xeon</div>







<div>cadejos-3.cnca <span style="white-space:pre-wrap">        </span>np=8 <span style="white-space:pre-wrap">        </span>xeon</div><div>cadejos-4.cnca <span style="white-space:pre-wrap">        </span>np=8 <span style="white-space:pre-wrap">        </span>xeon</div>







<div>zarate-0.cnca<span style="white-space:pre-wrap">        </span>np=2<span style="white-space:pre-wrap">        </span>ps3</div><div>zarate-1.cnca<span style="white-space:pre-wrap">        </span>np=2<span style="white-space:pre-wrap">        </span>ps3</div>







<div>zarate-2.cnca<span style="white-space:pre-wrap">        </span>np=2<span style="white-space:pre-wrap">        </span>ps3</div><div>zarate-3.cnca<span style="white-space:pre-wrap">        </span>np=2<span style="white-space:pre-wrap">        </span>ps3</div>







</div><div><br></div><div><br></div></div>
<br></div></div>_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org" target="_blank">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org" target="_blank">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org" target="_blank">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
<br></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
torqueusers mailing list<br>
<a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a><br>
<a href="http://www.supercluster.org/mailman/listinfo/torqueusers" target="_blank">http://www.supercluster.org/mailman/listinfo/torqueusers</a><br>
<br></blockquote></div><br></div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>torqueusers mailing list</span><br><span><a href="mailto:torqueusers@supercluster.org">torqueusers@supercluster.org</a></span><br><span><a href="http://www.supercluster.org/mailman/listinfo/torqueusers">http://www.supercluster.org/mailman/listinfo/torqueusers</a></span><br></div></blockquote></body></html>