[Mauiusers] Changing the maximum number of jobs Maui can handle ?

[Chris Samuel]

-----BEGIN PGP SIGNED MESSAGE-----

Hi folks,

I'm involved in looking after a cluster for some developers who have a habbit 
of submitting a lot of jobs (one user just submitted almost 10,000) and I've 
noticed that Maui (maui-3.2.6p9-snap.1091548659) only seems to keep track of 
the first 3,810.

I've set MAXIJOB to be 20,30 and that works nicely, so I wasn't thinking that 
was a problem until I tried to submit a small interactive job to test 
something and found that it wasn't getting picked up at all.

Looking at the Maui logs I see that Maui reads the queue fine until it fills 
some internal buffer and then discards the rest of the jobs in the queue, 
saying:

08/19 16:45:04 WARNING:  job buffer overflow (cannot add job '69059')
08/19 16:45:04 ERROR:    job buffer is full  (ignoring job '69059.XXXX')

for each job after that.

It's not terminal I guess because as the queue empties it'll pick these jobs 
up, but it is a pain as the usual MAXIJOB trick to stop folks from 
queue-stuffing doesn't work.

Looking at the MAUI source it appears this all comes down to the definitions 
in include/msched.h which say:

#define MAX_MJOB           4096
#define MMAX_JOB           4096

#define MAX_MJOB_TRACE     4096

I presume if I just tag a 0 on the end of these I'll be relatively safe 
(asides from the extra memory usage I guess) ?

What are the chances of making this a run-time configuration option ?  I guess 
it would be something you'd only be able to change at startup, rather than 
whilst the server was running..

All the best, and thanks for the great software..

Chris
- -- 
 Christopher Samuel - (03)9925 4751 - VPAC Systems & Network Admin
 Victorian Partnership for Advanced Computing http://www.vpac.org/
 Bldg 91, 110 Victoria Street, Carlton South, VIC 3053, Australia

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iQEVAwUBQSRStI1yjaOTJg85AQEdiwgAq5bKykh0nHNqQYBAYQEZsSf38NhUBu0F
VTm75ncrjTLvcvZbQzPDoZl3Fhj7uGg7jFOQ9hSvNkF9kE9vTWQuxz3fQoKl7cig
llaJl8WI/aab3JS4w+MGnvohiZejiOCnJI644x3py5wwVv53t3UzA69Scpf6WUR7
/nw02sAEsuUln5mlTpgqy9UKswmv1aZKxqmLRL+jNvItH3Nf7YTNIvtZXtBZuwRZ
g86UTFrGnGk9F+lyeSFINpYpqnEJm6aEB+vklpGnk34T/Wxm9/J45gNt9e2NKSYH
4M1TJ97s+4OfmMGLwGwBV1w9srfZUhO+xNH4nTU2qn+/Z/aXoIT4/A==
=vZsP
-----END PGP SIGNATURE-----