[Mauiusers] Changing the maximum number of jobs Maui can handle ?
csamuel at vpac.org
Thu Aug 19 01:11:48 MDT 2004
-----BEGIN PGP SIGNED MESSAGE-----
I'm involved in looking after a cluster for some developers who have a habbit
of submitting a lot of jobs (one user just submitted almost 10,000) and I've
noticed that Maui (maui-3.2.6p9-snap.1091548659) only seems to keep track of
the first 3,810.
I've set MAXIJOB to be 20,30 and that works nicely, so I wasn't thinking that
was a problem until I tried to submit a small interactive job to test
something and found that it wasn't getting picked up at all.
Looking at the Maui logs I see that Maui reads the queue fine until it fills
some internal buffer and then discards the rest of the jobs in the queue,
08/19 16:45:04 WARNING: job buffer overflow (cannot add job '69059')
08/19 16:45:04 ERROR: job buffer is full (ignoring job '69059.XXXX')
for each job after that.
It's not terminal I guess because as the queue empties it'll pick these jobs
up, but it is a pain as the usual MAXIJOB trick to stop folks from
queue-stuffing doesn't work.
Looking at the MAUI source it appears this all comes down to the definitions
in include/msched.h which say:
#define MAX_MJOB 4096
#define MMAX_JOB 4096
#define MAX_MJOB_TRACE 4096
I presume if I just tag a 0 on the end of these I'll be relatively safe
(asides from the extra memory usage I guess) ?
What are the chances of making this a run-time configuration option ? I guess
it would be something you'd only be able to change at startup, rather than
whilst the server was running..
All the best, and thanks for the great software..
Christopher Samuel - (03)9925 4751 - VPAC Systems & Network Admin
Victorian Partnership for Advanced Computing http://www.vpac.org/
Bldg 91, 110 Victoria Street, Carlton South, VIC 3053, Australia
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
-----END PGP SIGNATURE-----
More information about the mauiusers