[Moabusers] GMetric based threshold triggers

[Martins, Flavio]

I am revisiting an issue from several months ago that has not been
resolved. I am trying to set up node based triggers that fire when disk
space starts to run low. I set up a native resource manager in the
moab.cfg file as such:

RMCFG[disk] TYPE=NATIVE
RMCFG[disk] CLUSTERQUERYURL=exec:///opt/moab/tools/disk_check.pl

The script disk_check.pl produces the following output:

MASTER  gmetric[diskuse]=75.1550958223691
n0      gmetric[diskuse]=28.7212163113584
n1      gmetric[diskuse]=55.8703672122378
n2      gmetric[diskuse]=19.9133572888433
n3      gmetric[diskuse]=8.41885580627952
n4      gmetric[diskuse]=31.0858248642784
n5      gmetric[diskuse]=23.7057359554696
n6      gmetric[diskuse]=16.6687679107839

Up to here all seems fine. The output of the checknode command includes
(for n0)

Generic Metrics:  diskuse=28.72

So moab is understanding the output from disk_check.pl.

Now I set up a node based trigger to do some disk clean-up and e-mail
admins when the disk reaches a certain threshold:

NODECFG[n0]
TRIGGER=atype=exec,etype=threshold,threshold=gmetric[diskuse]>85.0,actio
n='/opt/moab/tools/trigtest.pl $TIME $OID 0.85'

The problem is that this trigger fires every time the scheduler is
restated. Shouldn't the trigger only fire if the gmetric property for
that node is > 85.0? Here is the output of mdiag -T -v

TrigID                Object ID               Event  AType
ActionDate       State
--------------------- -------------------- -------- ------
-------------------- -----------
13331*                node:n0              threshol   exec
-  Successful
  Launch Time: -2:13:14:27
  BlockTime:    INFINITY  ActiveTime:  00:00:01
  PID:         12755
  Threshold:   GMetric[diskuse] > 85.00
  Action Data: /opt/moab/tools/trigtest.pl $TIME $OID 0.85
  Output Buffer: /opt/moab/spool/trigtest.pl.oQkmL5n
  Error Buffer: /opt/moab/spool/trigtest.pl.elsYxLK
  Variables=

I'm running Moab 5.1.0p3 and TORQUE 2.1.9

Thanks in advance for any help.

Flavio Martins
Senior Engineer - Aerodynamics / CFD
Florida Turbine Technologies Inc.
1701 Military Trail, Suite 110
Jupiter, FL 33458-7101
-----------------------------------------------------
Phone: (561) 427-6261
Fax: (561) 427-6191