Closed Bug 1493862 Opened 7 years ago Closed 7 years ago

mac-v2-signing13.srv.releng.mdc2.mozilla.com has a full disk but nagios didn't report it

Categories

(Infrastructure & Operations :: RelOps: Puppet, task)

Product:
Infrastructure & Operations
Component:
RelOps: Puppet
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: nthomas, Unassigned)

Details

When investigating slow mac signing I found the disk on mac-v2-signing13 was nearly full. Missing nagios check I thought, but no it exists https://nagios1.private.releng.mdc2.mozilla.com/releng-mdc2/cgi-bin/status.cgi?navbarsearch=1&host=mac-v2-signing13.srv.releng.mdc2 but the failure hasn't been reported on IRC. The disk check has been in that state for 4 days, no sign of an IRC alert in that time. Please investigate the nagios config. Is the contact_group of build misconfigured for mdc1/mdc2 ?
Turns out the host has a super long downtime set on it from when it was moved to the DC. I've removed that, and also reviewed the other hosts in mdc1 + mdc2 for similar problems.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.