Closed Bug 1155686 Opened 10 years ago Closed 10 years ago

alert that watch pending is successful

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Platform:
x86
macOS
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: kmoir, Unassigned)

Details

Fallout from bug 1133833 - the change in https://github.com/mozilla/build-cloud-tools/commit/52a5ae6919677f624d9f2a4504eeb00fdc498233 made the JSON unparsable, and aws_watch_pending.py bailed out very early each time it ran. We need some sort of alert when it's not running, as it was down for ~10 hours. The errors were in syslog on aws-manager2 so papertrail would be one option, or a nagios file freshness check on the log.
Noticed last week that there is a nagios alert for when watch pending that is patch and alerts when the log is not being updated and thus points to a problem with the json. Can't find the other bug tho
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Component: Tools → General
You need to log in before you can comment on or make changes to this bug.