Closed
Bug 912428
Opened 11 years ago
Closed 11 years ago
buildapi/scripts/reporter.py hangs generating builds-4hr.js.gz, resulting in tbpl.m.o not showing completed builds
Categories
(Infrastructure & Operations Graveyard :: CIDuty, task, P1)
Infrastructure & Operations Graveyard
CIDuty
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: emorley, Assigned: nthomas)
References
Details
(Keywords: buildapi)
+++ This bug was initially created as a clone of Bug #905554 +++ Completed builds are not showing up on TBPL, due to builds-4hr.js.gz having last been updated just over an hour ago. See timestamps at: https://secure.pub.build.mozilla.org/builddata/buildjson/ Guessing the redis service needs a kick again, similar to bug 905554. Trees are closed (shortly) as a result.
Reporter | ||
Comment 1•11 years ago
|
||
Note to self: We have until 13:44 UK before we'll need to start manually backfilling job data, since we'll be outside the 4hr window.
Assignee | ||
Updated•11 years ago
|
Assignee: nobody → nthomas
Assignee | ||
Comment 2•11 years ago
|
||
You were right, the redis service needed bouncing. builds-4hr.js.gz is back up to date, and builds-2013-09-04.js.gz will follow in a few mins.
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Reporter | ||
Comment 3•11 years ago
|
||
Thank you - jobs are showing up fine now that the TBPL cron has picked those up too. Will file a bug for nagios alert for builds-4hr.js.gz being out of date (though seem to recall that already being done? maybe we can email sheriffs@ too).
Assignee | ||
Comment 4•11 years ago
|
||
There's one in #buildduty already: Wed 03:04:10 PDT [4342] builddata.pub.build.mozilla.org:http file age - /buildjson/builds-4hr.js.gz is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - Last modified 1:19:40 ago - 1210708 bytes in 0.072 second response time (http://m.allizom.org/http+file+age+-+/buildjson/builds-4hr.js.gz) Wed 03:34:11 PDT [4348] builddata.pub.build.mozilla.org:http file age - /buildjson/builds-4hr.js.gz is OK: HTTP OK: HTTP/1.1 200 OK - 1212185 bytes in 0.069 second response time (http://m.allizom.org/http+file+age+-+/buildjson/builds-4hr.js.gz)
Reporter | ||
Comment 5•11 years ago
|
||
Ah, I just tend not to be in that channel since it's pretty noisy. I've filed bug 912463 for getting sheriffs@ emailed when the alert triggers (presuming that's possible).
Updated•6 years ago
|
Product: Release Engineering → Infrastructure & Operations
Updated•4 years ago
|
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•