Closed Bug 1135333 (buildbot-master123) Opened 10 years ago Closed 10 years ago

buildbot-master123 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task)

x86
macOS
task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: nthomas, Unassigned)

Details

Attachments

(1 file)

Nagios started alerting at: Fri 20:34:51 PST [4964] buildbot-master123.bb.releng.usw2.mozilla.com:buildbot is CRITICAL: PROCS CRITICAL: 0 processes with command name buildbot In /var/log/message there is an oomkill of buildbot: Feb 20 20:23:23 buildbot-master123.bb.releng.usw2.mozilla.com kernel: Out of memory: Kill process 954 (buildbot) score 882 or sacrifice child Puppet had been failing to allocate memory since Feb 20 18:51 PST. See attached graph for memory usage, something went haywire at ~ 21:30 on the 16th.
Restarted at 23:14. bm120-123 also have elevated memory usage, possibly others.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: