689038 - reboot requests (sjc1)

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: General, task)

Description

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

nagios is consistently detecting the following errors on bm-xserve17:

Subject: ** PROBLEM alert - bm-xserve17.build.sjc1/buildbot is CRITICAL **
Subject: ** PROBLEM alert - bm-xserve17.build.sjc1/disk - / is CRITICAL **

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

This should be on a reboots bug.  Since the last (bug 686411) is already closed, I'll just re-purpose this one.

bm-xserve17

Comment 2

[Aki Sasaki (not active)]

moz2-darwin9-slave41.build.sjc1

Comment 3

[Amy Rich [:arr] [:arich]]

try-mac-slave02
try-mac-slave34
moz2-darwin9-slave12
moz2-darwin9-slave13
moz2-darwin9-slave52

Comment 4

[Amy Rich [:arr] [:arich]]

try-linux-slave04

Comment 5

[Amy Rich [:arr] [:arich]]

talos-r3-fed-036
talos-r3-fed64-033

Comment 6

[Amy Rich [:arr] [:arich]]

ignore talos-r3-fed-036
talos-r3-fed64-033, put them in the wrong bug.

Comment 7

[Philippe M. Chiasson (:gozer)]

tb2-darwin10-slave71

Comment 8

[Justin Dow [:jabba]]

I rebooted:
bm-xserve17
moz2-darwin9-slave41.build.sjc1
try-mac-slave02
try-mac-slave34
moz2-darwin9-slave12
moz2-darwin9-slave13
moz2-darwin9-slave52

and while there, I noticed that moz2-darwin9-slave03 is dead, just fyi. I also rebooted try-mac-slave33, which was off. This was on accident as it was next to 34 and I was going by the lights. Hope that is cool.

Comment 9

[Dustin J. Mitchell [:dustin] (he/him)]

moz2-darwin9-slave03 is set to be decommissioned in bug 688548.

try-linux-slave04 is a VM, so I'll handle that.

tb2-darwin10-slave71 got it's ram replaced, which counts as a reboot too :)

Comment 10

[Dustin J. Mitchell [:dustin] (he/him)]

try-linux-slave04 rebooted via vmware console.