793648 - (bld-lion-r5-017) bld-lion-r5-017 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Nick Thomas [:nthomas] (UTC+12)]

This try slave has some sort of hardware issue, possibly disk related.

Comment 1

[Chris Cooper [:coop] (he/him)]

This slave was refusing to reboot, wasn't allowing connections, and continued to burn jobs. I rebooted it (eventually) via the PDU.

Comment 2

[Chris AtLee [:catlee]]

This was online, but disabled in slavealloc. I've re-enabled it and rebooted it, and it's reconnected to buildbot.

Comment 3

[Aki Sasaki (not active)]

Died in the middle of a job, during the very first "set basedir" step.

Comment 4

[Phil Ringnalda (:philor)]

Nagios has been nagiosing about "socket timeout after 20 seconds" all day, and it appears to have only managed two jobs before giving up the ghost.

Comment 5

[Kim Moir [:kmoir] ET]

back in production with try keys

Comment 6

[Phil Ringnalda (:philor)]

https://tbpl.mozilla.org/php/getParsedLog.php?id=33991381&tree=Try and the last one before mine that it ran to completion, https://tbpl.mozilla.org/php/getParsedLog.php?id=33924504&tree=Try, both the same otherwise-never-seen failures in some mozinstall make check test, "InstallError: Failed to install "/builds/slave/try-osx64-00000000000000000000/build/testing/mozbase/mozinstall/tests/Installer-Stubs/firefox.dmg""

Disabled in slavealloc.

Comment 7

[[e-mail] (:bhearsum)]

This seems like a new variation of the classic hdiutil failing to mount problem. If I'm right, a reboot fixes this. I re-enabled the machine and rebooted it. I'll watch it until it takes a new job.

Comment 8

[[e-mail] (:bhearsum)]

Still busted, I disabled it again.

Comment 9

[[e-mail] (:bhearsum)]

Back in production. Godspeed, bld-lion-r5-017.

Comment 10

[Release Engineering SlaveAPI Service]

Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1264115)