933797 - (b-2008-ix-0144) b-2008-ix-0144 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Armen [:armenzg]]

It can't come back!

Armens-MacBook-Air ~ $ curl http://slaveapi-dev1.srv.releng.scl3.mozilla.com:8080/slave/w64-ix-slave130/action/reboot;
{
  "reboots": {
    "58207376": {
      "state": 3, 
      "text": "Attempting SSH reboot...Failed.\nAttempting IPMI reboot...Failed.\nCan't do anything else, human intervention needed."
    }
  }

Comment 1

[Armen [:armenzg]]

IT managed to get it back up and it got re-imaged as a rev2.

Comment 2

[Phil Ringnalda (:philor)]

https://tbpl.mozilla.org/php/getParsedLog.php?id=30491738&tree=UX where it's timing out, um, uploading? or maybe just getting ready to? is the one I've got handy, but the fact that it's doing one or two builds a day, and has failed every single thing for the last 16 jobs, makes me think it isn't actually well yet.

Disabled in slavealloc.

Comment 3

[[e-mail] (:bhearsum)]

This slave didn't have ssh keys on it. I fixed that and re-enabled it.

Comment 4

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Lots of failures like https://treeherder.mozilla.org/logviewer.html#?job_id=1464759&repo=b2g-inbound that persisted after I rebooted the slave.

Disabled in slavealloc.

Comment 5

[Chris Cooper [:coop] (he/him)]

Re-imaged and returned to production.