Closed Bug 1100028 Opened 10 years ago Closed 10 years ago

t-xp32-ix-137 is unreachable

Categories

(Infrastructure & Operations :: DCOps, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: slaveapi, Unassigned)

References

Details

      No description provided.
Note bug 1096640 comment 2 - prior to that, slaveapi failed at ssh rebooting this slave, and failed at IPMI rebooting it. Following that, just like its partner in crime t-xp32-ix-140, this slave didn't even get an attempt at an IPMI reboot, just failed ssh.
colo-trip: --- → scl3
found host online. pulled blade then IPMI and host becomes unreachable, so that means that the right IPs are being picked up by the right blade. host is currently reimaging. 

i know the default password for the IPMI on these nodes get changed. can we confirm that it's been changed on this host after the reimage?
host finished reimaging and is back online.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
I cannot login to this host via the web interface to IPMI, i.e. http://t-xp32-ix-137-mgmt.build.mozilla.org

The same password works on other host, e.g. http://t-xp32-ix-136-mgmt.build.mozilla.org
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
:coop/:philor, i recall :arr once replied to one of the bugs (cant find bug now) that releng has a script that changes the IPMI password. since the IPMI password isn't changed through the BIOS, is this something you or your team can run or point us to it?
found script, but im unsure how to use as it asks for imports.

https://hg.mozilla.org/build/braindump/file/tip/ipmi-related/setup_oob.py
(In reply to Van Le [:van] from comment #6)
> found script, but im unsure how to use as it asks for imports.
> 
> https://hg.mozilla.org/build/braindump/file/tip/ipmi-related/setup_oob.py

:dustin already had the script setup on an admin node, so he got this slave working again.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.