765655 - need to reset 3 MTV1 PDUs

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: General, task)

Description

[Mike Taylor [:bear]]

While doing the recover from the MTV1 network downtime, 3 of the PDUs for tegras did not "come back"

Can someone please reset them so we can do Tegra powercycles.

pdu3.df202-1.build.mtv1.mozilla.com
pdu2.df201-4.build.mtv1.mozilla.com
pdu1.df201-4.build.mtv1.mozilla.com

Comment 1

[Ravi Pina [:ravi]]

How do you reset these?

Comment 2

[Mike Taylor [:bear]]

there is some fancy IPMI interface, but right now since we need to power cycle the tegras, I would say just power cycle the whole thing

Comment 3

[Ravi Pina [:ravi]]

Reloaded:

pdu2.df201-4.build.mtv1.mozilla.com
pdu1.df201-4.build.mtv1.mozilla.com

Can't find pdu3.df202-1.build.mtv1.mozilla.com.  There are 6 in haxxor and none of them are labled.

Comment 4

[Mike Taylor [:bear]]

pdu3.df202-1.build.mtv1.mozilla.com is somehow up.

Comment 5

[Amy Rich [:arr] [:arich]]

FYI, all of the addressable PDUs in haxxor *are* labeled and in inventory both.  Perhaps you could not see the labels because they were covered in wall wart cables.

Comment 6

[Ravi Pina [:ravi]]

Yeah, it was more of identifying which PDU it was in the respective location.  We should look to getting some better more prominent labeling.