1230979 - t-w864-ix-092 is unreachable

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Comment 1

[Vinh Hua [:vinh]]

host back online

[[e-mail]3 ~]$ ssh t-w864-ix-092.wintest.releng.scl3.mozilla.com
The authenticity of host 't-w864-ix-092.wintest.releng.scl3.mozilla.com (10.26.40.122)' can't be established.
RSA key fingerprint is aa:7f:de:37:4d:cb:30:e1:38:a2:46:c4:59:75:81:4b.
Are you sure you want to continue connecting (yes/no)?

Comment 2

[Van Le [:van]]

Vinh can you configure ipmi password. I think that's why we keep getting this bug.

Comment 3

[Vinh Hua [:vinh]]

IPMI did not have our default user/pw.  I've added them.

Comment 4

[Phil Ringnalda (:philor)]

Well, that's part of it. The other part is that it's broken and needs to go back. It lasted for a job and a half, died, I tried a reboot, and after only an attempt at ssh, still no ipmi, bug 1232565.

Comment 5

[Vinh Hua [:vinh]]

I've submit a ticket for iX to take a look.  ticket #IPZ-937-83236

Comment 6

[Vinh Hua [:vinh]]

iX ran their diagnostics and did not find any issues.  I've swapped out the CAT5 cable and reimaged the host with a spare 1TB drive (no spare 500gb drives atm).  Can you see if you can still replicate the issue?

Comment 7

[Phil Ringnalda (:philor)]

It has made it through five jobs, which is quite impressive by its standard.

Comment 8

[Amy Rich [:arr] [:arich]]

this is still under warranty, so if it's a faulty drive, please get another one of the same size from ix. We don't want to mix the drive types in the test pool.

Comment 9

[Vinh Hua [:vinh]]

hard disk RMA ticket #HIB-557-23691

Comment 10

[Van Le [:van]]

picked up hdd from iX and swapped/reimaged. host  back online.

Comment 12

[Phil Ringnalda (:philor)]

Guess who's "unreachable" again :\

Comment 13

[Van Le [:van]]

:arr, i have the foopie blades which are the same specs sans the memory which i can upgrade. can we replace this blade for one of those as this host should be out OOW by now and is a reoccurring problem.

Comment 14

[Amy Rich [:arr] [:arich]]

the foopys were a different CPU, so no, they weren't the same specs.

Comment 15

[Van Le [:van]]

when i removed the blade, i noticed the memory wasn't seated correctly. running a full round of diags and we'll test again. if it still fails, we can swap the CPU and memory over to one of the foopy blades.

Comment 16

[Amy Rich [:arr] [:arich]]

Howdy, it's been a week, and we're really strapped for capacity. What were the results here?

Comment 17

[Van Le [:van]]

Ive been in Phoenix for a conference. Can poke when I get back.

Comment 18

[Van Le [:van]]

memtest ran the week i was gone and it completed 93 passes with no issues. also ran a full disk diags and it came back with no errors. can you give it another whirl?