1098707 - please run hardware diagnostics on t-w732-ix-161 and reimage

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Phil Ringnalda (:philor)]

It was burning jobs with I/O errors, got diagnostics that didn't find anything in bug 1091661, and continues burning jobs with the exact same I/O errors.

Comment 1

[Salvador Espinoza [:sal]]

running memtest

Comment 2

[Van Le [:van]]

do you have the log of IO errors? it'll help if we open a case with iX for either a drive or controller replacement.

Comment 3

[Phil Ringnalda (:philor)]

There are links to and copy-pastes from the test logs in bug 1091658, but iX isn't likely to think of

08:34:01 FATAL - Unable to remove C:\slave\test\build!
08:34:01 FATAL - Caught exception: (1117, 'FindNextFile', 'The request could not be performed because of an I/O device error.')

as very helpful logs. For OS-level logs, I think I'd have to ask Van ;)

Comment 4

[Salvador Espinoza [:sal]]

passed memtest, running hard disk diagnostics. If host passes both diags and keeps burning jobs after the reimage we can open a case with iX

Comment 5

[Salvador Espinoza [:sal]]

host passed diagnostics, reimaging

Comment 6

[Salvador Espinoza [:sal]]

host is up, let us know if it keeps burning jobs.

sals-MacBook-Pro-3:~ sal$ sudo fping  10.26.19.160
10.26.19.160 is alive
sals-MacBook-Pro-3:~ sal$ sudo fping  10.26.40.135
10.26.40.135 is alive
sals-MacBook-Pro-3:~ sal$ ssh !$
ssh 10.26.40.135
The authenticity of host '10.26.40.135 (10.26.40.135)' can't be established.
RSA key fingerprint is e1:6a:3c:92:52:3b:97:bc:bf:01:87:e1:f0:58:e6:6a.
Are you sure you want to continue connecting (yes/no)?