927921 - (t-xp32-ix-008) t-xp32-ix-008 problem tracking

Status: RESOLVED WONTFIX

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Armen [:armenzg]]

Loaned in bug 921240.

Comment 1

[Armen [:armenzg]]

Ready to be re-imaged and put back into the pool.

Comment 2

[[e-mail] (:bhearsum)]

Back in production after a re-image.

Comment 3

[Ryan VanderMeulen [:RyanVM]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=33773190&tree=Mozilla-Aurora

17:06:39     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x00E04870>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #5
17:06:39    FATAL - Unable to remove C:\slave\test\build!
17:06:39    FATAL - Caught exception: (1392, 'SetFileAttributesW', 'The file or directory is corrupted and unreadable.')
17:06:39    FATAL - Caught exception: (1392, 'SetFileAttributesW', 'The file or directory is corrupted and unreadable.')
17:06:39    FATAL - Caught exception: (1392, 'SetFileAttributesW', 'The file or directory is corrupted and unreadable.')
17:06:39    FATAL - Caught exception: (1392, 'SetFileAttributesW', 'The file or directory is corrupted and unreadable.')
17:06:39    FATAL - Caught exception: (1392, 'SetFileAttributesW', 'The file or directory is corrupted and unreadable.')
17:06:39    FATAL - Running post_fatal callback...
17:06:39    FATAL - Exiting -1

Comment 4

[[e-mail] (:bhearsum)]

Back in production after a reimage.

Comment 5

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

This slave got the same failure that reopened bug 938872 earlier today.

Comment 6

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

(In reply to Wes Kocher (:KWierso) from comment #5)
> This slave got the same failure that reopened bug 938872 earlier today.

https://tbpl.mozilla.org/php/getParsedLog.php?id=34886735&tree=Mozilla-Inbound

Comment 7

[[e-mail] (:bhearsum)]

Reimaged again, maybe that will help?

Comment 8

[[e-mail] (:bhearsum)]

Nope, still broken.

Comment 9

[Jordan Lund (:jlund)]

back in production, leaving dep bug 975104 open until first job completes.

Comment 10

[Phil Ringnalda (:philor)]

First one completed, but the second failed, and the third mentions the problem in a reftest where the test image consists of the text "Error: color depth is only 16."

Disabled in slavealloc.

Comment 11

[Phil Ringnalda (:philor)]

But I'm sure this time, things will be different.

Comment 12

[Release Engineering SlaveAPI Service]

Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1035841)

Comment 13

[Release Engineering SlaveAPI Service]

Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1071097)

Comment 14

[Release Engineering SlaveAPI Service]

Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1114685)

Comment 15

[Phil Ringnalda (:philor)]

Looks like this slave came back, after the chkdsk coop said he was watching run, but the disk is still busted and in need of diagnostics (or, better yet, blind replacement).

Disabled in slavealloc.

Comment 16

[Phil Ringnalda (:philor)]

(In reply to Phil Ringnalda (:philor) from comment #11)
> But I'm sure this time, things will be different.

Reenabled.

Comment 17

[Phil Ringnalda (:philor)]

Lasted until last night, when it disconnected in the middle of two jobs and then stopped taking any more, until I rebooted it this morning when it took two jobs and disconnected in the middle of both and then stopped taking any more. Disabled.

Comment 18

[Phil Ringnalda (:philor)]

Reenabled with a new disk.

Comment 19

[Phil Ringnalda (:philor)]

Unable to remove C:\slave\test\build!

Comment 20

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Back online after re-image,will keep monitoring.

Comment 21

[Ryan VanderMeulen [:RyanVM]]

Unable to remove C:\slave\test\build!