942982 - (t-w864-ix-077) t-w864-ix-077 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Comment 1

[[e-mail] (:bhearsum)]

Back in production

Comment 2

[Phil Ringnalda (:philor)]

Last six jobs have ended in tears, of the 

20:53:11     INFO - rmtree: C:\slave\test\build
20:53:11     INFO - Using _rmtree_windows ...
20:53:11     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x026D2F30>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #1
20:54:00     INFO - retry: Failed, sleeping 60 seconds before retrying
20:55:00     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x026D2F30>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #2
20:55:52     INFO - retry: Failed, sleeping 120 seconds before retrying
20:57:52     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x026D2F30>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #3
20:58:42     INFO - retry: Failed, sleeping 240 seconds before retrying
21:02:42     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x026D2F30>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #4
21:03:33     INFO - retry: Failed, sleeping 300 seconds before retrying
21:08:33     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x026D2F30>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #5
21:09:22    FATAL - Unable to remove C:\slave\test\build!
21:09:22    FATAL - Caught exception: (1117, 'SetFileAttributesW', 'The request could not be performed because of an I/O device error.')
21:09:22    FATAL - Caught exception: (1117, 'SetFileAttributesW', 'The request could not be performed because of an I/O device error.')
21:09:22    FATAL - Caught exception: (1117, 'SetFileAttributesW', 'The request could not be performed because of an I/O device error.')
21:09:22    FATAL - Caught exception: (1117, 'SetFileAttributesW', 'The request could not be performed because of an I/O device error.')
21:09:22    FATAL - Caught exception: (1117, 'SetFileAttributesW', 'The request could not be performed because of an I/O device error.')

sort. Disabled in slavealloc.

Comment 3

[Phil Ringnalda (:philor)]

Reenabled and rebooted two hours ago, and like the other three Win8 slaves that have been reimaged this week, it still hasn't connected to a master. Lest someone think I'm not giving them enough time, I'll leave it enabled overnight.

Comment 4

[Phil Ringnalda (:philor)]

No joy.

Comment 5

[Phil Ringnalda (:philor)]

Disabled, since it's clearly not going to fix itself.

Comment 6

[Ryan VanderMeulen [:RyanVM]]

Yikes:
https://treeherder.mozilla.org/ui/logviewer.html#?job_id=825213&repo=b2g-inbound

Disabled for reimaging.

Comment 7

[Phil Ringnalda (:philor)]

Reenabled after a reimage, don't be surprised if it winds up with graphics issues now.

Comment 8

[Phil Ringnalda (:philor)]

Disabled again and reopened bug 1098705 for the same failures removing files that it has had since August.

Comment 9

[Phil Ringnalda (:philor)]

Reenabled with a new drive.