Bug 940092 (t-xp32-ix-092)

t-xp32-ix-092 problem tracking

RESOLVED FIXED

Status

Infrastructure & Operations
CIDuty
P3
normal
RESOLVED FIXED
5 years ago
a month ago

People

(Reporter: philor, Unassigned)

Tracking

Details

(Whiteboard: [buildduty][buildslaves][capacity])

(Reporter)

Description

5 years ago
Has something stuck in its craw that it can't rm, e.g.

https://tbpl.mozilla.org/php/getParsedLog.php?id=30726201&tree=Mozilla-Aurora

15:17:25     INFO - rmtree: C:\slave\test\build
15:17:25     INFO - Using _rmtree_windows ...
15:17:25     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x01071690>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #1
15:17:25     INFO - retry: Failed, sleeping 60 seconds before retrying
15:18:24     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x01071690>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #2
15:18:24     INFO - retry: Failed, sleeping 120 seconds before retrying
15:20:24     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x01071690>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #3
15:20:24     INFO - retry: Failed, sleeping 240 seconds before retrying
15:24:23     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x01071690>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #4
15:24:23     INFO - retry: Failed, sleeping 300 seconds before retrying
15:29:23     INFO - retry: Calling <bound method DesktopUnittest._rmtree_windows of <__main__.DesktopUnittest object at 0x01071690>> with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #5
15:29:23    FATAL - Unable to remove C:\slave\test\build!
15:29:23    FATAL - Caught exception: (5, 'SetFileAttributesW', 'Access is denied.')
15:29:23    FATAL - Caught exception: (5, 'SetFileAttributesW', 'Access is denied.')
15:29:23    FATAL - Caught exception: (5, 'SetFileAttributesW', 'Access is denied.')
15:29:23    FATAL - Caught exception: (5, 'SetFileAttributesW', 'Access is denied.')
15:29:23    FATAL - Caught exception: (5, 'SetFileAttributesW', 'Access is denied.')
15:29:23    FATAL - Running post_fatal callback...
15:29:23    FATAL - Exiting -1


Disabled in slavealloc.

Comment 1

5 years ago
I've rebooted this slave and it's currently running chkdsk on boot.

Comment 2

5 years ago
Back in production. Jobs are running green.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
(Reporter)

Comment 3

5 years ago
Those were good times; now it's https://tbpl.mozilla.org/php/getParsedLog.php?id=31019596&tree=Mozilla-Inbound, "Caught exception: (1392, 'FindFirstFile', 'The file or directory is corrupted and unreadable.')"

Disabled in slavealloc.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

Updated

5 years ago
Depends on: 944447

Comment 4

5 years ago
Re-image requested.

Comment 5

5 years ago
Rebooted into production.
Status: REOPENED → RESOLVED
Last Resolved: 5 years ago5 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1167580)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Reporter)

Updated

3 years ago
Status: REOPENED → RESOLVED
Last Resolved: 5 years ago3 years ago
No longer depends on: 1167580
Resolution: --- → FIXED

Updated

a month ago
Product: Release Engineering → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.