Closed Bug 1321308 (t-w864-ix-323) Opened 8 years ago Closed 7 years ago

t-w864-ix-323 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Product:
Infrastructure & Operations Graveyard
Component:
CIDuty
Platform:
x86_64
Windows 8
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: philor, Unassigned)

References

Details

(Whiteboard: [buildduty][buildslaves][capacity]) 

"Unable to remove C:\slave\test\build!"

Disabled.
Green jobs after been re-imaged.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
"Unable to remove C:\slave\test\build!"

Disabled.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1334703)
Back online after been re-imaged.
Status: REOPENED → RESOLVED
Closed: 8 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1337650)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back online and taking jobs.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Stuck in a "Unable to remove C:\slave\test\build!" loop.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back in production after been re-imaged.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1338746)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back after a reimage.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1341181)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back online and taking jobs after has been reimaged by DCOps team
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1342807)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back in the pool after re-imaged.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
"Unable to remove C:\slave\test\build!"

Disabled.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Re-imaged and returned to the pool. Mostly green jobs after that.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1352976)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back online and taking jobs after been re-imaged by DCops.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1355601)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Returned to the pool after reimaged by DCOps.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Disabled, needs a reimage, it has some file stuck in its craw, maybe just tp5n.zip and maybe more than one, so it fails the talos jobs it tries to do which require it like https://treeherder.mozilla.org/logviewer.html#?job_id=98599979&repo=autoland&lineNumber=562
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attempting SSH reboot...Failed.
Attempting IPMI reboot...Failed.
Filed IT bug for reboot (bug 1364299)
Back online
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Still exactly the same

20:28:11     INFO -  INFO - File tp5n.zip fetched from https://api.pub.build.mozilla.org/tooltool/ as C:\slave\test\build\tests\talos\talos\tests\tmptsl5i0
20:28:12     INFO -  INFO - File integrity verified, renaming tmptsl5i0 to tp5n.zip
20:28:12    ERROR -  Traceback (most recent call last):
20:28:12     INFO -    File "C:/mozilla-build/tooltool.py", line 1016, in <module>
20:28:12     INFO -      sys.exit(main(sys.argv))
20:28:12     INFO -    File "C:/mozilla-build/tooltool.py", line 1013, in main
20:28:12     INFO -      return 0 if process_command(options, args) else 1
20:28:12     INFO -    File "C:/mozilla-build/tooltool.py", line 923, in process_command
20:28:12     INFO -      region=options.get('region'))
20:28:12     INFO -    File "C:/mozilla-build/tooltool.py", line 657, in fetch_files
20:28:12     INFO -      os.path.join(os.getcwd(), localfile.filename))
20:28:12     INFO -  WindowsError: [Error 183] Cannot create a file when that file already exists

failures. Redisabled.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Re-imaged and returned to production, monitored for 2 days,no sign of error:
https://secure.pub.build.mozilla.org/buildapi/recent/t-w864-ix-323?numbuilds=100

If will fail again I will disable it.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
And again.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Different kind of error,re-imaged and puted back online.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
"Unable to remove C:\slave\test\build!", disabled.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Back online after picked up RMA, replaced drive, and reimaged by DCOps.
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → FIXED
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.