1476787 - [MDC1] T-W1064-MS-110 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

The worker is missing from taskcluster.
It's slow and encountering errors when booting into BIOS.

Comment 1

[Adrian Pop]

rebooted and re-imaged the machine ( as it wasn't visible on Task Cluster ). Currently it is available and it took jobs

Comment 2

[Roland Mutter Michael (:rmutter)]

Closing for now, seems like it is working.

Comment 3

[Zsolt Fay [:zfay]]

Attachment: w10-110.PNG

This machine was missing and got re-imaged today. Although re-image was successful and jobs are being taken, i believe we might still have a problem. Machine is a little slower than the other ones and has some errors. See attached pic for more info.

@Markco do you think this could grow into a bigger issue?

Comment 4

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

Attachment: system_health

Comment 5

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

It had task running, so I quarantined it and waited for the job to finish, entered into the machine, rebooted it and pressed F2 for seeing more information, and I got what can be seen in the screenshot attached above.
Continued booting sequence and I took it out of quarantine.

Comment 6

[Attila Craciun [:arny]]

No jobs for one day, rebooted and now is running tasks. Logs before reboot:

Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:20 Response#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:20 HTTP/1.1 200 OK#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Content-Length: 0#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Date: Tue, 07 Aug 2018 06:05:21 GMT#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Etag: "33bf4ca86cba2034199ddf8bc634776d"#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Server: AmazonS3#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: X-Amz-Id-2: lvmTqbnfZSN1o7C7y58EZBTGeB466nWCb9jhQ4gRw4DD9OzvwY8Vm+/xpoaode+EB0+0zOhQZOM=#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: X-Amz-Request-Id: 98232DFC0CFD7373#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: X-Amz-Version-Id: yygC.KWo5nsS1J0NC8i16OuX54EY8ySi#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: #015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:20 Resolving task...#015
Aug 06 23:05:21 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:20 Command finished successfully!#015
Aug 06 23:05:22 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:21 No previous task user desktop, so no need to close any open desktops#015
Aug 06 23:05:22 T-W1064-MS-110.mdc1.mozilla.com generic-worker: 2018/08/07 06:05:21 Trying to remove directory 'C:\Users\task_1533618465' via os.RemoveAll(path) call as GenericWorker user...#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Graphic Card being used "Intel(R) Iris(R) Pro Graphics P580  " #015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Removing temp dir contents #015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Deleted file - C:\Users\GenericWorker\AppData\Local\Temp\aria-debug-5664.log#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: C:\Users\GenericWorker\AppData\Local\Temp\aria-debug-5968.log#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Deleted file - C:\Users\GenericWorker\AppData\Local\Temp\wctD920.tmp#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Deleted file - C:\Users\GenericWorker\AppData\Local\Temp\wctDA2A.tmp#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Deleted file - C:\Users\GenericWorker\AppData\Local\Temp\livelog675364951\stream#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Deleted file - C:\ProgramData\Package Cache\{B74E65FD-CC47-41C5-4B89-791A3F61942D}v8.100.25984\Installers\Kits Configuration Installer-x86_en-us.msi#015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Removing log files older than 1 day #015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Removing Windows log files older than 7 days #015
Aug 06 23:05:26 T-W1064-MS-110.mdc1.mozilla.com generic-worker: Removing Recycle.bin contents  #015
Aug 06 23:05:27 T-W1064-MS-110.mdc1.mozilla.com User32: The process C:\windows\system32\shutdown.exe (T-W1064-MS-110) has initiated the restart of computer T-W1064-MS-110 on behalf of user T-W1064-MS-110\GenericWorker for the following reason: No title for this reason could be found   Reason Code: 0x800000ff   Shutdown Type: restart   Comment: Rebooting as generic worker ran successfully#015
Aug 06 23:05:31 T-W1064-MS-110.mdc1.mozilla.com Service_Control_Manager: The sshd service terminated unexpectedly.  It has done this 1 time(s).#015