Closed Bug 1470507 Opened 7 years ago Closed 5 years ago

Windows 10 GenericWorker 10 nodes go unresponsive at shutdown

Categories

(Infrastructure & Operations :: RelOps: OpenCloudConfig, task)

Product:
Infrastructure & Operations
Component:
RelOps: OpenCloudConfig
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1573864

People

(Reporter: markco, Assigned: markco)

References

Details

These nodes will stop communicating with papertrail, are unpingable, and unable to connect to through VNC. ILo shows the machine is on, so most likely this is hanging on shutdown. Thought that is only an assumption at this point. Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call LogonUserW with args: [C042017860 C04226D6B0 C0423BD300 2 0 C04226D6B8]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 1 0 The operation completed successfully.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call LoadUserProfileW with args: [684 C042026140]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 1 0 The operation completed successfully.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call SHSetKnownFolderPath with args: [D4C880 0 684 C042063B60]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 0 0 The system could not find the environment option that was entered.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call SHGetKnownFolderPath with args: [D4C880 8000 684 C04226D7E8]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 0 0 Cannot create a file when that file already exists.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call CoTaskMemFree with args: [1716F0]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 1 0 The operation completed successfully.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call SHSetKnownFolderPath with args: [D4C870 0 684 C042298B90]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 0 0 The system could not find the environment option that was entered.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call SHGetKnownFolderPath with args: [D4C870 8000 684 C04226D868]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 0 0 Cannot create a file when that file already exists.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Making system call CoTaskMemFree with args: [1717B0]#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Result: 1 0 The operation completed successfully.#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Exiting worker so it can reboot...#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Saving file file-caches.json (absolute path: C:\generic-worker\file-caches.json)#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Saving file directory-caches.json (absolute path: C:\generic-worker\directory-caches.json)#015 Jun 21 19:23:30 T-W1064-MS-107.mdc1.mozilla.com generic-worker: 2018/06/22 02:23:29 Exiting worker with exit code 67#015 Jun 21 19:23:32 T-W1064-MS-107.mdc1.mozilla.com User32: The process C:\windows\system32\shutdown.exe (T-W1064-MS-107) has initiated the restart of computer T-W1064-MS-107 on behalf of user NT AUTHORITY\SYSTEM for the following reason: No title for this reason could be found Reason Code: 0x800000ff Shutdown Type: restart Comment: Rebooting as generic worker ran successfully#015 Jun 21 19:23:35 T-W1064-MS-107.mdc1.mozilla.com Service_Control_Manager: The sshd service terminated unexpectedly. It has done this 1 time(s).#015 Nodes that exhibited this behavior ms-020 ms-024 ms-032 ms-039 ms-072 ms-107
Assignee: nobody → mcornmesser

I suspect this is related to the long time between tasks. Marking this bug a s duplicate.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.