Closed Bug 1489112 (T-W1064-MS-031) Opened 7 years ago Closed 6 years ago

[MDC1] T-W1064-MS-031 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: arny, Unassigned)

References

Details

No jobs for one day, rebooted and now is running tasks.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Depends on: 1493087
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
Looks like this is only on 31. Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com generic-worker: *********** PANIC occurred! *********** #015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com generic-worker: strconv.Atoi: parsing "\x00\x00\x00": invalid syntax#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com generic-worker: Exiting worker with exit code 69#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: generic-worker running process detected 278 ms after task-claim-state.valid flag set.#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: process priority for generic worker altered from Normal to AboveNormal.#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: begin - 2018-11-23T15:57:53.7343587Z#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: wuauserv service state: Stopped.#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: end - 2018-11-23T15:57:53.7353615Z#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: userdata run completed#015 Nov 23 07:57:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: end - 2018-11-23T15:57:53.7363640Z#015 Nov 23 07:58:03 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Generic worker exit with code 69 more than once; Rebooting to recover #015 Nov 23 07:58:03 T-W1064-MS-031.mdc1.mozilla.com generic-worker: The system cannot find the file specified. #015 Nov 23 07:58:03 T-W1064-MS-031.mdc1.mozilla.com generic-worker: #015 Nov 23 07:58:04 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Local multi-user session manager received system shutdown message#015 Nov 23 07:58:04 T-W1064-MS-031.mdc1.mozilla.com User32: The process C:\windows\system32\shutdown.exe (T-W1064-MS-031) has initiated the restart of computer T-W1064-MS-031 on behalf of user NT AUTHORITY\SYSTEM for the following reason: No title for this reason could be found Reason Code: 0x800000ff Shutdown Type: restart Comment: Generic worker has not recovered; Rebooting#015 Nov 23 07:58:07 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Remote Desktop Services: Session logoff succeeded: User: T-W1064-MS-031\task_1542936488 Session ID: 1#015 Nov 23 07:58:07 T-W1064-MS-031.mdc1.mozilla.com OpenSSH: sshd: Received signal 8; terminating.#015 Nov 23 07:58:07 T-W1064-MS-031.mdc1.mozilla.com Service_Control_Manager: The sshd service terminated unexpectedly. It has done this 1 time(s).#015 Nov 23 07:58:12 T-W1064-MS-031.mdc1.mozilla.com nxlog: WARNING received a system shutdown request#015 Nov 23 07:58:12 T-W1064-MS-031.mdc1.mozilla.com nxlog: WARNING stopping nxlog service#015 Nov 23 07:58:12 T-W1064-MS-031.mdc1.mozilla.com nxlog: WARNING nxlog-ce received a termination request signal, exiting...#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com generic-worker: 1 file(s) copied. #015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com generic-worker: #015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com generic-worker: 1 file(s) copied. #015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com generic-worker: #015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com nxlog: INFO nxlog-ce-2.9.1716 started#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com nxlog: INFO input file 'C:/generic-worker/generic-worker-wrapper.log' was truncated, restarting from the beginning#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com nxlog: INFO reconnecting in 1 seconds#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Plugin RDSAppXPlugin has been successfully initialized#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-WinRM: The WinRM service is not listening for WS-Management requests. User Action If you did not intentionally stop the service, use the following command to see the WinRM configuration: winrm enumerate winrm/config/listener#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com mlx4_bus: Mellanox ConnectX-3 PRO VPI (MT04103) Network Adapter (PCI bus 14, device 0, function 0): SR-IOV cannot be enabled because FW does not support SR-IOV. In order to resolve this issue please re-burn FW, having added parameters related to SR-IOV support.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Service_Control_Manager: The CldFlt service failed to start due to the following error: The request is not supported.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com nxlog: ERROR apr_sockaddr_info failed for log-aggregator.srv.releng.mdc1.mozilla.com:514; No such host is known. #015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com OpenSSH: sshd: Server listening on :: port 22.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com OpenSSH: sshd: Server listening on 0.0.0.0 port 22.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Begin session arbitration: User: T-W1064-MS-031\task_1542936488 Session ID: 1#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: End session arbitration: User: T-W1064-MS-031\task_1542936488 Session ID: 1#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Remote Desktop Services: Session logon succeeded: User: T-W1064-MS-031\task_1542936488 Session ID: 1 Source Network Address: LOCAL#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-TerminalServic: Remote Desktop Services: Shell start notification received: User: T-W1064-MS-031\task_1542936488 Session ID: 1 Source Network Address: LOCAL#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-Time-Service: NtpClient was unable to set a manual peer to use as a time source because of DNS resolution error on 'infoblox1.private.mdc1.mozilla.com,0x8'. NtpClient will try again in 15 minutes and double the reattempt interval thereafter. The error was: No such host is known. (0x80072AF9)#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com Service_Control_Manager: The cphs service terminated with the following error: No more data is available.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com mlx4_bus: Port type registry value for device Native_14_0_0 could not be modified to value (PortType = none,auto). Previous value will be set.#015 Nov 23 07:59:18 T-W1064-MS-031.mdc1.mozilla.com mlx4_bus: Native_14_0_0: EXT_QP_MAX_RETRY_LIMIT/EXT_QP_MAX_RETRY_PERIOD registry keys were requested by user but FW does not support this feature. Please upgrade your firmware to support it. For more details, please refer to WinOF User Manual.#015 Nov 23 07:59:19 T-W1064-MS-031.mdc1.mozilla.com nxlog: INFO connecting to log-aggregator.srv.releng.mdc1.mozilla.com:514#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: begin - 2018-11-23T15:59:21.5449241Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: Run-MaintainSystem :: begin - 2018-11-23T15:59:21.5449241Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: begin - 2018-11-23T15:59:21.7011908Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: CLRVersion: 4.0.30319.42000, PSVersion: 5.1.15063.0#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: Remove-OldTaskDirectories :: begin - 2018-11-23T15:59:21.7011908Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: SecurityProtocol: Tls, Tls11, Tls12#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: Detected TLS v1.2 in security protocol support list#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: 2 task directories detected matching pattern: C:\Users\task_*#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: Detected registry setting to use strong cryptography on 64 bit .Net Framework#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: Detected registry setting to use strong cryptography on 32 bit .Net Framework#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: SecurityProtocol: Tls, Tls11, Tls12#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-DefaultStrongCryptography :: end - 2018-11-23T15:59:21.7949507Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkRoutes :: begin - 2018-11-23T15:59:21.8105776Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkRoutes :: skipping network route correction (not configured for OS: Microsoft Windows 10 Enterprise).#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkRoutes :: end - 2018-11-23T15:59:21.8730840Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: begin - 2018-11-23T15:59:21.8730840Z#015 Nov 23 07:59:22 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: wuauserv service state: Stopped.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: wuauserv service state: Running.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: end - 2018-11-23T15:59:22.3827965Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: hw-DiskManage :: begin - 2018-11-23T15:59:22.6404924Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: hw-DiskManage :: path: C:\windows\SoftwareDistribution\Download\*, deleted.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Current free space of drive C 35948 MB#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Current free space percentage of drive C 57%#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: hw-DiskManage :: end - 2018-11-23T15:59:23.0385407Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: userdata run starting.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: begin - 2018-11-23T15:59:23.0495709Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: begin - 2018-11-23T15:59:23.0515759Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: w32time service state: Running.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: w32time service state: Stopped.#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: end - 2018-11-23T15:59:23.3062531Z#015 Nov 23 07:59:23 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: w32time service status: Stopped#015 Nov 23 07:59:24 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: system timezone set to UTC.#015 Nov 23 07:59:24 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DNS-Client: The system failed to register host (A or AAAA) resource records (RRs) for network adapter with settings: Adapter Name : {B7F9FB5F-769A-48E9-8140-390F9DDA1FE6} Host Name : T-W1064-MS-031 Primary Domain Suffix : mdc1.mozilla.com DNS server list : #01110.48.75.120, 10.50.75.120 Sent update to server : <?> IP Address(es) : 10.49.40.17 The reason the system could not register these RRs during the update request was because of a system problem. You can manually retry DNS registration of the network adapter and its settings by typing 'ipconfig /registerdns' at the command prompt. If problems still persist, contact your DNS server or network systems administrator. See event details for specific error code information.#015 Nov 23 07:59:24 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DNS-Client: The system failed to register host (A or AAAA) resource records (RRs) for network adapter with settings: Adapter Name : {B7F9FB5F-769A-48E9-8140-390F9DDA1FE6} Host Name : T-W1064-MS-031 Primary Domain Suffix : mdc1.mozilla.com DNS server list : #01110.48.75.120, 10.50.75.120 Sent update to server : <?> IP Address(es) : 10.49.40.17 The reason the system could not register these RRs during the update request was because of a system problem. You can manually retry DNS registration of the network adapter and its settings by typing 'ipconfig /registerdns' at the command prompt. If problems still persist, contact your DNS server or network systems administrator. See event details for specific error code information.#015 Nov 23 07:59:24 T-W1064-MS-031.mdc1.mozilla.com mlx4eth63: Mellanox ConnectX-3 Pro Ethernet Adapter #2 device detected that the link connected to port 2 is down. This can occur if the physical link is disconnected or damaged, or if the other end-port is down.#015 Nov 23 07:59:25 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: time service unregistered.#015 Nov 23 07:59:26 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:26 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: time service registered.#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: time service configured with peerlist: infoblox1.private.mdc1.mozilla.com#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: begin - 2018-11-23T15:59:26.4977450Z#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: w32time service state: Stopped.#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: w32time service state: Running.#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: end - 2018-11-23T15:59:26.7985446Z#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: w32time service status: Running#015 Nov 23 07:59:27 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DNS-Client: The system failed to register host (A or AAAA) resource records (RRs) for network adapter with settings: Adapter Name : {B7F9FB5F-769A-48E9-8140-390F9DDA1FE6} Host Name : T-W1064-MS-031 Primary Domain Suffix : mdc1.mozilla.com DNS server list : #01110.48.75.120, 10.50.75.120 Sent update to server : <?> IP Address(es) : 10.49.40.17 The reason the system could not register these RRs during the update request was because of a system problem. You can manually retry DNS registration of the network adapter and its settings by typing 'ipconfig /registerdns' at the command prompt. If problems still persist, contact your DNS server or network systems administrator. See event details for specific error code information.#015 Nov 23 07:59:31 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:31 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: time service resynchronised.#015 Nov 23 07:59:31 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-SystemClock :: end - 2018-11-23T15:59:30.8292644Z#015 Nov 23 07:59:36 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:36 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: isWorker: True.#015 Nov 23 07:59:36 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: workerType: gecko-t-win10-64-hw.#015 Nov 23 07:59:36 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-OpenCloudConfig :: runDscOnWorker: True.#015 Nov 23 07:59:36 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: begin - 2018-11-23T15:59:35.4976550Z#015 Nov 23 07:59:42 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:43 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: scheduled task: MaintainSystem deleted.#015 Nov 23 07:59:43 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: C:\dsc\MaintainSystem.ps1 deleted.#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: C:\dsc\MaintainSystem.ps1 downloaded from https://raw.githubusercontent.com/mozilla-releng/OpenCloudConfig/master/userdata/MaintainSystem.ps1?ecbac9c4-e8b8-4a38-b7bb-80874f5f9c71.#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: scheduled task: MaintainSystem created.#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Create-ScheduledPowershellTask :: end - 2018-11-23T15:59:43.4818476Z#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkCategory :: begin - 2018-11-23T15:59:43.5029047Z#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkCategory :: network category to: private (IsConnected: True, IsConnectedToInternet: True).#015 Nov 23 07:59:44 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-NetworkCategory :: end - 2018-11-23T15:59:43.7405339Z#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer is going to invoke the consistency check for task of type REBOOT.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer is running LCM method PerformRequiredConfigurationChecks with the flag set to 2.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The local configuration manager started.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {CA933C0E-EF38-11E8-A911-F40343DF3381} : Operation Consistency Check or Pull started by user sid S-1-5-20 from computer NULL.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {CA933C0E-EF38-11E8-A911-F40343DF3381} : Details logging started to C:\windows\System32\Configuration\ConfigurationStatus\{CA933C0E-EF38-11E8-A911-F40343DF3381}-0.details.json.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer is going to start the consistency timer for the first time with value 15 minutes.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer successfully created the consistency timer.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer is going to start the refresh timer for the first time with value 30 minutes.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer successfully created the refresh timer.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {CA933C0E-EF38-11E8-A911-F40343DF3381} : Running consistency engine.#015 Nov 23 07:59:45 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {CA933C0E-EF38-11E8-A911-F40343DF3381} : The local configuration manager is updating the PSModulePath to C:\windows\system32\config\systemprofile\Documents\WindowsPowerShell\Modules;C:\Program Files\WindowsPowerShell\Modules;C:\windows\system32\WindowsPowerShell\v1.0\Modules;C:\Program Files\Mellanox\MLNX_VPI\Tools\WMI\Modules;C:\Program Files\Mellanox\MLNX_CIMProvider\WMI\Modules.#015 Nov 23 07:59:46 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: removed task directory: C:\Users\task_1542933642, with last write time: 11/23/2018 12:54:33 AM#015 Nov 23 07:59:46 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: Remove-OldTaskDirectories :: end - 2018-11-23T15:59:45.7518743Z#015 Nov 23 07:59:46 T-W1064-MS-031.mdc1.mozilla.com MaintainSystem: Run-MaintainSystem :: end - 2018-11-23T15:59:45.7528778Z#015 Nov 23 07:59:47 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:52 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: r Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-WinrmConfig :: begin - 2018-11-23T15:59:52.4265908Z#015 Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-WinrmConfig :: execution policy set to: RemoteSigned.#015 Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: begin - 2018-11-23T15:59:52.4687029Z#015 Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: winrm service state: Running.#015 Nov 23 07:59:53 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-ServiceState :: end - 2018-11-23T15:59:52.4697057Z#015 Nov 23 07:59:54 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-WinrmConfig :: WSMan:\localhost\MaxTimeoutms set to 180000.#015 Nov 23 07:59:56 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-WinrmConfig :: WSMan:\localhost\MaxEnvelopeSizekb set to 32696.#015 Nov 23 07:59:56 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Set-WinrmConfig :: end - 2018-11-23T15:59:55.8947949Z#015 Nov 23 07:59:56 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: begin - 2018-11-23T15:59:55.9609716Z#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job DscTimerConsistencyOperationResult : DSC Engine Error : #011 Error Message: NULL #011Error Code : 28 #015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job DscTimerConsistencyCallOperationRetry : DSC Engine Error : #011 Error Message: NULL #011Error Code : 2147749939 #015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The DscTimer is running LCM method PerformRequiredConfigurationChecks with the flag set to 2.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: The local configuration manager started.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Operation Consistency Check or Pull started by user sid S-1-5-20 from computer NULL.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Details logging started to C:\windows\System32\Configuration\ConfigurationStatus\{D271DBFB-EF38-11E8-A911-F40343DF3381}-0.details.json.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Running consistency engine.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: powershell package provider: NuGet, version: 2.8.5.208, detected.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: powershell module: xPSDesiredStateConfiguration, detected.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: powershell module: xWindowsUpdate, detected.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Stop-DesiredStateConfig :: begin - 2018-11-23T15:59:57.1892319Z#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Stop-DesiredStateConfig :: dsc process with pid 6460, stopped.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Stop-DesiredStateConfig :: end - 2018-11-23T15:59:57.2183202Z#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: downloaded C:\windows\TEMP\xDynamicConfig.ps1, from https://raw.githubusercontent.com/mozilla-releng/OpenCloudConfig/master/userdata/xDynamicConfig.ps1.#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: **********************#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Windows PowerShell transcript start#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Start time: 20181123155955#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Username: WORKGROUP\SYSTEM#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: RunAs User: WORKGROUP\SYSTEM#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Machine: T-W1064-MS-031 (Microsoft Windows NT 10.0.15063.0)#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Host Application: C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoLogo -NoProfile -WindowStyle Hidden -File C:\dsc\rundsc.ps1 -ExecutionPolicy RemoteSigned -ConsoleOutputFile C:\dsc\rundsc-run.log#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Process ID: 1704#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: PSVersion: 5.1.15063.0#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: PSEdition: Desktop#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: PSCompatibleVersions: 1.0, 2.0, 3.0, 4.0, 5.0, 5.1.15063.0#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: BuildVersion: 10.0.15063.0#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: CLRVersion: 4.0.30319.42000#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: WSManStackVersion: 3.0#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: PSRemotingProtocolVersion: 2.3#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: SerializationVersion: 1.1.0.1#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: **********************#015 Nov 23 07:59:57 T-W1064-MS-031.mdc1.mozilla.com dsc-run: Transcript started, output file is C:\log\20181123155955.dsc-run.log#015 Nov 23 07:59:58 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : The local configuration manager is updating the PSModulePath to C:\windows\system32\config\systemprofile\Documents\WindowsPowerShell\Modules;C:\Program Files\WindowsPowerShell\Modules;C:\windows\system32\WindowsPowerShell\v1.0\Modules;C:\Program Files\Mellanox\MLNX_VPI\Tools\WMI\Modules;C:\Program Files\Mellanox\MLNX_CIMProvider\WMI\Modules.#015 Nov 23 08:00:01 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: r Nov 23 08:00:02 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 08:00:06 T-W1064-MS-031.mdc1.mozilla.com OpenCloudConfig: Run-RemoteDesiredStateConfig :: compiled mof C:\windows\TEMP\xDynamicConfig, from xDynamicConfig.#015 Nov 23 08:00:07 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFC-EF38-11E8-A911-F40343DF3381} : Operation Start-DscConfiguration -Force started by user sid S-1-5-18 from computer T-W1064-MS-031.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Configuration is stopped when Powershell DSC resource is executing.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFD-EF38-11E8-A911-F40343DF3381} : Current configuration is forcely stopped.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFD-EF38-11E8-A911-F40343DF3381} : Operation Stop-DscConfiguration -Force completed successfully.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Current configuration is cancelled. 304 out of 162 resources are not configured.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: " Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Job runs under the following LCM setting. ConfigurationMode: ApplyAndMonitor ConfigurationModeFrequencyMins: 15 RefreshMode: PUSH RefreshFrequencyMins: 30 RebootNodeIfNeeded: NONE DebugMode: False#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: RESULT 1 [NXLOG@14506 Keywords="4611686018427387904" EventType="ERROR" EventID="4252" ProviderGuid="{50DF9E12-A8C4-4939-B281-47E1325BA63E}" Version="0" Task="0" OpcodeValue="0" RecordNumber="25805" ActivityID="{78CCB485-8345-0000-15CA-CC784583D401}" ThreadID="5076" Channel="Microsoft-Windows-DSC/Operational" Domain="NT AUTHORITY" AccountName="SYSTEM" UserID="S-1-5-18" AccountType="User" Opcode="Info" JobId="{D271DBFB-EF38-11E8-A911-F40343DF3381}" MIResult="1" ErrorMessage="The current configuration was cancelled." ErrorCategory="0" ErrorCode="1" ErrorType="MI" EventReceivedTime="2018-11-23 16:00:08" SourceModuleName="eventlog_operational" SourceModuleType="im_msvistalog"] Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : MIResult: 1 Error Message: The current configuration was cancelled. Message ID: MI RESULT 1 Error Category: 0 Error Code: 1 Error Type: MI#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFB-EF38-11E8-A911-F40343DF3381} : Details logging completed for C:\windows\System32\Configuration\ConfigurationStatus\{D271DBFB-EF38-11E8-A911-F40343DF3381}-0.details.json.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job DscTimerConsistencyOperationResult : DSC Engine Error : #011 Error Message: NULL #011Error Code : 1 #015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFC-EF38-11E8-A911-F40343DF3381} : Operation Start-DscConfiguration -Force started by user sid S-1-5-18 from computer T-W1064-MS-031.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: Job {D271DBFC-EF38-11E8-A911-F40343DF3381} : Details logging started to C:\windows\System32\Configuration\ConfigurationStatus\{D271DBFC-EF38-11E8-A911-F40343DF3381}-0.details.json.#015 Nov 23 08:00:08 T-W1064-MS-031.mdc1.mozilla.com Microsoft-Windows-DSC: r Nov 23 08:00:12 T-W1064-MS-031.mdc1.mozilla.com generic-worker-wrapper: Checking for manifest completetion #015
Status: RESOLVED → REOPENED
Flags: needinfo?(mcornmesser)
Resolution: FIXED → ---
I am not too concern about anything here. Unless the machine was reimaged because it is now up and running tasks. It looks like it has recovered from the generic worker 69 exit.
Flags: needinfo?(mcornmesser)
Closing for now.
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Depends on: 1540503

the machine seems to be up and running and taking jobs.
https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-win10-64-hw/workers/mdc1/T-W1064-MS-031
We will close the bug for now. If the problem will persist in the future, we will re-open this bug.

Status: REOPENED → RESOLVED
Closed: 7 years ago6 years ago
Resolution: --- → FIXED
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.