1474865 - Intermittent taskcluster startup fails with Exit Code: 3221225794 [0xC0000142 - The application failed to initialize properly]

Status: RESOLVED WORKSFORME

(Taskcluster :: Workers, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Blog post from Microsoft about this kind of failure: https://blogs.msdn.microsoft.com/winsdk/2015/06/03/what-is-up-with-the-application-failed-to-initialize-properly-0xc0000142-error/

(empty) formatted log: https://treeherder.mozilla.org/logviewer.html#?job_id=187346733&repo=mozilla-central&lineNumber=46

raw log: https://taskcluster-artifacts.net/ZnEflPjDR9qiFgMafYrgHA/0/public/logs/live_backing.log

[taskcluster 2018-07-10T10:56:19.432Z] Worker Type (gecko-t-win10-64) settings:
[taskcluster 2018-07-10T10:56:19.432Z]   {
[taskcluster 2018-07-10T10:56:19.432Z]     "aws": {
[taskcluster 2018-07-10T10:56:19.432Z]       "ami-id": "ami-d4b1823f",
[taskcluster 2018-07-10T10:56:19.432Z]       "availability-zone": "eu-central-1a",
[taskcluster 2018-07-10T10:56:19.432Z]       "instance-id": "i-0b7e1a40934054b3b",
[taskcluster 2018-07-10T10:56:19.432Z]       "instance-type": "c4.2xlarge",
[taskcluster 2018-07-10T10:56:19.432Z]       "local-ipv4": "10.147.23.197",
[taskcluster 2018-07-10T10:56:19.432Z]       "public-hostname": "ec2-18-196-156-249.eu-central-1.compute.amazonaws.com",
[taskcluster 2018-07-10T10:56:19.432Z]       "public-ipv4": "18.196.156.249"
[taskcluster 2018-07-10T10:56:19.432Z]     },
[taskcluster 2018-07-10T10:56:19.432Z]     "config": {
[taskcluster 2018-07-10T10:56:19.432Z]       "deploymentId": "68c796118ff4",
[taskcluster 2018-07-10T10:56:19.432Z]       "runTasksAsCurrentUser": false
[taskcluster 2018-07-10T10:56:19.432Z]     },
[taskcluster 2018-07-10T10:56:19.432Z]     "generic-worker": {
[taskcluster 2018-07-10T10:56:19.432Z]       "go-arch": "amd64",
[taskcluster 2018-07-10T10:56:19.432Z]       "go-os": "windows",
[taskcluster 2018-07-10T10:56:19.432Z]       "go-version": "go1.10.2",
[taskcluster 2018-07-10T10:56:19.432Z]       "release": "https://github.com/taskcluster/generic-worker/releases/tag/v10.8.5",
[taskcluster 2018-07-10T10:56:19.432Z]       "revision": "034c836cfd18ebe8b7fb6dbfabccea4bcd0fa1f6",
[taskcluster 2018-07-10T10:56:19.432Z]       "source": "https://github.com/taskcluster/generic-worker/commits/034c836cfd18ebe8b7fb6dbfabccea4bcd0fa1f6",
[taskcluster 2018-07-10T10:56:19.432Z]       "version": "10.8.5"
[taskcluster 2018-07-10T10:56:19.432Z]     },
[taskcluster 2018-07-10T10:56:19.432Z]     "machine-setup": {
[taskcluster 2018-07-10T10:56:19.432Z]       "ami-created": "2018-06-14 16:58:33.570Z",
[taskcluster 2018-07-10T10:56:19.432Z]       "manifest": "https://github.com/mozilla-releng/OpenCloudConfig/blob/68c796118ff4506c99e0ff07d82da4e012033664/userdata/Manifest/gecko-t-win10-64.json"
[taskcluster 2018-07-10T10:56:19.432Z]     }
[taskcluster 2018-07-10T10:56:19.432Z]   }
[taskcluster 2018-07-10T10:56:19.433Z] Task ID: ZnEflPjDR9qiFgMafYrgHA
[taskcluster 2018-07-10T10:56:19.433Z] === Task Starting ===
[taskcluster 2018-07-10T10:56:20.452Z] Uploading redirect artifact public/logs/live.log to URL https://clcjz6iaaaawjbbh4daqezytrmtgjcn7inn3zq5mn4rdmq44.taskcluster-worker.net:60023/log/Qv1M88YJRQ-Gnxk53XvYOQ with mime type "text/plain; charset=utf-8" and expiry 2018-07-10T12:26:03.329Z
[taskcluster 2018-07-10T10:56:20.855Z] [mounts] Downloading task HR5WM8EyRH2LMOhJ-8yimA artifact public/build/mozharness.zip to Y:\downloads\PEABWo6uQF-aj5TTCWX-tg
[taskcluster 2018-07-10T10:56:40.683Z] [mounts] Downloaded 2377711 bytes with SHA256 d9569d3aec9b12e7d4d3949dbba47213cb0293148f088965f72727919a08a80f from task HR5WM8EyRH2LMOhJ-8yimA artifact public/build/mozharness.zip to Y:\downloads\PEABWo6uQF-aj5TTCWX-tg
[taskcluster:warn 2018-07-10T10:56:40.683Z] [mounts] Download Y:\downloads\PEABWo6uQF-aj5TTCWX-tg of task HR5WM8EyRH2LMOhJ-8yimA artifact public/build/mozharness.zip has SHA256 d9569d3aec9b12e7d4d3949dbba47213cb0293148f088965f72727919a08a80f but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2018-07-10T10:56:40.683Z] [mounts] Creating directory Z:\task_1531219606 with permissions 0700
[taskcluster 2018-07-10T10:56:40.683Z] [mounts] Extracting zip file Y:\downloads\PEABWo6uQF-aj5TTCWX-tg to 'Z:\task_1531219606'
[taskcluster 2018-07-10T10:56:40.860Z] Executing command 0: c:\mozilla-build\python\python.exe -u mozharness\scripts\desktop_unittest.py --cfg mozharness\configs\unittests\win_taskcluster_unittest.py --headless --mochitest-suite=plain-chunked --e10s --installer-url https://queue.taskcluster.net/v1/task/HR5WM8EyRH2LMOhJ-8yimA/artifacts/public/build/target.zip --test-packages-url https://queue.taskcluster.net/v1/task/HR5WM8EyRH2LMOhJ-8yimA/artifacts/public/build/target.test_packages.json --download-symbols true --headless --mochitest-suite=plain-chunked --e10s --total-chunk=5 --this-chunk=2
[taskcluster 2018-07-10T10:56:40.875Z]    Exit Code: 3221225794
[taskcluster 2018-07-10T10:56:40.875Z]    User Time: 0s
[taskcluster 2018-07-10T10:56:40.875Z]  Kernel Time: 15.625ms
[taskcluster 2018-07-10T10:56:40.875Z]    Wall Time: 13.9918ms
[taskcluster 2018-07-10T10:56:40.875Z]       Result: FAILED
[taskcluster 2018-07-10T10:56:40.875Z] === Task Finished ===
[taskcluster 2018-07-10T10:56:40.875Z] Task Duration: 15.0032ms
[taskcluster:error] Uploading error artifact public/logs from file logs with message "Could not read directory 'Z:\\task_1531219606\\logs'", reason "file-missing-on-worker" and expiry 2019-07-10T09:47:32.760Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'Z:\task_1531219606\logs'
[taskcluster:error] Uploading error artifact public/test_info from file build/blobber_upload_dir with message "Could not read directory 'Z:\\task_1531219606\\build\\blobber_upload_dir'", reason "file-missing-on-worker" and expiry 2019-07-10T09:47:32.760Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'Z:\task_1531219606\build\blobber_upload_dir'
[taskcluster 2018-07-10T10:56:42.296Z] Uploading redirect artifact public/logs/live.log to URL https://queue.taskcluster.net/v1/task/ZnEflPjDR9qiFgMafYrgHA/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2019-07-10T09:47:32.760Z
[taskcluster:error] exit status 3221225794
[taskcluster:error] file-missing-on-worker: Could not read directory 'Z:\task_1531219606\logs'
[taskcluster:error] file-missing-on-worker: Could not read directory 'Z:\task_1531219606\build\blobber_upload_dir'

Comment 1

[Intermittent Failures Robot]

1 failures in 623 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows10-64-msvc: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1474865&startday=2018-07-09&endday=2018-07-15&tree=trunk

Comment 2

[Intermittent Failures Robot]

2 failures in 760 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows2012-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1474865&startday=2018-07-23&endday=2018-07-29&tree=trunk