Perma [tier 2] IOError: node not found at MOZ_NODE_PATH Z:/task_1568090273/fetches\node/node.exe
Categories
(Firefox Build System :: Task Configuration, defect, P5)
Tracking
(firefox-esr60 unaffected, firefox-esr68 unaffected, firefox69 unaffected, firefox70 unaffected, firefox71 fixed)
Tracking | Status | |
---|---|---|
firefox-esr60 | --- | unaffected |
firefox-esr68 | --- | unaffected |
firefox69 | --- | unaffected |
firefox70 | --- | unaffected |
firefox71 | --- | fixed |
People
(Reporter: intermittent-bug-filer, Assigned: CuveeHsu)
References
Details
(Keywords: intermittent-failure, regression)
Attachments
(2 files)
Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=265861630&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/LhCixpJARiK8UpCjGV92fg/runs/0/artifacts/public/logs/live_backing.log
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'TASKCLUSTER_ROOT_URL': 'https://taskcluster.net',
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'TASK_ID': 'LhCixpJARiK8UpCjGV92fg',
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'TEMP': 'C:\Users\task_1568090273\AppData\Local\Temp',
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'TMP': 'C:\Users\task_1568090273\AppData\Local\Temp',
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'TOOLTOOL_CACHE': 'y:\tooltool-cache',
[task 2019-09-10T05:27:13.035Z] 05:27:13 INFO - 'USERDOMAIN': 'I-028042693C91D',
[task 2019-09-10T05:27:13.036Z] 05:27:13 INFO - 'USERDOMAIN_ROAMINGPROFILE': 'I-028042693C91D',
[task 2019-09-10T05:27:13.036Z] 05:27:13 INFO - 'USERNAME': 'task_1568090273',
[task 2019-09-10T05:27:13.036Z] 05:27:13 INFO - 'USERPROFILE': 'C:\Users\task_1568090273',
[task 2019-09-10T05:27:13.036Z] 05:27:13 INFO - 'WINDIR': 'C:\Windows'}
[task 2019-09-10T05:27:13.036Z] 05:27:13 INFO - Calling ['Z:\task_1568090273\build\venv\Scripts\python', '-u', 'Z:\task_1568090273\build\tests\xpcshell\runxpcshelltests.py', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--symbols-path=Z:\task_1568090273\build\symbols', '--test-plugin-path=Z:\task_1568090273\build\application\firefox\plugins', '--log-raw=Z:\task_1568090273\build\blobber_upload_dir\xpcshell_raw.log', '--log-errorsummary=Z:\task_1568090273\build\blobber_upload_dir\xpcshell_errorsummary.log', '--utility-path=tests/bin', '--xpcshell=Z:\task_1568090273\build\application\firefox/xpcshell.exe', '--manifest=tests/xpcshell/tests/xpcshell.ini', u'devtools/client/performance-new/test/xpcshell/test_popup_initial_state.js'] with output_timeout 1000
[task 2019-09-10T05:27:13.273Z] 05:27:13 INFO - node not found at MOZ_NODE_PATH Z:/task_1568090273/fetches\node/node.exe
[task 2019-09-10T05:27:13.273Z] 05:27:13 INFO - Traceback (most recent call last):
[task 2019-09-10T05:27:13.273Z] 05:27:13 INFO - File "Z:\task_1568090273\build\tests\xpcshell\runxpcshelltests.py", line 1689, in <module>
[task 2019-09-10T05:27:13.275Z] 05:27:13 INFO - main()
[task 2019-09-10T05:27:13.275Z] 05:27:13 INFO - File "Z:\task_1568090273\build\tests\xpcshell\runxpcshelltests.py", line 1684, in main
[task 2019-09-10T05:27:13.277Z] 05:27:13 INFO - if not xpcsh.runTests(options):
[task 2019-09-10T05:27:13.277Z] 05:27:13 INFO - File "Z:\task_1568090273\build\tests\xpcshell\runxpcshelltests.py", line 1343, in runTests
[task 2019-09-10T05:27:13.277Z] 05:27:13 INFO - self.trySetupNode()
[task 2019-09-10T05:27:13.277Z] 05:27:13 INFO - File "Z:\task_1568090273\build\tests\xpcshell\runxpcshelltests.py", line 1123, in trySetupNode
[task 2019-09-10T05:27:13.279Z] 05:27:13 INFO - raise IOError(error)
[task 2019-09-10T05:27:13.279Z] 05:27:13 INFO - IOError: node not found at MOZ_NODE_PATH Z:/task_1568090273/fetches\node/node.exe
[task 2019-09-10T05:27:13.308Z] 05:27:13 ERROR - Return code: 1
[task 2019-09-10T05:27:13.327Z] WARNING: No valid records found in []
[task 2019-09-10T05:27:13.327Z] 05:27:13 INFO - Getting output from command: ['Z:/task_1568090273/fetches\grcov.exe', '-t', 'coveralls', '-p', 'z:/build/build/src/', '--ignore-dir', 'gcc*', '--ignore-dir', 'vs2017_', 'Z:/task_1568090273/fetches\target.code-coverage-gcno.zip', 'c:\users\task_1568090273\appdata\local\temp\tmp0tcfqn', '--token', 'UNUSED', '--commit-sha', 'UNUSED', 'jsvm_lcov_output.info', '--llvm', '--filter', 'covered']
[task 2019-09-10T05:27:13.327Z] 05:27:13 INFO - Copy/paste: Z:/task_1568090273/fetches\grcov.exe -t coveralls -p z:/build/build/src/ --ignore-dir gcc --ignore-dir vs2017_* Z:/task_1568090273/fetches\target.code-coverage-gcno.zip c:\users\task_1568090273\appdata\local\temp\tmp0tcfqn --token UNUSED --commit-sha UNUSED jsvm_lcov_output.info --llvm --filter covered
[task 2019-09-10T05:27:13.411Z] 05:27:13 ERROR - No tests run or test summary not found
[task 2019-09-10T05:27:13.411Z] 05:27:13 INFO - TinderboxPrint: xpcshell-xpcshell<br/><em class="testfail">T-FAIL</em>
[task 2019-09-10T05:27:13.411Z] 05:27:13 WARNING - # TBPL FAILURE #
[task 2019-09-10T05:27:13.411Z] 05:27:13 WARNING - setting return code to 2
[task 2019-09-10T05:27:13.411Z] 05:27:13 WARNING - TinderboxPrint: Per-test run of ...\test_popup_initial_state.js<br/>: FAILURE
[task 2019-09-10T05:27:13.411Z] 05:27:13 INFO - Running post-action listener: _package_coverage_data
[task 2019-09-10T05:27:25.872Z] 05:27:25 INFO - Running post-action listener: _resource_record_post_action
[task 2019-09-10T05:27:25.872Z] 05:27:25 INFO - Running post-action listener: process_java_coverage_data
[task 2019-09-10T05:27:25.872Z] 05:27:25 INFO - [mozharness: 2019-09-10 05:27:25.872000Z] Finished run-tests step (success)
[task 2019-09-10T05:27:25.872Z] 05:27:25 INFO - Running post-run listener: _resource_record_post_run
[task 2019-09-10T05:27:26.025Z] 05:27:26 INFO - Validating Perfherder data against Z:\task_1568090273\mozharness\external_tools\performance-artifact-schema.json
[task 2019-09-10T05:27:26.028Z] 05:27:26 INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"subtests": [{"name": "cpu_percent", "value": 19.178564154786148}, {"name": "io_write_bytes", "value": 16650600960}, {"name": "io.read_bytes", "value": 29421056}, {"name": "io_write_time", "value": 541}, {"name": "io_read_time", "value": 4}], "extraOptions": ["e10s", "taskcluster-c5.2xlarge"], "name": ".overall"}, {"subtests": [{"name": "time", "value": 4.116000175476074}, {"name": "cpu_percent", "value": 15.479166666666666}], "name": ".install"}, {"subtests": [{"name": "time", "value": 0.03099989891052246}], "name": ".stage-files"}, {"subtests": [{"name": "time", "value": 982.6790001392365}, {"name": "cpu_percent", "value": 19.196127300613494}], "name": ".run-tests"}]}
[task 2019-09-10T05:27:26.028Z] 05:27:26 INFO - Total resource usage - Wall time: 987s; CPU: 19.0%; Read bytes: 29421056; Write bytes: 16650600960; Read time: 4; Write time: 541
[task 2019-09-10T05:27:26.028Z] 05:27:26 INFO - TinderboxPrint: CPU usage<br/>19.2%
[task 2019-09-10T05:27:26.028Z] 05:27:26 INFO - TinderboxPrint: I/O read bytes / time<br/>29,421,056 / 4
[task 2019-09-10T05:27:26.028Z] 05:27:26 INFO - TinderboxPrint: I/O write bytes / time<br/>16,650,600,960 / 541
[task 2019-09-10T05:27:26.029Z] 05:27:26 INFO - TinderboxPrint: CPU idle<br/>6,394.7 (80.8%)
[task 2019-09-10T05:27:26.029Z] 05:27:26 INFO - TinderboxPrint: CPU system<br/>372.0 (4.7%)
[task 2019-09-10T05:27:26.029Z] 05:27:26 INFO - TinderboxPrint: CPU user<br/>1,124.2 (14.2%)
[task 2019-09-10T05:27:26.029Z] 05:27:26 INFO - install - Wall time: 4s; CPU: 15.0%; Read bytes: 0; Write bytes: 15654912; Read time: 0; Write time: 0
[task 2019-09-10T05:27:26.030Z] 05:27:26 INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2019-09-10T05:27:26.039Z] 05:27:26 INFO - run-tests - Wall time: 983s; CPU: 19.0%; Read bytes: 29421056; Write bytes: 16581337600; Read time: 4; Write time: 541
[task 2019-09-10T05:27:26.263Z] 05:27:26 WARNING - returning nonzero exit status 2
Comment 1•5 years ago
|
||
Also appearing on xpcshell tests: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=265869568&repo=mozilla-central&lineNumber=993
Assignee | ||
Comment 3•5 years ago
|
||
(In reply to Geoff Brown [:gbrown] from comment #2)
:Junior - is this related to your recent changes?
Yes it is
Assignee | ||
Comment 4•5 years ago
|
||
Assignee | ||
Comment 5•5 years ago
|
||
Let's see the result of test-coverage test
https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=265988360&revision=710d61828abd0fea0915a43f1b99d4069aaeb9c0
Assignee | ||
Comment 6•5 years ago
|
||
(In reply to Alexandru Michis [:malexandru] from comment #1)
Also appearing on xpcshell tests: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=265869568&repo=mozilla-central&lineNumber=993
Set the dependency for test-windows10-aarch64/opt-xpcshell-e10s-* failures
Assignee | ||
Comment 7•5 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 13•5 years ago
|
||
There are 70 total failures since September 9.
Tom can you please take a look at Junior's patch?
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•5 years ago
|
Comment 17•5 years ago
|
||
Comment 18•5 years ago
|
||
bugherder |
https://hg.mozilla.org/mozilla-central/rev/9d4b2073939f
https://hg.mozilla.org/mozilla-central/rev/ab70364f88a1
Updated•5 years ago
|
Updated•5 years ago
|
Comment 19•5 years ago
|
||
Junior, the patches doesn't seem to fix the issue: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&group_state=expanded&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&revision=e71921b729c6c61c9f2c7b6b84cf0db58543d28f&searchStr=windows%2C10%2Caarch64%2Copt%2Cxpc&selectedJob=267250534
Could you please take a look over this?
Failure log:https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=267250534&repo=mozilla-central&lineNumber=995
Assignee | ||
Comment 20•5 years ago
|
||
Hello :CosminS, this patches fix the test coverage (TC). For the xpcshell in aarch64, it's another issue which bug 1578963 should fixes.
Comment 21•5 years ago
|
||
Thank Junior for the info.
Based on comment 20 closing this as fixed and those m-c aarch xpcshell failures are expected fail from bug 1578963.
Comment hidden (Intermittent Failures Robot) |
Updated•3 years ago
|
Description
•