1635750 - Perma [Tier2 - CCov] ImportError: No module named mozbuild.util

Status: RESOLVED FIXED

(Core :: JavaScript Engine, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=301016040&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KdAW0p_OTLW56M4BAs67Fw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-05-06T11:29:37.535Z] 11:29:37 INFO - Calling ['Z:\task_1588762432\build\venv\Scripts\python', '-u', 'Z:\task_1588762432\build\tests\jit-test\jit-test\jit_test.py', '--total-chunks', '8', '--this-chunk', '1', 'tests/bin/js', '--no-slow', '--no-progress', '--format=automation', '--jitflags=all', '--timeout=970'] with output_timeout 1000
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - Traceback (most recent call last):
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - File "Z:\task_1588762432\build\tests\jit-test\jit-test\jit_test.py", line 32, in <module>
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - from lib import jittests
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - File "Z:\task_1588762432\build\tests\jit-test\tests\lib\jittests.py", line 21, in <module>
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - from .tasks_win import run_all_tests
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - File "Z:\task_1588762432\build\tests\jit-test\tests\lib\tasks_win.py", line 9, in <module>
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - from mozbuild.util import system_encoding
[task 2020-05-06T11:29:37.577Z] 11:29:37 INFO - ImportError: No module named mozbuild.util
[task 2020-05-06T11:29:37.605Z] 11:29:37 ERROR - Return code: 1
[task 2020-05-06T11:29:37.605Z] 11:29:37 ERROR - No tests run or test summary not found
[task 2020-05-06T11:29:37.605Z] 11:29:37 INFO - TinderboxPrint: jittest-jittest<br/><em class="testfail">T-FAIL</em>
[task 2020-05-06T11:29:37.605Z] 11:29:37 WARNING - # TBPL FAILURE #
[task 2020-05-06T11:29:37.605Z] 11:29:37 WARNING - setting return code to 2
[task 2020-05-06T11:29:37.605Z] 11:29:37 WARNING - The jittest suite: jittest ran with return status: FAILURE
[task 2020-05-06T11:29:37.605Z] 11:29:37 INFO - Running post-action listener: package_coverage_data
[task 2020-05-06T11:29:37.640Z] WARNING: No valid records found in []
[task 2020-05-06T11:29:37.640Z] 11:29:37 INFO - Getting output from command: ['Z:/task_1588762432/fetches\grcov.exe', '-t', 'lcov', '-p', 'z:/build/build/src/', '--ignore-dir', 'gcc*', '--ignore-dir', 'vs2017', 'Z:/task_1588762432/fetches\target.code-coverage-gcno.zip', 'c:\users\task_1588762432\appdata\local\temp\tmpcibxq3', '--llvm']
[task 2020-05-06T11:29:37.640Z] 11:29:37 INFO - Copy/paste: Z:/task_1588762432/fetches\grcov.exe -t lcov -p z:/build/build/src/ --ignore-dir gcc --ignore-dir vs2017_* Z:/task_1588762432/fetches\target.code-coverage-gcno.zip c:\users\task_1588762432\appdata\local\temp\tmpcibxq3 --llvm
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Errors received:
[task 2020-05-06T11:29:50.526Z] 11:29:50 INFO - Reading from file tmpfile_stderr
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestDictionaryBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestDictionaryBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestCodeGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestCodeGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestJSImplInheritanceGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestJSImplInheritanceGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestExampleGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestExampleGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestJSImplGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Warning: "../TestJSImplGenBinding.cpp" cannot be normalized because of "..", so skip it.
[task 2020-05-06T11:29:50.526Z] 11:29:50 ERROR - Return code: 0

Comment 1

[Ricky Stewart]

+ahal for figuring out how to configure this task with mozbuild in the PYTHONPATH.

Comment 2

[Andrew Halberstadt [:ahal]]

I know next to nothing about jittests, but I think the best approach is to shim it through mach. E.g, right now the command is:

Z:\\task_1588762432\\build\\venv\\Scripts\\python -u Z:\\task_1588762432\\build\\tests\\jit-test\\jit-test\\jit_test.py

we could change that to:

Z:\\task_1588762432\\build\\venv\\Scripts\\python mach python -u Z:\\task_1588762432\\build\\tests\\jit-test\\jit-test\\jit_test.py

That way it'll still run with the same python version, only with the mach PYTHONPATH enabled.

Comment 3

[Andrew Halberstadt [:ahal]]

Oh though I guess this runs from a tests.zip so mach might not be available. Mozbuild itself might not be available.

Comment 4

[Ricky Stewart]

Attachment: Bug 1635750 - Fix perma failure in ccov by not depending on mozbuild

Comment 5

[Intermittent Failures Robot]

44 failures in 931 pushes (0.047 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 44

Platform breakdown:

• windows10-64-ccov: 44

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635750&startday=2020-05-06&endday=2020-05-06&tree=all

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1633037

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d2dc990fff79
Fix perma failure in ccov by not depending on mozbuild r=glandium

Comment 8

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/d2dc990fff79

Comment 9

[Intermittent Failures Robot]

36 failures in 980 pushes (0.037 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 36

Platform breakdown:

• windows10-64-ccov: 36

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635750&startday=2020-05-07&endday=2020-05-07&tree=all

Comment 10

[Intermittent Failures Robot]

80 failures in 5276 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #15 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 80

Platform breakdown:

• windows10-64-ccov: 80

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635750&startday=2020-05-04&endday=2020-05-10&tree=all