1818693 - Intermittent win11 ModuleNotFoundError: No module named 'mozdebug' / 'mozfile'

Status: RESOLVED INCOMPLETE

(Firefox Build System :: Task Configuration, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=406795604&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SUr6lZpBTJWQ-IEhNvrlLA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SUr6lZpBTJWQ-IEhNvrlLA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO -  'USERDOMAIN_ROAMINGPROFILE': 'VM-EIEYY9ILRHQH',
[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO -  'USERNAME': 'task_167722497834305',
[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO -  'USERPROFILE': 'C:\\Users\\task_167722497834305',
[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO -  'VIRTUAL_ENV': 'venv',
[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO -  'WINDIR': 'C:\\Windows'}
[task 2023-02-24T08:07:15.635Z] 08:07:15     INFO - Calling ['Z:\\task_167722497834305\\build\\venv\\Scripts\\python', '-u', 'Z:\\task_167722497834305\\build\\tests\\reftest\\runreftest.py', '--total-chunks', '3', '--this-chunk', '1', '--setpref=gfx.webrender.dcomp-win.enabled=true', '--setpref=gfx.webrender.dcomp-video-overlay-win=false', '--setpref=gfx.webrender.dcomp-video-overlay-win.force-enabled=false', '--setpref=gfx.webrender.compositor=false', '--setpref=gfx.webrender.compositor.force-enabled=false', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--appname=Z:\\task_167722497834305\\build\\application\\firefox\\firefox.exe', '--utility-path=tests/bin', '--extra-profile-file=tests/bin/plugins', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aUbvq95fSxmJWRmnhrJVOw/artifacts/public/build/target.crashreporter-symbols.zip', '--log-raw=Z:\\task_167722497834305\\build\\blobber_upload_dir\\reftest_raw.log', '--log-errorsummary=Z:\\task_167722497834305\\build\\blobber_upload_dir\\reftest_errorsummary.log', '--cleanup-crashes', '--marionette-startup-timeout=180', '--sandbox-read-whitelist=Z:\\task_167722497834305\\build', '--log-raw=-', '--suite=reftest', '--topsrcdir=tests/reftest/tests', '--', 'tests/reftest/tests/layout/reftests/reftest.list'] with output_timeout 1000
[task 2023-02-24T08:07:15.840Z] 08:07:15     INFO -  Traceback (most recent call last):
[task 2023-02-24T08:07:15.841Z] 08:07:15     INFO -    File "Z:\task_167722497834305\build\tests\reftest\runreftest.py", line 28, in <module>
[task 2023-02-24T08:07:15.841Z] 08:07:15     INFO -      import mozdebug
[task 2023-02-24T08:07:15.842Z] 08:07:15     INFO -  ModuleNotFoundError: No module named 'mozdebug'
[task 2023-02-24T08:07:15.862Z] 08:07:15     INFO - Return code: 1
[task 2023-02-24T08:07:15.863Z] 08:07:15    ERROR - No suite end message was emitted by this harness.
[task 2023-02-24T08:07:15.863Z] 08:07:15    ERROR - No checks run.
[task 2023-02-24T08:07:15.863Z] 08:07:15     INFO - TinderboxPrint: reftest-reftest<br/><em class="testfail">T-FAIL</em>
[task 2023-02-24T08:07:15.863Z] 08:07:15  WARNING - setting return code to 2

Comment 2

[Cosmin Sabou [:CosminS]]

Adding also the log with the mozfile failure: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/L5ndNRe1QviWKC-qPTuVGg/runs/0/artifacts/public/logs/live_backing.log

task 2023-02-24T07:59:56.804Z] 07:59:56     INFO - Getting output from command: ['Z:\\task_167722458463566\\build\\venv\\Scripts\\pip', 'list', '--format', 'freeze', '--no-index']
[task 2023-02-24T07:59:56.804Z] 07:59:56     INFO - Copy/paste: Z:\task_167722458463566\build\venv\Scripts\pip list --format freeze --no-index
[task 2023-02-24T07:59:57.532Z] 07:59:57     INFO - Reading from file tmpfile_stdout
[task 2023-02-24T07:59:57.532Z] 07:59:57     INFO - Using _rmtree_windows ...
[task 2023-02-24T07:59:57.532Z] 07:59:57     INFO - Running command: del /F /Q "Z:\task_167722458463566\tmpfile_stderr"
[task 2023-02-24T07:59:57.544Z] 07:59:57     INFO - Return code: 0
[task 2023-02-24T07:59:57.544Z] 07:59:57     INFO - Using _rmtree_windows ...
[task 2023-02-24T07:59:57.545Z] 07:59:57     INFO - Running command: del /F /Q "Z:\task_167722458463566\tmpfile_stdout"
[task 2023-02-24T07:59:57.558Z] 07:59:57     INFO - Return code: 0
[task 2023-02-24T07:59:57.559Z] 07:59:57     INFO - Return code: 0
[task 2023-02-24T07:59:57.559Z] 07:59:57     INFO - Detecting whether we're running mozinstall >=1.0...
[task 2023-02-24T07:59:57.559Z] 07:59:57     INFO - Getting output from command: ['Z:\\task_167722458463566\\build\\venv\\Scripts\\mozinstall', '-h']
[task 2023-02-24T07:59:57.559Z] 07:59:57     INFO - Copy/paste: Z:\task_167722458463566\build\venv\Scripts\mozinstall -h
[task 2023-02-24T07:59:57.737Z] 07:59:57    ERROR - Errors received:
[task 2023-02-24T07:59:57.738Z] 07:59:57     INFO - Reading from file tmpfile_stderr
[task 2023-02-24T07:59:57.738Z] 07:59:57    ERROR -  Traceback (most recent call last):
[task 2023-02-24T07:59:57.738Z] 07:59:57    ERROR -    File "Z:\task_167722458463566\build\venv\Scripts\mozinstall-script.py", line 33, in <module>
[task 2023-02-24T07:59:57.738Z] 07:59:57    ERROR -      sys.exit(load_entry_point('mozInstall==2.0.1', 'console_scripts', 'mozinstall')())
[task 2023-02-24T07:59:57.738Z] 07:59:57    ERROR -    File "Z:\task_167722458463566\build\venv\Scripts\mozinstall-script.py", line 25, in importlib_load_entry_point
[task 2023-02-24T07:59:57.738Z] 07:59:57    ERROR -      return next(matches).load()
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "c:\mozilla-build\python3\lib\importlib\metadata.py", line 77, in load
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -      module = import_module(match.group('module'))
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "c:\mozilla-build\python3\lib\importlib\__init__.py", line 127, in import_module
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -      return _bootstrap._gcd_import(name[level:], package, level)
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap_external>", line 850, in exec_module
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "Z:\task_167722458463566\build\venv\lib\site-packages\mozinstall\__init__.py", line 6, in <module>
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -      from .mozinstall import *
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -    File "Z:\task_167722458463566\build\venv\lib\site-packages\mozinstall\mozinstall.py", line 16, in <module>
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -      import mozfile
[task 2023-02-24T07:59:57.739Z] 07:59:57    ERROR -  ModuleNotFoundError: No module named 'mozfile'

Comment 3

[Intermittent Failures Robot]

3 failures in 3643 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• windows11-32-2009-qr: 1
  • debug: 1
• windows11-64-2009-asan-qr: 1
  • opt: 1
• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-02-20&endday=2023-02-26&tree=all

Comment 4

[Natalia Csoregi [:nataliaCs]]

First occurrence in this batch of retriggers and backfills

Comment 5

[Intermittent Failures Robot]

8 failures in 3752 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• windows11-32-2009-qr: 2
  • opt: 1
  • debug: 1
• windows11-64-2009-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-shippable-qr: 1
  • opt: 1
• windows11-64-2009-asan-qr: 2
  • opt: 2
• windows11-64-2009-mingwclang-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

the root cause is bug 1732228

Comment 7

[Intermittent Failures Robot]

12 failures in 3966 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• autoland: 6
• try: 1

Platform and build breakdown:

• windows11-64-2009-mingwclang-qr: 2
  • debug: 2
• windows11-64-2009-asan-qr: 2
  • opt: 2
• windows11-64-2009-qr: 4
  • opt: 1
  • debug: 3
• windows11-32-2009-qr: 3
  • debug: 2
  • opt: 1
• windows11-64-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-03-06&endday=2023-03-12&tree=all

Comment 8

[Intermittent Failures Robot]

9 failures in 3761 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• autoland: 4
• mozilla-central: 3

Platform and build breakdown:

• windows11-64-2009-qr: 6
  • debug: 5
  • opt: 1
• windows11-64-2009-asan-qr: 2
  • opt: 2
• windows11-64-2009-mingwclang-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-03-13&endday=2023-03-19&tree=all

Comment 9

[Intermittent Failures Robot]

7 failures in 4161 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-beta: 5

Platform and build breakdown:

• windows11-64-2009-mingwclang-qr: 1
  • debug: 1
• windows11-64-2009-asan-qr: 1
  • opt: 1
• windows11-64-2009-qr: 3
  • debug: 3
• windows11-64-2009-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-03-20&endday=2023-03-26&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 3863 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 6

Platform and build breakdown:

• windows11-64-2009-devedition-qr: 2
  • opt: 2
• windows11-64-2009-qr: 1
  • debug: 1
• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-64-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1818693&startday=2023-03-27&endday=2023-04-02&tree=all

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.