2037297 - Perma TV Exception during post-action for download-and-extract: Traceback (most recent call last):

Status: NEW

(Testing :: Mozbase, defect)

Description

[Treeherder Bug Filer]

Filed by: agoloman [at] mozilla.com
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/B_GJInX8Sc-hA8y6LaG1dA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/default/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/B_GJInX8Sc-hA8y6LaG1dA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=564638361&repo=autoland&task=B_GJInX8Sc-hA8y6LaG1dA.0

---

[task 2026-05-06T00:00:01.303+00:00] 00:00:01     INFO - Content-Length response header: 560745629
[task 2026-05-06T00:00:01.303+00:00] 00:00:01     INFO - Bytes received: 560745629
[task 2026-05-06T00:00:15.533+00:00] 00:00:15     INFO - Running post-action listener: _resource_record_post_action
[task 2026-05-06T00:00:15.533+00:00] 00:00:15     INFO - Running post-action listener: find_tests_for_coverage
[task 2026-05-06T00:00:15.533+00:00] 00:00:15     INFO - Running post-action listener: find_tests_for_verification
[task 2026-05-06T00:00:15.540+00:00] 00:00:15     INFO - Per-test run using mozinfo: {'os': 'win', 'processor': 'x86', 'version': '10.0.26200', 'os_version': StringVersion ('11.26200'), 'bits': 32, 'has_sandbox': True, 'display': None, 'automation': True, 'apple_silicon': False, 'apple_catalina': False, 'win10_2009': False, 'win11_2009': False, 'is_ubuntu': False, 'arch': 'x86', 'appname': 'firefox', 'artifact': False, 'asan': False, 'bin_suffix': '.exe', 'buildapp': 'browser', 'buildtype': 'debug', 'buildtype_guess': 'debug', 'cc_type': 'clang-cl', 'ccov': False, 'crashreporter': True, 'datareporting': True, 'dbus_enabled': False, 'debug': True, 'devedition': False, 'early_beta_or_earlier': True, 'healthreport': True, 'isolated_process': False, 'mingw': False, 'mozconfig': '/builds/worker/checkouts/gecko/.mozconfig', 'nightly_build': True, 'normandy': True, 'official': True, 'opt': False, 'pgo': False, 'platform_guess': 'win32', 'release_or_beta': False, 'require_signing': False, 'stylo': True, 'sync': True, 'telemetry': False, 'tests_enabled': True, 'toolkit': 'windows', 'topobjdir': '/builds/worker/workspace/obj-build', 'topsrcdir': '/builds/worker/checkouts/gecko', 'tsan': False, 'ubsan': False, 'updater': True, 'e10s': True, 'fission': True, 'headless': False, 'a11y_checks': False, 'socketprocess_e10s': False, 'socketprocess_networking': False, 'swgl': False, 'wmfme': False, 'emewmf': False, 'mda_gpu': False, 'nogpu': False, 'msix': False, 'vertical_tab': False, 'inc_origin_init': False, 'privateBrowsing': False, 'sessionHistoryInParent': True, 'http2': False, 'http3': False, 'xorigin': False, 'condprof': False, 'verify': True}
[task 2026-05-06T00:00:15.540+00:00] 00:00:15     INFO - retry: Calling get_automationrelevance with args: (), kwargs: {}, attempt #1
[task 2026-05-06T00:00:15.540+00:00] 00:00:15     INFO - retry: Calling _urlopen with args: (), kwargs: {'url': 'https://hg.mozilla.org/integration/autoland/json-automationrelevance/6c7e4caffd18d79202d5f18c4aa05f4217f69926'}, attempt #1
[task 2026-05-06T00:00:17.427+00:00] 00:00:17     INFO -  6c7e4caffd18 b'Bug 2036948  - [TOS] - Update showModal to use gBrowser.selectedBrowser r=omc-reviewers,janerik,sachung'
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR - Exception during post-action for download-and-extract: Traceback (most recent call last):
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\mozharness\base\script.py", line 2330, in run_action
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -     method(action, success=success and self.return_code == 0)
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\mozharness\mozilla\testing\verify_tools.py", line 49, in find_tests_for_verification
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -     self.find_modified_tests()
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\mozharness\mozilla\testing\per_test_base.py", line 451, in find_modified_tests
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -     self._find_misc_tests(dirs, changed_files, mozinfo)
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\mozharness\mozilla\testing\per_test_base.py", line 69, in _find_misc_tests
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -     from manifestparser import TestManifest
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\manifestparser\__init__.py", line 8, in <module>
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -     from .manifestparser import *
[task 2026-05-06T00:00:17.490+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\manifestparser\manifestparser.py", line 18, in <module>
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR -     from .toml import read_toml
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\manifestparser\toml.py", line 11, in <module>
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR -     from mozinfo.platforminfo import android_api_to_os_version
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR -   File "D:\task_177802426952639\mozharness\mozinfo\platforminfo.py", line 11, in <module>
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR -     import yaml
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    ERROR - ModuleNotFoundError: No module named 'yaml'
[task 2026-05-06T00:00:17.503+00:00] 00:00:17     INFO - Running post-action listener: set_extra_try_arguments
[task 2026-05-06T00:00:17.503+00:00] 00:00:17     INFO - Running post-action listener: setup_coverage_tools
[task 2026-05-06T00:00:17.503+00:00] 00:00:17     INFO - [mozharness: 2026-05-06 00:00:17.503204Z] Finished download-and-extract step (success)
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    FATAL - Aborting due to failure in post-action listener.
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    FATAL - Running post_fatal callback...
[task 2026-05-06T00:00:17.503+00:00] 00:00:17    FATAL - Exiting -1
[task 2026-05-06T00:00:17.504+00:00] 00:00:17     INFO - Running post-run listener: _resource_record_post_run
[taskcluster 2026-05-06T00:00:17.556Z]                        Exit Code: 4294967295
[taskcluster 2026-05-06T00:00:17.556Z]                        User Time: 31.25ms
[taskcluster 2026-05-06T00:00:17.556Z]                      Kernel Time: 0s
[taskcluster 2026-05-06T00:00:17.556Z]                        Wall Time: 2m29.0865581s
[taskcluster 2026-05-06T00:00:17.556Z]  Average Available System Memory: 13.30 GiB
[taskcluster 2026-05-06T00:00:17.556Z]       Average System Memory Used: 2.70 GiB
[taskcluster 2026-05-06T00:00:17.556Z]          Peak System Memory Used: 5.11 GiB
[taskcluster 2026-05-06T00:00:17.556Z]              Total System Memory: 15.99 GiB
[taskcluster 2026-05-06T00:00:17.556Z]                           Result: FAILED
[taskcluster 2026-05-06T00:00:17.557Z] === Task Finished ===
[taskcluster 2026-05-06T00:00:17.557Z] Task Duration: 2m29.0886717s
[taskcluster 2026-05-06T00:00:18.717Z] [mounts] Preserving cache: Moving "D:\\task_177802426952639\\.task-cache\\pip" to "D:\\caches\\VoYPhpuUS2qa0fYFeVPFzA"
[taskcluster 2026-05-06T00:00:18.719Z] [mounts] Preserving cache: Moving "D:\\task_177802426952639\\.task-cache\\uv" to "D:\\caches\\ZTSQ-MqPSFKCcjD_wJ68aw"
[taskcluster:error] exit status 0xffffffff

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:mjung, since you are the author of the regressor, bug 2036948, could you take a look?

For more information, please visit BugBot documentation.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 2036948

Comment 3

[Ryan VanderMeulen [:RyanVM]]

This was regressed by https://hg-edge.mozilla.org/mozilla-central/rev/00856bc4cea0

Comment 4

[Ryan VanderMeulen [:RyanVM]]

Attachment: Bug 2037297 - Lazy-import android_api_to_os_version in manifestparser/toml.py to avoid pulling in pyyaml at import time. r?sylvestre

Comment 5

[Ryan VanderMeulen [:RyanVM]]

This is a band-aid fix for now, but longer-term we probably want to add pyyaml to mozinfo/setup.py's install_requires and add it to the Mac and Windows CI workers.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/de95252e9176
https://hg.mozilla.org/integration/autoland/rev/135af6efdef7
Lazy-import android_api_to_os_version in manifestparser/toml.py to avoid pulling in pyyaml at import time. r=sylvestre,sergesanspaille

Comment 7

[Intermittent Failures Robot]

341 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 330
• try: 4
• mozilla-central: 7

Table

	no_variant
linux2404-x86_64/opt	1
macosx1470-x86_64/debug	55
macosx1470-x86_64/opt	55
windows11-x86/debug	55
windows11-x86/opt	56
windows11-x86_64/ccov	7
windows11-x86_64/debug	56
windows11-x86_64/opt	56

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2037297&startday=2026-05-06&endday=2026-05-06&tree=all

Comment 8

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/135af6efdef7

Comment 9

[Ryan VanderMeulen [:RyanVM]]

We should also add a test for this issue that fails closer to the source of the problem rather than in unrelated downstream tasks.

Comment 10

[Ryan VanderMeulen [:RyanVM]]

Marco, Johan and I were poking at this a bit and it appears the issue isn't missing pyyaml on our pypi server, it's test-verify not correctly setting up dependencies for Mac and Windows. On Linux it appears that we're correctly loading the python dependencies as shown in the logs below.
Linux: https://firefox-ci-tc.services.mozilla.com/tasks/UbwRE-W0QB2J0zXJAfu23w/runs/0/logs/public/logs/live.log#L1245
Windows: https://firefox-ci-tc.services.mozilla.com/tasks/B_GJInX8Sc-hA8y6LaG1dA/runs/0/logs/public/logs/live.log#L626

Is there someone on your team that could maybe take a look?

Comment 11

[Marco Castelluccio [:marco]]

I can't think of anyone right now that has experience with this area. Maybe ahal or florian? Or maybe somebody from the build team? Serge reviewed the patch, so we could start with him.

Comment 12

[Intermittent Failures Robot]

345 failures were associated with this bug in the last 7 days.
This is the #1 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 334
• try: 4
• mozilla-central: 7

Table

	no_variant
linux2404-x86_64/opt	1
macosx1470-x86_64/debug	56
macosx1470-x86_64/opt	57
windows11-x86/debug	56
windows11-x86/opt	56
windows11-x86_64/ccov	7
windows11-x86_64/debug	56
windows11-x86_64/opt	56

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2037297&startday=2026-05-04&endday=2026-05-10&tree=all

Comment 13

[Mark Banner (:standard8)]

The failures are all about test-verify, nothing to do with Lint afaict. Not sure why it was logged under developer infra / Lint.

Comment 14

[Mark Banner (:standard8)]

Oh, maybe because the regressing bug was Lint, but the files the patch touched were mozbase...

Comment 15

[Sylvestre Ledru [:Sylvestre]]

thanks for the fixing ryan