1747241 - Intermittent mach.requirements.UnexpectedFlexibleRequirementException: psutil>=5.4.2,<=5.8.0 | after raise UnexpectedFlexibleRequirementException(raw_requirement)

Status: RESOLVED FIXED

(Firefox Build System :: Mach Core, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=362109888&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/He5bCWLHTji5sVyKPWd41g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-12-22T11:09:22.587Z] Creating default state directory: /builds/worker/.mozbuild
[task 2021-12-22T11:09:23.462Z] Traceback (most recent call last):
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/mach", line 126, in <module>
[task 2021-12-22T11:09:23.462Z]     main(sys.argv[1:])
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/mach", line 118, in main
[task 2021-12-22T11:09:23.462Z]     mach = check_and_get_mach(os.path.dirname(os.path.realpath(__file__)))
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/mach", line 105, in check_and_get_mach
[task 2021-12-22T11:09:23.462Z]     return load_mach(dir_path, mach_path)
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/mach", line 91, in load_mach
[task 2021-12-22T11:09:23.462Z]     return mach_initialize.initialize(dir_path)
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/comm/build/mach_initialize.py", line 52, in initialize
[task 2021-12-22T11:09:23.462Z]     sys.path.extend(mach_sys_path(topsrcdir))
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/comm/build/mach_initialize.py", line 34, in mach_sys_path
[task 2021-12-22T11:09:23.462Z]     requirements = MachEnvRequirements.from_requirements_definition(
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 80, in from_requirements_definition
[task 2021-12-22T11:09:23.462Z]     _parse_mach_env_requirements(
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 170, in _parse_mach_env_requirements
[task 2021-12-22T11:09:23.462Z]     _parse_requirements_definition_file(root_requirements_path, False)
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 166, in _parse_requirements_definition_file
[task 2021-12-22T11:09:23.462Z]     _parse_requirements_line(
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 115, in _parse_requirements_line
[task 2021-12-22T11:09:23.462Z]     _parse_requirements_definition_file(
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 166, in _parse_requirements_definition_file
[task 2021-12-22T11:09:23.462Z]     _parse_requirements_line(
[task 2021-12-22T11:09:23.462Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 142, in _parse_requirements_line
[task 2021-12-22T11:09:23.463Z]     _parse_package_specifier(raw_requirement, only_strict_requirements),
[task 2021-12-22T11:09:23.463Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/requirements.py", line 184, in _parse_package_specifier
[task 2021-12-22T11:09:23.463Z]     raise UnexpectedFlexibleRequirementException(raw_requirement)
[task 2021-12-22T11:09:23.463Z] mach.requirements.UnexpectedFlexibleRequirementException: psutil>=5.4.2,<=5.8.0
[task 2021-12-22T11:09:23.501Z] cleanup
[task 2021-12-22T11:09:23.501Z] + cleanup
[task 2021-12-22T11:09:23.501Z] + local rv=1
[task 2021-12-22T11:09:23.501Z] + cleanup_xvfb
[task 2021-12-22T11:09:23.502Z] ++ pidof Xvfb
[task 2021-12-22T11:09:23.503Z] + local xvfb_pid=
[task 2021-12-22T11:09:23.503Z] + local vnc=false
[task 2021-12-22T11:09:23.503Z] + local interactive=false
[task 2021-12-22T11:09:23.503Z] + '[' -n '' ']'
[task 2021-12-22T11:09:23.503Z] + exit 1
[taskcluster 2021-12-22 11:09:23.860Z] === Task Finished ===
[taskcluster 2021-12-22 11:09:23.984Z] Artifact "public/logs" not found at "/builds/worker/logs/"
[taskcluster 2021-12-22 11:09:24.087Z] Artifact "public/build" not found at "/builds/worker/artifacts/"
[taskcluster 2021-12-22 11:09:24.183Z] Artifact "public/build/target.complete.mar" not found at "/builds/worker/workspace/outputs/target.complete.mar"
[taskcluster 2021-12-22 11:09:24.247Z] Unsuccessful task run with exit code: 1 completed in 19.462 seconds

Comment 1

[Iulian Moraru]

This bustages appeared on autoland but we also got them on m-c.

Push where the bustage first appeared -autoland-
Push where the bustage first appeared on m-c

Failure log

Comment 2

[Iulian Moraru]

Hi Mitchell! Can you please take a look at this?
Thank you!

Comment 3

[Mitchell Hentges [:mhentges] 🦀]

There's two reasons why this failure have occurred, one a little more concerning than the other:

1. comm-central needed to be updated to be compatible. When its fix lands, it'll work around this issue.
2. When our CI ran those two failing tasks, note that, in the stack trace, there's /builds/worker/checkouts/gecko/comm/build/mach_initialize.py. It looks like these CI jobs aren't running from clean checkouts, so a previous "Thunderbird" task on a worker is leaving thunderbird-specific files in the VCS repo.

I've reported that issue over here.

I'll mark this specific issue as FIXED since the Thunderbird bug has been resolved.

Comment 4

[Intermittent Failures Robot]

9 failures in 2286 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform and build breakdown:

• linux64: 3
  • opt: 3
• osx-cross: 2
  • plain: 1
  • opt: 1
• windows2012-64: 3
  • debug: 3
• windows2012-32-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1747241&startday=2021-12-20&endday=2021-12-26&tree=all