1952790 - `mach python-test` fails on python 3.11 due to `pyyaml` compilation error

Status: NEW

(Testing :: Python Test, defect)

Description

[:glob ✱]

dev/mozilla-central$ MACH_SHOW_PIP_OUTPUT=1  python3.11 ./mach python-test
Installing pip requirements to the 'python-test' site.
Using Python 3.11.11 environment at: /Users/byron/.mozbuild/srcdirs/mozilla-central-0aa7e5c7e374/_virtualenvs/python-test
Audited 39 packages in 31ms
Installing pip requirements to the 'python-test' site.
Using Python 3.11.11 environment at: /Users/byron/.mozbuild/srcdirs/mozilla-central-0aa7e5c7e374/_virtualenvs/python-test
  × Failed to build `pyyaml==6.0`
  ├─▶ The build backend returned an error
  ╰─▶ Call to `setuptools.build_meta.build_wheel` failed (exit status: 1)

      [stdout]
      running egg_info
      writing lib/PyYAML.egg-info/PKG-INFO
      writing dependency_links to lib/PyYAML.egg-info/dependency_links.txt
      writing top-level names to lib/PyYAML.egg-info/top_level.txt

      [stderr]
      Traceback (most recent call last):
        File "<string>", line 14, in <module>
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/build_meta.py", line 334, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/build_meta.py", line 304, in _get_build_requires
          self.run_setup()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/build_meta.py", line 320, in run_setup
          exec(code, locals())
        File "<string>", line 288, in <module>
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
          dist.run_commands()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
          self.run_command(cmd)
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command
          super().run_command(command)
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 312, in run
          self.find_sources()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 320, in find_sources
          mm.run()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 543, in run
          self.add_defaults()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/command/egg_info.py", line 581, in add_defaults
          sdist.add_defaults(self)
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/command/sdist.py", line 109, in add_defaults
          super().add_defaults()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/command/sdist.py", line 245, in add_defaults
          self._add_defaults_ext()
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/command/sdist.py", line 330, in _add_defaults_ext
          self.filelist.extend(build_ext.get_source_files())
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "<string>", line 204, in get_source_files
        File "/Users/byron/Library/Caches/uv/builds-v0/.tmpOsWwBK/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 131, in __getattr__
          raise AttributeError(attr)
      AttributeError: cython_sources

Worked without issue with python3.10: python3.10 ./mach python-test

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:jmaher, could you have a look please?

For more information, please visit BugBot documentation.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

:glob, can you try adjusting https://searchfox.org/mozilla-central/source/testing/mozharness/requirements.txt#5 -> pyyaml==6.0.1 ?

My attempt to reproduce (with no changes) yields other errors:

 MACH_SHOW_PIP_OUTPUT=1 ./mach python-test
Installing pip requirements to the 'python-test' site.
Using Python 3.11.7 environment at: C:\Users\elvis\.mozbuild\srcdirs\mozilla-central-1f60a787181c\_virtualenvs\python-test
error: In `--require-hashes` mode, all requirements must be pinned upfront with `==`, but found: `colorama`

I am not sure which requirements files are used to generate all of this, I assume colorama is from wpt:
https://searchfox.org/mozilla-central/search?q=colorama&path=*.in&case=false&regexp=false