1802693 - firefox-esr91 bootstrap failed

Status: RESOLVED WONTFIX

(Firefox Build System :: Bootstrap Configuration, defect, P3)

Description

[Ronny]

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:107.0) Gecko/20100101 Firefox/107.0

Steps to reproduce:

git checkout esr91
./mach bootstrap --application-choice js

Actual results:

Bootstrapping failed with the following error (shorten):

couchdb@DESKTOP-UO5L8MA /c/relax/gecko-dev
$ ./mach bootstrap --application-choice js
Your version of Python 3 (3.9.10) is new enough.
WARNING: Your version of Python 2 (None) is not new enough. You must have Python >= 2.7.3 to build Firefox. Python 2 is not required to build, so we will proceed. However, Python 2 is required for other development tasks, like running tests; you may like to have Python 2 installed for that reason.
Python is provided by MozillaBuild; ensure your MozillaBuild installation is up to date.

The Firefox build system and related tools store shared, persistent state
in a common directory on the filesystem. On this machine, that directory
is:

  C:\Users\couchdb/.mozbuild

If you would like to use a different directory, hit CTRL+c and set the
MOZBUILD_STATE_PATH environment variable to the directory you'd like to
use and re-run the bootstrapper.

Would you like to create this directory? (Yn): Y
Creating global state directory: C:\Users\couchdb/.mozbuild

WARNING! You appear to be running `mach bootstrap` from an old revision.
bootstrap is meant primarily for getting developer environments up-to-date to
build the latest version of tree. Running bootstrap on old revisions may fail
and is not guaranteed to bring your machine to any working state in particular.
Proceed at your own peril.

created virtual environment CPython3.9.10.final.0-64 in 10326ms
  creator CPython3Windows(dest=C:\Users\couchdb\.mozbuild\_virtualenvs\mach, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\couchdb\AppData\Local\pypa\virtualenv)
    added seed packages: pip==20.3.1, setuptools==51.0.0, wheel==0.36.1
  activators BashActivator,BatchActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
Collecting psutil==5.8.0
  Using cached psutil-5.8.0-cp39-cp39-win_amd64.whl (246 kB)
Installing collected packages: psutil
Successfully installed psutil-5.8.0
Collecting zstandard==0.15.2
  Downloading zstandard-0.15.2-cp39-cp39-win_amd64.whl (582 kB)
     |████████████████████████████████| 582 kB 1.3 MB/s
Installing collected packages: zstandard
Successfully installed zstandard-0.15.2
Collecting appdirs==1.4.4
  Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Collecting attrs==20.3.0
  Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Collecting cffi==1.14.4
  Downloading cffi-1.14.4-cp39-cp39-win_amd64.whl (179 kB)
     |████████████████████████████████| 179 kB 1.3 MB/s
Collecting click==7.1.2
  Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Collecting diskcache==5.1.0
  Using cached diskcache-5.1.0-py3-none-any.whl (44 kB)
Collecting glean-parser==2.5.0
  Using cached glean_parser-2.5.0-py3-none-any.whl (73 kB)
Collecting glean_sdk==36.0.0
  Using cached glean_sdk-36.0.0-py3-none-win_amd64.whl (2.7 MB)
Collecting importlib-metadata==3.7.0
  Using cached importlib_metadata-3.7.0-py3-none-any.whl (11 kB)
Collecting iso8601==0.1.14
  Using cached iso8601-0.1.14-py2.py3-none-any.whl (9.5 kB)
Collecting jinja2==2.11.2
  Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting jsonschema==3.2.0
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Requirement already satisfied: setuptools in c:\users\couchdb\.mozbuild\_virtualenvs\mach\lib\site-packages (from jsonschema==3.2.0->-r C:/relax/gecko-dev\build\glean_requirements.txt (line 87)) (51.0.0)
Collecting markupsafe==1.1.1
  Downloading MarkupSafe-1.1.1.tar.gz (19 kB)
Collecting pathspec==0.8.1
  Using cached pathspec-0.8.1-py2.py3-none-any.whl (28 kB)
Collecting pycparser==2.20
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting pyrsistent==0.17.3
  Using cached pyrsistent-0.17.3.tar.gz (106 kB)
Collecting pyyaml==5.3.1
  Downloading PyYAML-5.3.1-cp39-cp39-win_amd64.whl (212 kB)
     |████████████████████████████████| 212 kB 1.3 MB/s
Collecting six==1.15.0
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting typing-extensions==3.7.4.3
  Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting yamllint==1.26.0
  Using cached yamllint-1.26.0-py2.py3-none-any.whl (60 kB)
Requirement already satisfied: setuptools in c:\users\couchdb\.mozbuild\_virtualenvs\mach\lib\site-packages (from jsonschema==3.2.0->-r C:/relax/gecko-dev\build\glean_requirements.txt (line 87)) (51.0.0)
Collecting zipp==3.4.0
  Using cached zipp-3.4.0-py3-none-any.whl (5.2 kB)
Building wheels for collected packages: markupsafe, pyrsistent
  Building wheel for markupsafe (setup.py) ... done
  Created wheel for markupsafe: filename=MarkupSafe-1.1.1-cp39-cp39-win_amd64.whl size=19700 sha256=1d3f5a29da148dc0e85682b7466657b409b95d4d47d219a51b73deb7a027a5d8
  Stored in directory: c:\users\couchdb\appdata\local\pip\cache\wheels\e0\19\6f\6ba857621f50dc08e084312746ed3ebc14211ba30037d5e44e
  Building wheel for pyrsistent (setup.py) ... done
  Created wheel for pyrsistent: filename=pyrsistent-0.17.3-cp39-cp39-win_amd64.whl size=70738 sha256=d49572b70207d13d5ced057247e46ba5263d40be673dee5c3e3f9b6318e58326
  Stored in directory: c:\users\couchdb\appdata\local\pip\cache\wheels\00\cc\12\e712d3979a4aeee423b34a832d97c803e1a67659060315a7e0
Successfully built markupsafe pyrsistent
Installing collected packages: six, pyyaml, pyrsistent, pathspec, markupsafe, attrs, yamllint, pycparser, jsonschema, jinja2, diskcache, click, appdirs, zipp, glean-parser, cffi, typing-extensions, iso8601, importlib-metadata, glean-sdk
Successfully installed appdirs-1.4.4 attrs-20.3.0 cffi-1.14.4 click-7.1.2 diskcache-5.1.0 glean-parser-2.5.0 glean-sdk-36.0.0 importlib-metadata-3.7.0 iso8601-0.1.14 jinja2-2.11.2 jsonschema-3.2.0 markupsafe-1.1.1 pathspec-0.8.1 pycparser-2.20 pyrsistent-0.17.3 pyyaml-5.3.1 six-1.15.0 typing-extensions-3.7.4.3 yamllint-1.26.0 zipp-3.4.0
Mach environment created.
Your version of Mercurial (6.2.3) is sufficiently modern.
Could not find a Rust compiler.
Will try to install Rust.
Downloading rustup-init... Ok
Running rustup-init...
info: profile set to 'default'
info: setting default host triple to x86_64-pc-windows-msvc
info: syncing channel updates for 'stable-x86_64-pc-windows-msvc'
info: latest update on 2022-11-03, rust version 1.65.0 (897e37553 2022-11-02)
info: downloading component 'cargo'
info: downloading component 'clippy'
info: downloading component 'rust-docs'
info: downloading component 'rust-std'
info: downloading component 'rustc'
info: downloading component 'rustfmt'
info: installing component 'cargo'
info: using up to 500.0 MiB of RAM to unpack components
info: installing component 'clippy'
info: installing component 'rust-docs'
info: installing component 'rust-std'
info: installing component 'rustc'
info: installing component 'rustfmt'
info: default toolchain set to 'stable-x86_64-pc-windows-msvc'

  stable-x86_64-pc-windows-msvc installed - rustc 1.65.0 (897e37553 2022-11-02)


Rust is installed now. Great!

To get started you need Cargo's bin directory (%USERPROFILE%\.cargo\bin) in
your PATH environment variable. Future applications will automatically
have the correct environment, but you may need to restart your current shell.

Rust installation complete. You should now have rustc and cargo
in /C/Users/couchdb/.cargo/bin

The installer tries to add these to your default shell PATH, so
restarting your shell and running this script again may work.
If it doesn't, you'll need to add the new command location
manually.

If restarting doesn't work, edit your shell initialization
script, which may be called ~/.bashrc or ~/.bash_profile or
~/.profile, and add the following line:

    export PATH=/C/Users/couchdb/.cargo/bin:$PATH

Then restart your shell and run the bootstrap script again.


Mozilla recommends using git-cinnabar to work with mozilla-central (or
mozilla-unified).

Would you like to run a few configuration steps to ensure Git is
optimally configured? (Yn): Y
================================================================================
Ensuring https://github.com/glandium/git-cinnabar.git is up to date at C:\Users\couchdb/.mozbuild\git-cinnabar
Cloning into 'C:\Users\couchdb/.mozbuild\git-cinnabar'...
remote: Enumerating objects: 15119, done.
remote: Counting objects: 100% (489/489), done.
remote: Compressing objects: 100% (212/212), done.
remote: Total 15119 (delta 302), reused 368 (delta 267), pack-reused 14630
Receiving objects: 100% (15119/15119), 4.21 MiB | 1.34 MiB/s, done.
Resolving deltas: 100% (11298/11298), done.

Your branch is up to date with 'origin/master'.
================================================================================
git: 'cinnabar' is not a git command. See 'git --help'.
Command '['C:\\Program Files\\Git\\cmd\\git.EXE', 'cinnabar', 'download']' returned non-zero exit status 1.

To add git-cinnabar to the PATH, edit your shell initialization script, which
may be called ~/.bashrc or ~/.bash_profile or ~/.profile, and add the following
lines:

    export PATH="C:\Users\couchdb/.mozbuild\git-cinnabar:$PATH"

Then restart your shell.

 0:09.11 ERROR!!!!!! Could not find artifacts for a toolchain build named `win64-node`. Local commits, dirty/stale files, and other changes in your checkout may cause this error. Make sure you are on a fresh, current checkout of mozilla-central. Beware that commands like `mach bootstrap` and `mach artifact` are unlikely to work on any versions of the code besides recent revisions of mozilla-central.
Error running mach:

    ['bootstrap', '--application-choice', 'js']

The error occurred in code that was called by the mach command. This is either
a bug in the called code itself or in the way that mach is calling it.
You can invoke |./mach busted| to check if this issue is already on file. If it
isn't, please use |./mach busted file bootstrap| to report it. If |./mach busted| is
misbehaving, you can also inspect the dependencies of bug 1543241.

If filing a bug, please include the full output of mach, including this error
message.

The details of the failure are as follows:

subprocess.CalledProcessError: Command '['C:\\Users\\couchdb/.mozbuild\\_virtualenvs\\mach\\Scripts\\python.exe', 'C:\\relax\\gecko-dev\\mach', 'artifact', 'toolchain', '--bootstrap', '--from-build', 'win64-node']' returned non-zero exit status 1.

  File "C:\relax\gecko-dev\python/mozboot/mozboot/mach_commands.py", line 55, in bootstrap
    bootstrapper.bootstrap(self.settings)
  File "C:\relax\gecko-dev\python/mozboot\mozboot\bootstrap.py", line 389, in bootstrap
    self.maybe_install_private_packages_or_exit(state_dir, checkout_root)
  File "C:\relax\gecko-dev\python/mozboot\mozboot\bootstrap.py", line 258, in maybe_install_private_packages_or_exit
    self.instance.ensure_node_packages(state_dir, checkout_root)
  File "C:\relax\gecko-dev\python/mozboot\mozboot\mozillabuild.py", line 229, in ensure_node_packages
    self.install_toolchain_artifact(state_dir, checkout_root, node_artifact)
  File "C:\relax\gecko-dev\python/mozboot\mozboot\base.py", line 417, in install_toolchain_artifact
    subprocess.check_call(cmd, cwd=state_dir)
  File "C:\mozilla-build\python3\lib\subprocess.py", line 373, in check_call
    raise CalledProcessError(retcode, cmd)

Expected results:

Setting up bootstrap environment correctly.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Firefox Build System::Bootstrap Configuration' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[Alex Hochheiden [:ahochheiden]]

This is probably due to recent changes with git-cinnabar but not being on up-to-date central. Not sure on the best way to resolve. :Glandium probably has a better idea.

Comment 3

[Mike Hommey [:glandium]]

Bug 1769680 preemptively addressed this in 102. There's nothing we can do for 91.