1659728 - unable to run `./mach bootstrap`

Status: RESOLVED DUPLICATE of bug 1659602

(Firefox Build System :: Mach Core, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

$ ./mach bootstrap

Note on Artifact Mode:

Artifact builds download prebuilt C++ components rather than building
them locally. Artifact builds are faster!

Artifact builds are recommended for people working on Firefox or
Firefox for Android frontends, or the GeckoView Java API. They are unsuitable
for those working on C++ code. For more information see:
https://developer.mozilla.org/en-US/docs/Artifact_builds.

Please choose the version of Firefox you want to build:

1. Firefox for Desktop Artifact Mode
2. Firefox for Desktop
3. GeckoView/Firefox for Android Artifact Mode
4. GeckoView/Firefox for Android
   Your choice: 1
   Your version of Python 3 (3.6.5) is new enough.
   Your version of Python 2 (2.7.15) is new enough.
   Your version of Mercurial (4.9.1) is sufficiently modern.
   Warning: the Firefox checkout directory is currently not in the Windows Defender exclusion list. This can cause the build process to be dramatically slowed or broken. To resolve this, follow the directions here: https://firefox-source-docs.mozilla.org/setup/windows_build.html#antivirus-performance

Mozilla recommends a number of changes to Mercurial to enhance your
experience with it.

Would you like to run a configuration wizard to ensure Mercurial is
optimally configured? (Yn): n
Error running mach:

['artifact', 'toolchain', '--bootstrap', '--from-build', 'win64-node']

The error occurred in code that was called by the mach command. This is either
a bug in the called code itself or in the way that mach is calling it.
You can invoke |./mach busted| to check if this issue is already on file. If it
isn't, please use |./mach busted file artifact| to report it. If |./mach busted| is
misbehaving, you can also inspect the dependencies of bug 1543241.

If filing a bug, please include the full output of mach, including this error
message.

The details of the failure are as follows:

TypeError: a bytes-like object is required, not 'str'

File "c:\Users\elvis\mozilla-central\python/mozbuild/mozbuild/artifact_commands.py", line 311, in artifact_toolchain
toolchains = load_tasks_for_kind(params, 'toolchain', root_dir=root_dir)
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 431, in load_tasks_for_kind
for task in tgg.full_task_set
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 153, in full_task_set
return self._run_until('full_task_set')
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 375, in _run_until
k, v = next(self.run)
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 279, in run
parameters, list(all_tasks.values()), self.write_artifacts,
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 82, in load_tasks
for task_dict in transforms(trans_config, inputs)]
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\generator.py", line 72, in <listcomp>
tasks = [Task(self.name,
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1971, in check_run_task_caches
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1889, in check_task_dependencies
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1877, in check_task_identifiers
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1860, in chain_of_trust
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1694, in build_task
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1685, in try_task_config_routes
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1675, in try_task_config_chemspill_prio
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1665, in try_task_config_env
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1630, in add_index_routes
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1435, in validate
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1412, in task_name_from_label
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1372, in set_defaults
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\task.py", line 1351, in set_implementation
for task in tasks:
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\cached_tasks.py", line 61, in cache_task
for task in order_tasks(config, tasks):
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\cached_tasks.py", line 22, in order_tasks
pending = deque(tasks)
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\job_init.py", line 369, in make_task_description
configure_taskdesc_for_run(config, job, taskdesc, job['worker']['implementation'])
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\job_init.py", line 429, in configure_taskdesc_for_run
func(config, job, taskdesc)
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\job\toolchain.py", line 155, in docker_worker_toolchain
'digest-data': get_digest_data(config, run, taskdesc),
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\transforms\job\toolchain.py", line 85, in get_digest_data
data = [hash_paths(GECKO, files)]
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\util\hash.py", line 38, in hash_paths
finder = get_file_finder(base_path)
File "c:\Users\elvis\mozilla-central\python/mozbuild\mozbuild\util.py", line 1009, in call
self[args] = self.func(*args)
File "c:\Users\elvis\mozilla-central\taskcluster\taskgraph\util\hash.py", line 26, in get_file_finder
return get_repository_object(base_path).get_tracked_files_finder()
File "c:\Users\elvis\mozilla-central\python/mozversioncontrol\mozversioncontrol_init.py", line 432, in get_tracked_files_finder
self.run(b'files', b'-0').split('\0') if p)
File "c:\Users\elvis\mozilla-central\python/mozversioncontrol\mozversioncontrol_init.py", line 332, in _run
return super(HgRepository, self).run(*args, **runargs)
File "c:\Users\elvis\mozilla-central\python/mozversioncontrol\mozversioncontrol_init.py", line 116, in _run
universal_newlines=True)
File "c:\mozilla-build\python3\lib\subprocess.py", line 336, in check_output
**kwargs).stdout
File "c:\mozilla-build\python3\lib\subprocess.py", line 403, in run
with Popen(*popenargs, **kwargs) as process:
File "c:\Users\elvis\mozilla-central\third_party/python/sentry-sdk\sentry_sdk\integrations\stdlib.py", line 190, in sentry_patched_popen_init
rv = old_popen_init(self, *a, **kw) # type: ignore
File "c:\mozilla-build\python3\lib\subprocess.py", line 709, in init
restore_signals, start_new_session)
File "c:\mozilla-build\python3\lib\subprocess.py", line 971, in _execute_child
args = list2cmdline(args)
File "c:\mozilla-build\python3\lib\subprocess.py", line 461, in list2cmdline
needquote = (" " in arg) or ("\t" in arg) or not arg
Sentry is attempting to send 0 pending error messages
Waiting up to 2 seconds
Press Ctrl-Break to quit
Error running mach:

['bootstrap']

The error occurred in code that was called by the mach command. This is either
a bug in the called code itself or in the way that mach is calling it.
You can invoke |./mach busted| to check if this issue is already on file. If it
isn't, please use |./mach busted file bootstrap| to report it. If |./mach busted| is
misbehaving, you can also inspect the dependencies of bug 1543241.

If filing a bug, please include the full output of mach, including this error
message.

The details of the failure are as follows:

subprocess.CalledProcessError: Command '['c:\mozilla-build\python3\python3.exe', 'c:\Users\elvis\mozilla-central\mach', 'artifact', 'toolchain', '--bootstrap', '--from-build', 'win64-node']' returned non-zero exit status 1.

File "c:\Users\elvis\mozilla-central\python/mozboot/mozboot/mach_commands.py", line 45, in bootstrap
bootstrapper.bootstrap()
File "c:\Users\elvis\mozilla-central\python/mozboot\mozboot\bootstrap.py", line 578, in bootstrap
checkout_root)
File "c:\Users\elvis\mozilla-central\python/mozboot\mozboot\bootstrap.py", line 421, in maybe_install_private_packages_or_exit
self.instance.ensure_node_packages(state_dir, checkout_root)
File "c:\Users\elvis\mozilla-central\python/mozboot\mozboot\mozillabuild.py", line 243, in ensure_node_packages
state_dir, checkout_root, node_artifact)
File "c:\Users\elvis\mozilla-central\python/mozboot\mozboot\base.py", line 356, in install_toolchain_artifact
subprocess.check_call(cmd, cwd=state_dir)
File "c:\mozilla-build\python3\lib\subprocess.py", line 291, in check_call
raise CalledProcessError(retcode, cmd)
Sentry is attempting to send 0 pending error messages
Waiting up to 2 seconds
Press Ctrl-Break to quit

elvis@DESKTOP-35QKDMP ~/mozilla-central
$ ./mach busted file bootstrap
which: /c/Users/elvis/.mozbuild/_virtualenvs/mach/Scripts/python: unknown command
This mach command requires /c/Users/elvis/.mozbuild/_virtualenvs/mach/Scripts/python, which wasn't found on the system!
Consider running 'mach bootstrap' or 'mach create-mach-environment' to create the mach virtualenvs, or set MACH_USE_SYSTEM_PYTHON to use the system Python installation over a virtualenv.

elvis@DESKTOP-35QKDMP ~/mozilla-central
$