1840271 - mach bootstrap fails to download macOS SDK

Status: RESOLVED DUPLICATE of bug 1840457

(Firefox Build System :: Bootstrap Configuration, defect)

Description

[Gary Kwong [:gkw] [:nth10sd] (NOT official MoCo now)]

I try running ./mach bootstrap --app=js on macOS Ventura 13.4.1 and m-c rev 36c126e25c92d545306d4b0174a639510b4def1f and it fails:

Site not up-to-date reason: "/Users/p2m/trees/mozilla-central/obj-aarch64-apple-darwin22.5.0/_virtualenvs/build" does not exist
Traceback (most recent call last):
  File "/Users/p2m/trees/mozilla-central/taskcluster/scripts/misc/unpack-sdk.py", line 103, in <module>
    unpack_sdk(*sys.argv[1:])
  File "/Users/p2m/trees/mozilla-central/taskcluster/scripts/misc/unpack-sdk.py", line 24, in unpack_sdk
    with urlopen(url) as fh:
         ^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 525, in open
    response = meth(req, response)
               ^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 634, in http_response
    response = self.parent.error(
               ^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 563, in error
    return self._call_chain(*args)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 496, in _call_chain
    result = func(*args)
             ^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.4/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

I then trace it to the URL here:

https://hg.mozilla.org/mozilla-central/file/tip/taskcluster/ci/toolchain/macos-sdk.yml#l27

and it seems that we hit this same 403 error while downloading the CLTools_macOSNMOS_SDK.pkg file on any CLI tool (aria2c, curl, wget) even though I set a User Agent and/or a referer. However, downloading via the browser on macOS/Windows works properly.

This used to work previously, but I went back to an earlier working rev to run mach, but that one also failed this time. So maybe something on the remote side?

:glandium, any ideas?

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Firefox Build System::Bootstrap Configuration' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[Boris Chiou [:boris]]

Perhaps this is related to Bug 1831491.