Closed Bug 1789770 Opened 3 years ago Closed 3 years ago

Intermittent requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://firefoxci.taskcluster-artifacts.net/Y9jXBmwvSZ2slUiMBCSN7w/0/public/build/target.crashreporter-symbols.zip

Categories

(Firefox Build System :: General, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: ccozmuta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=389812137&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a5c6zebITtWu1Tp9f57lGA/runs/0/artifacts/public/logs/live_backing.log


[task 2022-09-08T02:10:03.551Z] 02:10:03     INFO -  Installing from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Y9jXBmwvSZ2slUiMBCSN7w/artifacts/public/build/target.crashreporter-symbols.zip
[task 2022-09-08T02:10:03.551Z] 02:10:03     INFO -  Downloading artifact to local cache: /builds/worker/.mozbuild/package-frontend/b3229a19983b62ad-target.crashreporter-symbols.zip
[task 2022-09-08T02:10:03.551Z] 02:10:03     INFO -  Error running mach:
[task 2022-09-08T02:10:03.551Z] 02:10:03     INFO -      ['--log-no-times', 'artifact', 'install', '--symbols', '-v']
[task 2022-09-08T02:10:03.551Z] 02:10:03     INFO -  The error occurred in code that was called by the mach command. This is either
[task 2022-09-08T02:10:03.552Z] 02:10:03     INFO -  a bug in the called code itself or in the way that mach is calling it.
[task 2022-09-08T02:10:03.552Z] 02:10:03     INFO -  You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2022-09-08T02:10:03.552Z] 02:10:03     INFO -  isn't, please use |./mach busted file artifact| to report it. If |./mach busted| is
[task 2022-09-08T02:10:03.552Z] 02:10:03     INFO -  misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2022-09-08T02:10:03.553Z] 02:10:03     INFO -  If filing a bug, please include the full output of mach, including this error
[task 2022-09-08T02:10:03.553Z] 02:10:03     INFO -  message.
[task 2022-09-08T02:10:03.553Z] 02:10:03     INFO -  The details of the failure are as follows:
[task 2022-09-08T02:10:03.553Z] 02:10:03     INFO -  requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://firefoxci.taskcluster-artifacts.net/Y9jXBmwvSZ2slUiMBCSN7w/0/public/build/target.crashreporter-symbols.zip
[task 2022-09-08T02:10:03.553Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifact_commands.py", line 188, in artifact_install
[task 2022-09-08T02:10:03.554Z] 02:10:03     INFO -      return artifacts.install_from(source, distdir or command_context.distdir)
[task 2022-09-08T02:10:03.554Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1578, in install_from
[task 2022-09-08T02:10:03.554Z] 02:10:03     INFO -      return self.install_from_task(os.environ[var], distdir)
[task 2022-09-08T02:10:03.554Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1547, in install_from_task
[task 2022-09-08T02:10:03.554Z] 02:10:03     INFO -      if self.install_from_url(url, distdir):
[task 2022-09-08T02:10:03.555Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1435, in install_from_url
[task 2022-09-08T02:10:03.555Z] 02:10:03     INFO -      filename = self._artifact_cache.fetch(url)
[task 2022-09-08T02:10:03.555Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifact_cache.py", line 218, in fetch
[task 2022-09-08T02:10:03.555Z] 02:10:03     INFO -      dl.wait()
[task 2022-09-08T02:10:03.556Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 101, in wait
[task 2022-09-08T02:10:03.556Z] 02:10:03     INFO -      self.raise_if_error()
[task 2022-09-08T02:10:03.556Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 116, in raise_if_error
[task 2022-09-08T02:10:03.556Z] 02:10:03     INFO -      six.reraise(*self.__error)
[task 2022-09-08T02:10:03.556Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/six/six.py", line 696, in reraise
[task 2022-09-08T02:10:03.557Z] 02:10:03     INFO -      raise value
[task 2022-09-08T02:10:03.557Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 175, in _download
[task 2022-09-08T02:10:03.557Z] 02:10:03     INFO -      response.raise_for_status()
[task 2022-09-08T02:10:03.557Z] 02:10:03     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/models.py", line 943, in raise_for_status
[task 2022-09-08T02:10:03.557Z] 02:10:03     INFO -      raise HTTPError(http_error_msg, response=self)
[task 2022-09-08T02:10:03.558Z] 02:10:03    ERROR -  gmake[3]: *** [Makefile:122: recurse_artifact] Error 1
[task 2022-09-08T02:10:03.558Z] 02:10:03     INFO -  gmake[3]: Leaving directory '/builds/worker/workspace/obj-build'
[task 2022-09-08T02:10:03.558Z] 02:10:03    ERROR -  gmake[2]: *** [/builds/worker/checkouts/gecko/config/recurse.mk:34: artifact] Error 2
[task 2022-09-08T02:10:03.558Z] 02:10:03    ERROR -  gmake[1]: *** [/builds/worker/checkouts/gecko/config/rules.mk:361: default] Error 2
[task 2022-09-08T02:10:03.559Z] 02:10:03     INFO -  gmake: *** [client.mk:63: build] Error 2
[task 2022-09-08T02:10:03.559Z] 02:10:03     INFO -  0 compiler warnings present.
[task 2022-09-08T02:10:03.660Z] 02:10:03    ERROR - Return code: 2
[task 2022-09-08T02:10:03.660Z] 02:10:03  WARNING - setting return code to 2
[task 2022-09-08T02:10:03.660Z] 02:10:03    FATAL - 'mach build -v' did not run successfully. Please check log for errors.
[task 2022-09-08T02:10:03.660Z] 02:10:03    FATAL - Running post_fatal callback...
[task 2022-09-08T02:10:03.660Z] 02:10:03    FATAL - Exiting -1
[task 2022-09-08T02:10:03.660Z] 02:10:03     INFO - [mozharness: 2022-09-08 02:10:03.660596Z] Finished build step (failed)
[task 2022-09-08T02:10:03.660Z] 02:10:03     INFO - Running post-run listener: _parse_build_tests_ccov
[task 2022-09-08T02:10:03.661Z] 02:10:03     INFO - Running command: ['/builds/worker/workspace/obj-build/_virtualenvs/common/bin/python', 'mach', 'python', 'testing/parse_build_tests_ccov.py'] in /builds/worker/checkouts/gecko
[task 2022-09-08T02:10:03.661Z] 02:10:03     INFO - Copy/paste: /builds/worker/workspace/obj-build/_virtualenvs/common/bin/python mach python testing/parse_build_tests_ccov.py
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO - Using env: {'ACCEPTED_MAR_CHANNEL_IDS': 'firefox-mozilla-central',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'DEBIAN_FRONTEND': 'noninteractive',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'DISPLAY': ':2',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'EXTRA_MOZHARNESS_CONFIG': '{"mozconfig_platform": "win64-aarch64", '
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -                             '"mozconfig_variant": "nightly", "objdir": '
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -                             '"obj-build", "stage_platform": "win64-aarch64"}',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'GECKO_BASE_REPOSITORY': 'https://hg.mozilla.org/mozilla-unified',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/integration/autoland',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'GECKO_HEAD_REV': '2df511a16e4194617632cce3f261312c8e068620',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'GECKO_PATH': '/builds/worker/checkouts/gecko',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'GRCOV_PATH': '/builds/worker/fetches/grcov',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'HG_SHARE_BASE_DIR': '/builds/hg-shared',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'HG_STORE_PATH': '/builds/worker/checkouts/hg-store',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'HOME': '/builds/worker',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'HOSTNAME': 'taskcluster-worker',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'LC_ALL': 'C',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'LC_CTYPE': 'C.UTF-8',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'LOGNAME': 'worker',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MACH_BUILD_PYTHON_NATIVE_PACKAGE_SOURCE': 'system',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MACH_MAIN_PID': '21',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MACH_SYSTEM_ASSERTED_COMPATIBLE_WITH_COMMON_SITE': '1',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MACH_SYSTEM_ASSERTED_COMPATIBLE_WITH_MACH_SITE': '1',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MAR_CHANNEL_ID': 'firefox-mozilla-central',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MH_BRANCH': 'autoland',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MH_BUILD_POOL': 'taskcluster',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZBUILD_STATE_PATH': '/builds/worker/.mozbuild',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZHARNESS_ACTIONS': 'get-secrets build',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZHARNESS_CONFIG': 'builds/releng_base_firefox.py '
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -                       'builds/releng_base_linux_64_builds.py',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZHARNESS_OPTIONS': 'append-env-variables-from-configs',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZHARNESS_SCRIPT': 'mozharness/scripts/fx_desktop_build.py',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZ_ARTIFACT_TASK': 'Y9jXBmwvSZ2slUiMBCSN7w',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZ_ARTIFACT_TASK_WIN32_OPT': 'UitTVOqmS1iBh8RFyz1Xxg',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZ_AUTOMATION': '1',
[task 2022-09-08T02:10:03.662Z] 02:10:03     INFO -  'MOZ_BUILD_DATE': '20220908014245',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_CRASHREPORTER_NO_REPORT': '1',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_FETCHES': '[{"artifact": "project/gecko/pdbstr/pdbstr.tar.zst", '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"extract": true, "task": "esCuHH-0Ss-40ZwkDmkbvg"}, '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '{"artifact": "public/build/node.tar.zst", "extract": true, '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"task": "fhMO3qudRCG6hk4UeroGlw"}, {"artifact": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"public/build/nsis.tar.zst", "extract": true, "task": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"A73BXAzTQT2c8o3hritB2g"}, {"artifact": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"public/build/wine.tar.zst", "extract": true, "task": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"SAtgAC8RTueR7fXJe4WzXg"}, {"artifact": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"public/upx-3.95-win64.zip", "extract": true, "task": '
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -                 '"MUaCxPyeRtmTIiRr5_TKKQ"}]',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_FETCHES_DIR': '/builds/worker/fetches',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_OBJDIR': '/builds/worker/workspace/obj-build',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_SCM_LEVEL': '3',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_SIMPLE_PACKAGE_NAME': 'target',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_SOURCE_CHANGESET': '2df511a16e4194617632cce3f261312c8e068620',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'MOZ_SOURCE_REPO': 'https://hg.mozilla.org/integration/autoland',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'NEED_XVFB': 'false',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'OLDPWD': '/builds/worker',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'PATH': '/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'PERFHERDER_EXTRA_OPTIONS': 'aarch64-eme',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'PWD': '/builds/worker',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'PYTHONDONTWRITEBYTECODE': '1',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'PYTHONUNBUFFERED': '1',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'REQUIRE_GPU': '0',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'RUN_ID': '0',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'SCCACHE_DISABLE': '1',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'SHELL': '/bin/bash',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'SHLVL': '1',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'TASKCLUSTER_INSTANCE_TYPE': 'projects/970387039909/machineTypes/n2-custom-16-73728',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'TASKCLUSTER_NAME': '/youthful_elbakyan/taskcluster',
[task 2022-09-08T02:10:03.663Z] 02:10:03     INFO -  'TASKCLUSTER_PORT': 'tcp://172.17.0.2:80',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PORT_80_TCP': 'tcp://172.17.0.2:80',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PORT_80_TCP_ADDR': '172.17.0.2',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PORT_80_TCP_PORT': '80',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PORT_80_TCP_PROTO': 'tcp',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PROXY_URL': 'http://taskcluster',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_PUBLIC_IP': '34.173.51.247',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_WORKER_GROUP': 'us-central1',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_WORKER_LOCATION': '{"cloud":"google","region":"us-central1","zone":"us-central1-b"}',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_WORKER_POOL': 'gecko-3/b-linux-gcp',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASKCLUSTER_WORKER_TYPE': 'b-linux-gcp',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TASK_ID': 'a5c6zebITtWu1Tp9f57lGA',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TERM': 'xterm',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TINDERBOX_OUTPUT': '1',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TOOLTOOL_CACHE': '/builds/worker/tooltool-cache',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'TOOLTOOL_HOME': '/builds',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'UPLOAD_DIR': '/builds/worker/artifacts',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'USER': 'worker',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'USE_ARTIFACT': '1',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'WORKSPACE': '/builds/worker/workspace',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  'XZ_OPT': '-T0',
[task 2022-09-08T02:10:03.664Z] 02:10:03     INFO -  '_': '/builds/worker/checkouts/gecko/mach'}
[task 2022-09-08T02:10:04.723Z] 02:10:04     INFO - Return code: 0
[task 2022-09-08T02:10:04.723Z] 02:10:04     INFO - Running post-run listener: _summarize
[task 2022-09-08T02:10:04.724Z] 02:10:04    ERROR - # TBPL FAILURE #
[task 2022-09-08T02:10:04.724Z] 02:10:04     INFO - [mozharness: 2022-09-08 02:10:04.724033Z] FxDesktopBuild summary:
[task 2022-09-08T02:10:04.724Z] 02:10:04    ERROR - # TBPL FAILURE #
[taskcluster 2022-09-08 02:10:08.749Z] === Task Finished ===
[taskcluster 2022-09-08 02:10:09.181Z] Unsuccessful task run with exit code: 255 completed in 50.222 seconds
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.