Closed Bug 1734274 Opened 4 years ago Closed 3 years ago

Intermittent requests.exceptions.ConnectionError: HTTPSConnectionPool(host='firefox-ci-tc.services.mozilla.com', port=443): Max retries exceeded with url: /api/queue/v1/task/XadFWL_IQPCJIf5nhYFzRw/artifacts/public/build/target.common.tests.tar.gz (Caused

Categories

(Release Engineering :: Release Automation, defect, P5)

Product:
Release Engineering
Component:
Release Automation
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Assigned: gbrown)

Details

(Keywords: intermittent-failure)

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=353805102&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NP7X75BvSxih5x7aG4DN_Q/runs/0/artifacts/public/logs/live_backing.log

[task 2021-10-06T01:47:48.174Z] 01:47:48     INFO -  Downloading artifact to local cache: /builds/worker/.mozbuild/package-frontend/e99d13b3810df46a-target.common.tests.tar.gz
[task 2021-10-06T01:47:48.174Z] 01:47:48     INFO -  Error running mach:
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -      ['--log-no-times', 'artifact', 'install', '--symbols', '--host-bins', '-v']
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  The error occurred in code that was called by the mach command. This is either
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  a bug in the called code itself or in the way that mach is calling it.
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  isn't, please use |./mach busted file artifact| to report it. If |./mach busted| is
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  If filing a bug, please include the full output of mach, including this error
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  message.
[task 2021-10-06T01:47:48.175Z] 01:47:48     INFO -  The details of the failure are as follows:
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -  requests.exceptions.ConnectionError: HTTPSConnectionPool(host='firefox-ci-tc.services.mozilla.com', port=443): Max retries exceeded with url: /api/queue/v1/task/XadFWL_IQPCJIf5nhYFzRw/artifacts/public/build/target.common.tests.tar.gz (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fe1c237a7f0>: Failed to establish a new connection: [Errno 111] Connection refused'))
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifact_commands.py", line 195, in artifact_install
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -      return artifacts.install_from(source, distdir or command_context.distdir)
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1507, in install_from
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -      return self.install_from_task(os.environ[var], distdir)
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1485, in install_from_task
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -      if self.install_from_url(url, distdir):
[task 2021-10-06T01:47:48.176Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifacts.py", line 1373, in install_from_url
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -      filename = self._artifact_cache.fetch(url)
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/artifact_cache.py", line 218, in fetch
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -      dl.wait()
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 101, in wait
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -      self.raise_if_error()
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 116, in raise_if_error
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -      six.reraise(*self.__error)
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/six/six.py", line 696, in reraise
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -      raise value
[task 2021-10-06T01:47:48.177Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/dlmanager/dlmanager/manager.py", line 157, in _download
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -      with closing(session.get(url, stream=True)) as response:
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/sessions.py", line 555, in get
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -      return self.request('GET', url, **kwargs)
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/sessions.py", line 542, in request
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -      resp = self.send(prep, **send_kwargs)
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/sessions.py", line 655, in send
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -      r = adapter.send(request, **kwargs)
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -    File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/adapters.py", line 516, in send
[task 2021-10-06T01:47:48.178Z] 01:47:48     INFO -      raise ConnectionError(e, request=request)
[task 2021-10-06T01:47:48.179Z] 01:47:48    ERROR -  gmake[3]: *** [Makefile:126: recurse_artifact] Error 1
[task 2021-10-06T01:47:48.179Z] 01:47:48     INFO -  gmake[3]: Leaving directory '/builds/worker/workspace/obj-build'
[task 2021-10-06T01:47:48.179Z] 01:47:48    ERROR -  gmake[2]: *** [/builds/worker/checkouts/gecko/config/recurse.mk:34: artifact] Error 2
[task 2021-10-06T01:47:48.179Z] 01:47:48    ERROR -  gmake[1]: *** [/builds/worker/checkouts/gecko/config/rules.mk:358: default] Error 2
[task 2021-10-06T01:47:48.179Z] 01:47:48     INFO -  gmake: *** [client.mk:54: build] Error 2
[task 2021-10-06T01:47:48.191Z] 01:47:48     INFO -  0 compiler warnings present.
[task 2021-10-06T01:47:48.292Z] 01:47:48    ERROR - Return code: 2
[task 2021-10-06T01:47:48.292Z] 01:47:48  WARNING - setting return code to 2
[task 2021-10-06T01:47:48.292Z] 01:47:48    FATAL - 'mach build -v' did not run successfully. Please check log for errors.
[task 2021-10-06T01:47:48.292Z] 01:47:48    FATAL - Running post_fatal callback...
[task 2021-10-06T01:47:48.292Z] 01:47:48    FATAL - Exiting -1
[task 2021-10-06T01:47:48.292Z] 01:47:48     INFO - [mozharness: 2021-10-06 01:47:48.292367Z] Finished build step (failed)
Assignee: nobody → gbrown
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.