1860526 - Intermittent aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host firefoxci.taskcluster-artifacts.net:443 ssl:default [nodename nor servname provided, or not known] | socket.gaierror: [Errno 8] nodename nor servname provided, or not know

Status: RESOLVED INCOMPLETE

(Release Engineering :: Release Automation, defect, P5)

Description

[Iulian Moraru]

Failure summary is empty in treeherder. This appeared on today's beta central as early beta simulation for a BMS build(build-mac-singing) and so far, only occurred on OS X Cross Compiled debug.

• failure log
• link to failure in treeherder push

<class 'aiohttp.client_exceptions.ClientConnectorError'> Cannot connect to host firefoxci.taskcluster-artifacts.net:443 ssl:default [nodename nor servname provided, or not known]
2023-10-23T10:43:33  WARNING - retry_async: download_file: too many retries!
2023-10-23T10:43:33     INFO - Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LA6qH5-TRmiFJOxzE1RJ8A/artifacts/public%2Fchain-of-trust.json
2023-10-23T10:43:47    DEBUG -    makedirs(/builds/dep1/work/cot/H8XvnQ0rTu2KIGc-GaBxmw/./public)
2023-10-23T10:43:47     INFO - Done
2023-10-23T10:43:47    DEBUG -    makedirs(/builds/dep1/work/cot/LA6qH5-TRmiFJOxzE1RJ8A/./public)
2023-10-23T10:43:47     INFO - Done
2023-10-23T10:43:47    ERROR - SCRIPTWORKER_UNEXPECTED_EXCEPTION task Cannot connect to host firefoxci.taskcluster-artifacts.net:443 ssl:default [nodename nor servname provided, or not known]
Traceback (most recent call last):
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 1155, in _create_direct_connection
    hosts = await asyncio.shield(host_resolved)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 1155, in _create_direct_connection
    hosts = await asyncio.shield(host_resolved)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 1155, in _create_direct_connection
    hosts = await asyncio.shield(host_resolved)
  [Previous line repeated 2 more times]
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 861, in _resolve_host
    await event.wait()
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/locks.py", line 34, in wait
    raise self._exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 861, in _resolve_host
    await event.wait()
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/locks.py", line 34, in wait
    raise self._exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 861, in _resolve_host
    await event.wait()
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/locks.py", line 34, in wait
    raise self._exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 861, in _resolve_host
    await event.wait()
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/locks.py", line 34, in wait
    raise self._exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 874, in _resolve_host
    addrs = await self._resolver.resolve(host, port, family=self._family)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/resolver.py", line 33, in resolve
    infos = await self._loop.getaddrinfo(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/base_events.py", line 825, in getaddrinfo
    return await self.run_in_executor(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/socket.py", line 918, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/worker.py", line 56, in do_run_task
    await run_cancellable(verify_chain_of_trust(chain))
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/worker.py", line 157, in _run_cancellable
    result = await self.future
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/cot/verify.py", line 2019, in verify_chain_of_trust
    await download_cot(chain)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/cot/verify.py", line 683, in download_cot
    artifacts_paths = await raise_future_exceptions(artifact_tasks)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 409, in raise_future_exceptions
    succeeded_results, _ = await _process_future_exceptions(tasks, raise_at_first_error=True)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 443, in _process_future_exceptions
    raise exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/artifacts.py", line 294, in download_artifacts
    await raise_future_exceptions(tasks)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 409, in raise_future_exceptions
    succeeded_results, _ = await _process_future_exceptions(tasks, raise_at_first_error=True)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 443, in _process_future_exceptions
    raise exc
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 955, in semaphore_wrapper
    return await coro
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 273, in retry_async
    _check_number_of_attempts(attempt, attempts, func, "retry_async")
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 268, in retry_async
    return await func(*args, **kwargs)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/scriptworker-48.5.0-py3.8.egg/scriptworker/utils.py", line 667, in download_file
    async with session.get(url, auth=auth) as resp:
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/client.py", line 1141, in __aenter__
    self._resp = await self._coro
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/client.py", line 536, in _request
    conn = await self._connector.connect(
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 540, in connect
    proto = await self._create_connection(req, traces, timeout)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 901, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
  File "/builds/dep1/virtualenv/lib/python3.8/site-packages/aiohttp/connector.py", line 1169, in _create_direct_connection
    raise ClientConnectorError(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host firefoxci.taskcluster-artifacts.net:443 ssl:default [nodename nor servname provided, or not known]
2023-10-23T10:43:47    DEBUG -    "/builds/dep1/artifacts/public/logs/chain_of_trust.log" is encoded with "None" and has mime/type "text/plain"
2023-10-23T10:43:47     INFO - "/builds/dep1/artifacts/public/logs/chain_of_trust.log" can be gzip'd. Compressing...

Comment 1

[Intermittent Failures Robot]

1 failures in 3657 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• osx-cross: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860526&startday=2023-10-23&endday=2023-10-29&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.