Closed Bug 1720121 Opened 3 years ago Closed 3 years ago

Uncaught exception: Traceback (most recent call last): Finished get-secrets step (failed) | URLError: <urlopen error> socket.gaierror: [Errno 11001] getaddrinfo failed

Categories

(Release Engineering :: General, defect)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: noemi_erli, Unassigned)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell unknown])

Summary: [mozharness] Finished get-secrets step (failed) → [mozharness] Finished get-secrets step (failed) | URLError: <urlopen error [Errno 11001] getaddrinfo failed>

This looks like DNS issues to me. The traceback is:
[task 2021-07-12T10:00:19.642Z] 10:00:19 FATAL - Uncaught exception: Traceback (most recent call last):
[task 2021-07-12T10:00:19.642Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 1318, in do_open
[task 2021-07-12T10:00:19.642Z] 10:00:19 FATAL - encode_chunked=req.has_header('Transfer-encoding'))
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1239, in request
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - self._send_request(method, url, body, headers, encode_chunked)
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1285, in _send_request
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - self.endheaders(body, encode_chunked=encode_chunked)
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1234, in endheaders
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - self._send_output(message_body, encode_chunked=encode_chunked)
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1026, in _send_output
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - self.send(msg)
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 964, in send
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - self.connect()
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 936, in connect
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - (self.host,self.port), self.timeout, self.source_address)
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\socket.py", line 704, in create_connection
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - for res in getaddrinfo(host, port, 0, SOCK_STREAM):
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - File "c:\mozilla-build\python3\lib\socket.py", line 745, in getaddrinfo
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
[task 2021-07-12T10:00:19.643Z] 10:00:19 FATAL - socket.gaierror: [Errno 11001] getaddrinfo failed

I don't think there's anything actionable for us to do; it's most likely an AWS issue.

Summary: [mozharness] Finished get-secrets step (failed) | URLError: <urlopen error [Errno 11001] getaddrinfo failed> → Uncaught exception: Traceback (most recent call last): Finished get-secrets step (failed) | URLError: <urlopen error> socket.gaierror: [Errno 11001] getaddrinfo failed

There are 67 total failures in the last 7 days on

[task 2021-07-16T05:09:57.405Z] 05:09:57 INFO - fetching secret project/releng/gecko/build/level-3/gls-gapi.data from API
[task 2021-07-16T05:09:59.773Z] 05:09:59 INFO - [mozharness: 2021-07-16 05:09:59.773571Z] Finished get-secrets step (failed)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - Uncaught exception: Traceback (most recent call last):
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 1318, in do_open
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - encode_chunked=req.has_header('Transfer-encoding'))
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1239, in request
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self._send_request(method, url, body, headers, encode_chunked)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1285, in _send_request
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self.endheaders(body, encode_chunked=encode_chunked)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1234, in endheaders
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self._send_output(message_body, encode_chunked=encode_chunked)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 1026, in _send_output
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self.send(msg)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 964, in send
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self.connect()
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\http\client.py", line 936, in connect
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - (self.host,self.port), self.timeout, self.source_address)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\socket.py", line 704, in create_connection
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - for res in getaddrinfo(host, port, 0, SOCK_STREAM):
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\socket.py", line 745, in getaddrinfo
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - socket.gaierror: [Errno 11001] getaddrinfo failed
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL -
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - During handling of the above exception, another exception occurred:
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL -
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - Traceback (most recent call last):
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "z:\build\build\src\testing\mozharness\mozharness\base\script.py", line 2358, in run
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self.run_action(action)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "z:\build\build\src\testing\mozharness\mozharness\base\script.py", line 2292, in run_action
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - self._possibly_run_method(method_name, error_if_missing=True)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "z:\build\build\src\testing\mozharness\mozharness\base\script.py", line 2244, in _possibly_run_method
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - return getattr(self, method_name)()
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "z:\build\build\src\testing\mozharness\mozharness\mozilla\secrets.py", line 75, in get_secrets
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - secret = self._fetch_secret(secret_name)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "z:\build\build\src\testing\mozharness\mozharness\mozilla\secrets.py", line 24, in _fetch_secret
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - res = urllib.request.urlopen(url)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 223, in urlopen
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - return opener.open(url, data, timeout)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 526, in open
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - response = self._open(req, data)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 544, in _open
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - '_open', req)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 504, in _call_chain
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - result = func(*args)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 1346, in http_open
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - return self.do_open(http.client.HTTPConnection, req)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - File "c:\mozilla-build\python3\lib\urllib\request.py", line 1320, in do_open
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - raise URLError(err)
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - urllib.error.URLError: <urlopen error [Errno 11001] getaddrinfo failed>
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - Running post_fatal callback...
[task 2021-07-16T05:09:59.774Z] 05:09:59 ERROR - setting return code to 2 because fatal was called
[task 2021-07-16T05:09:59.774Z] 05:09:59 WARNING - setting return code to 2
[task 2021-07-16T05:09:59.774Z] 05:09:59 FATAL - Exiting -1

Whiteboard: [stockwell needswork:owner]
Flags: needinfo?(mtabara)
Component: Applications: ToolTool → General
QA Contact: bhearsum → mtabara

+1, seems like a cloud- or dns- level issue.

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.