1633152 - Intermittent TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond

Status: NEW

(Developer Services :: Mercurial: hg.mozilla.org, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=299396462&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MJSgWM5YRpeg1y2nLK7M_g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-04-25T12:22:18.451Z] 12:22:18 INFO - z:/task_1587816172/workspace/obj-build/virtualenvs/init_py3/Scripts/python.exe -m mozbuild.action.jar_maker -d ../../../../dist/xpi-stage/locale-ltg/browser -t Z:/task_1587816172/build/src -f flat --relativesrcdir=browser/branding/nightly/locales --locale-mergedir=z:/task_1587816172/workspace/obj-build/browser/locales/merge-dir/ltg --l10n-base=Z:/task_1587816172/build/l10n-central/ltg --root-manifest-entry-appid='{ec8030f7-c20a-464f-9b0e-13a3a9e97384}' -DNDEBUG=1 -DTRIMMED=1 -DMOZ_DISTRIBUTION_ID_UNQUOTED=org.mozilla -DACCESSIBILITY=1 -DBROWSER_CHROME_URL=chrome://browser/content/browser.xhtml -DBROWSER_CHROME_URL_QUOTED='"chrome://browser/content/browser.xhtml"' -DBUILD_CTYPES=1 -DCROSS_COMPILE=1 -DEARLY_BETA_OR_EARLIER=1 -DENABLE_REMOTE_AGENT=1 -DENABLE_SHARED_MEMORY=1 -DENABLE_SYSTEM_EXTENSION_DIRS=1 -DENABLE_TESTS=1 -DENABLE_WASM_BIGINT=1 -DENABLE_WASM_BULKMEM_OPS=1 -DENABLE_WASM_CRANELIFT=1 -DENABLE_WASM_GC=1 -DENABLE_WASM_MULTI_VALUE=1 -DENABLE_WASM_REFTYPES=1 -DFORCE_PR_LOG=1 -DGTEST_HAS_RTTI=0 -DHAVE_64BIT_BUILD=1 -DHAVE_FORCEINLINE=1 -DHAVE_LOCALECONV=1 -DHAVE_UINT64_T=1 -DJS_64BIT=1 -DJS_BUILD_BINAST=1 -DJS_CODEGEN_ARM64=1 -DJS_DEFAULT_JITREPORT_GRANULARITY=3 -DJS_HAS_INTL_API=1 -DJS_HAS_TYPED_OBJECTS=1 -DJS_PUNBOX64=1 -DJS_TRACE_LOGGING=1 -DMALLOC_H='<malloc.h>' -DMOZILLA_OFFICIAL=1 -DMOZILLA_UAVERSION='"77.0"' -DMOZILLA_VERSION='"77.0a1"' -DMOZILLA_VERSION_U=77.0a1 -DMOZ_APP_UA_NAME='""' -DMOZ_APP_UA_VERSION='"77.0a1"' -DMOZ_AV1=1 -DMOZ_BITS_DOWNLOAD=1 -DMOZ_BLOCK_PROFILE_DOWNGRADE=1 -DMOZ_BUILD_APP=browser -DMOZ_BUNDLED_FONTS=1 -DMOZ_CRASHREPORTER=1 -DMOZ_DATA_REPORTING=1 -DMOZ_DEDICATED_PROFILES=1 -DMOZ_DISTRIBUTION_ID='"org.mozilla"' -DMOZ_DLL_PREFIX='""' -DMOZ_DLL_SUFFIX='".dll"' -DMOZ_ENABLE_SKIA=1 -DMOZ_FMP4=1 -DMOZ_GECKO_PROFILER=1 -DMOZ_GLEAN=1 -DMOZ_HAS_REMOTE=1 -DMOZ_INSTRUMENT_EVENT_LOOP=1 -DMOZ_LAUNCHER_PROCESS=1 -DMOZ_LOGGING=1 -DMOZ_MACBUNDLE_ID=org.mozilla.nightly -DMOZ_MAINTENANCE_SERVICE=1 -DMOZ_NEW_CERT_STORAGE=1 -DMOZ_NEW_NOTIFICATION_STORE=1 -DMOZ_NEW_XULSTORE=1 -DMOZ_NORMANDY=1 -DMOZ_PEERCONNECTION=1 -DMOZ_PLACES=1 -DMOZ_PROFILER_MEMORY=1 -DMOZ_PROFILING=1 -DMOZ_RAW=1 -DMOZ_RUST_SIMD=1 -DMOZ_SAMPLE_TYPE_FLOAT32=1 -DMOZ_SANDBOX=1 -DMOZ_SCTP=1 -DMOZ_SERVICES_HEALTHREPORT=1 -DMOZ_SRTP=1 -DMOZ_STATIC_JS=1 -DMOZ_TELEMETRY_ON_BY_DEFAULT=1 -DMOZ_TELEMETRY_REPORTING=1 -DMOZ_TREE_CAIRO=1 -DMOZ_TREE_PIXMAN=1 -DMOZ_UPDATER=1 -DMOZ_UPDATE_CHANNEL=nightly -DMOZ_USER_DIR='"Mozilla"' -DMOZ_VERIFY_MAR_SIGNATURE=1 -DMOZ_VORBIS=1 -DMOZ_WEBM_ENCODER=1 -DMOZ_WEBRTC=1 -DMOZ_WEBRTC_ASSERT_ALWAYS=1 -DMOZ_WEBRTC_SIGNALING=1 -DMOZ_WEBSPEECH=1 -DMOZ_WEBSPEECH_TEST_BACKEND=1 -DMOZ_WMF=1 -DMOZ_XUL=1 -DNIGHTLY_BUILD=1 -DNOMINMAX=1 -DNO_NSPR_10_SUPPORT=1 -DNS_ENABLE_TSF=1 -DNS_PRINTING=1 -DNS_PRINT_PREVIEW=1 -DSTATIC_JS_API=1 -DTARGET_XPCOM_ABI='"aarch64-msvc"' -DUSE_SKIA=1 -DU_STATIC_IMPLEMENTATION=1 -DU_USING_ICU_NAMESPACE=0 -DWASM_PRIVATE_REFTYPES=1 -DWIN32=1 -DWIN32_LEAN_AND_MEAN=1 -DXP_WIN=1 -D_ARM64=1 -D_WINDOWS=1 -DXPI_NAME=locale-ltg -DAB_CD=ltg Z:/task_1587816172/build/src/browser/branding/nightly/locales/jar.mn
[task 2020-04-25T12:22:18.656Z] 12:22:18 INFO - processing Z:/task_1587816172/build/src/browser/branding/nightly/locales/jar.mn
[task 2020-04-25T12:22:18.660Z] 12:22:18 INFO - adding 'browser' entry to root chrome manifest appid={ec8030f7-c20a-464f-9b0e-13a3a9e97384}
[task 2020-04-25T12:22:18.678Z] 12:22:18 INFO - mozmake.exe[3]: Leaving directory 'z:/task_1587816172/workspace/obj-build/browser/branding/nightly/locales'
[task 2020-04-25T12:22:18.688Z] 12:22:18 INFO - mozmake.exe[3]: Entering directory 'z:/task_1587816172/workspace/obj-build/browser/branding/nightly/locales'
[task 2020-04-25T12:22:18.688Z] 12:22:18 INFO - mozmake.exe[3]: Nothing to be done for 'tools'.
[task 2020-04-25T12:22:18.688Z] 12:22:18 INFO - mozmake.exe[3]: Leaving directory 'z:/task_1587816172/workspace/obj-build/browser/branding/nightly/locales'
[task 2020-04-25T12:22:18.689Z] 12:22:18 INFO - mozmake.exe[2]: Leaving directory 'z:/task_1587816172/workspace/obj-build/browser/branding/nightly/locales'
[task 2020-04-25T12:22:18.690Z] 12:22:18 INFO - mozmake.exe[1]: Leaving directory 'z:/task_1587816172/workspace/obj-build/browser/locales'
[task 2020-04-25T12:22:18.700Z] 12:22:18 INFO - mozmake.exe[1]: Entering directory 'z:/task_1587816172/workspace/obj-build/browser/locales'
[task 2020-04-25T12:22:18.713Z] 12:22:18 INFO - z:/task_1587816172/workspace/obj-build/_virtualenvs/init_py3/Scripts/python.exe Z:/task_1587816172/build/src/config/nsinstall.py -D ../../dist/win64-aarch64/xpi/
[task 2020-04-25T12:22:18.804Z] 12:22:18 INFO - z:/task_1587816172/workspace/obj-build/_virtualenvs/init_py3/Scripts/python.exe -m mozbuild.action.langpack_manifest --locales ltg --min-app-ver 77.0a1 --max-app-ver 77.0a1 --app-name 'Firefox Nightly' --l10n-basedir 'Z:/task_1587816172/build/l10n-central' --defines Z:/task_1587816172/build/l10n-central/ltg/toolkit/defines.inc Z:/task_1587816172/build/l10n-central/ltg/browser/defines.inc --langpack-eid '[e-mail]' --input ../../dist/xpi-stage/locale-ltg
[task 2020-04-25T12:22:40.276Z] 12:22:40 ERROR - Traceback (most recent call last):
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connection.py", line 137, in _new_conn
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - (self.host, self.port), self.timeout, **extra_kw)
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\util\connection.py", line 91, in create_connection
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - raise err
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\util\connection.py", line 81, in create_connection
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - sock.connect(sa)
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - During handling of the above exception, another exception occurred:
[task 2020-04-25T12:22:40.276Z] 12:22:40 ERROR - Traceback (most recent call last):
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connectionpool.py", line 559, in urlopen
[task 2020-04-25T12:22:40.276Z] 12:22:40 INFO - body=body, headers=headers)
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connectionpool.py", line 345, in _make_request
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - self._validate_conn(conn)
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connectionpool.py", line 784, in _validate_conn
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - conn.connect()
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connection.py", line 217, in connect
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - conn = self._new_conn()
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connection.py", line 146, in _new_conn
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - self, "Failed to establish a new connection: %s" % e)
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x00000046258DDBA8>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - During handling of the above exception, another exception occurred:
[task 2020-04-25T12:22:40.277Z] 12:22:40 ERROR - Traceback (most recent call last):
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\adapters.py", line 376, in send
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - timeout=timeout
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\connectionpool.py", line 609, in urlopen
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - _stacktrace=sys.exc_info()[2])
[task 2020-04-25T12:22:40.277Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\packages\urllib3\util\retry.py", line 273, in increment
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - raise MaxRetryError(_pool, url, error or ResponseError(cause))
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='hg.mozilla.org', port=443): Max retries exceeded with url: /l10n-central/ltg/json-rev/b0f37d490f5cd2284e4af4617714d6fa621fe4f6 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x00000046258DDBA8>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond',))
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - During handling of the above exception, another exception occurred:
[task 2020-04-25T12:22:40.278Z] 12:22:40 ERROR - Traceback (most recent call last):
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 66, in get_dt_from_hg
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - response = session.get(url)
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\sessions.py", line 480, in get
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - return self.request('GET', url, **kwargs)
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\sessions.py", line 468, in request
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - resp = self.send(prep, **send_kwargs)
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\sessions.py", line 576, in send
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - r = adapter.send(request, **kwargs)
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\third_party\python\requests\requests\adapters.py", line 437, in send
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - raise ConnectionError(e, request=request)
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - requests.exceptions.ConnectionError: HTTPSConnectionPool(host='hg.mozilla.org', port=443): Max retries exceeded with url: /l10n-central/ltg/json-rev/b0f37d490f5cd2284e4af4617714d6fa621fe4f6 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x00000046258DDBA8>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond',))
[task 2020-04-25T12:22:40.278Z] 12:22:40 INFO - During handling of the above exception, another exception occurred:
[task 2020-04-25T12:22:40.279Z] 12:22:40 ERROR - Traceback (most recent call last):
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "C:\mozilla-build\python3\Lib\runpy.py", line 193, in _run_module_as_main
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - "main", mod_spec)
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "C:\mozilla-build\python3\Lib\runpy.py", line 85, in _run_code
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - exec(code, run_globals)
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 489, in <module>
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - main(sys.argv[1:])
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 483, in main
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - chrome_entries
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 430, in create_webmanifest
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - 'version': get_timestamp_for_locale(os.path.join(l10n_basedir, loc)),
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 99, in get_timestamp_for_locale
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - dt = get_dt_from_hg(path)
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - File "z:\task_1587816172\build\src\python\mozbuild\mozbuild\action\langpack_manifest.py", line 69, in get_dt_from_hg
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - raise Exception(msg)
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - Exception: Failed to retrieve push timestamp using https://hg.mozilla.org/l10n-central/ltg/json-rev/b0f37d490f5cd2284e4af4617714d6fa621fe4f6
[task 2020-04-25T12:22:40.279Z] 12:22:40 INFO - Error: HTTPSConnectionPool(host='hg.mozilla.org', port=443): Max retries exceeded with url: /l10n-central/ltg/json-rev/b0f37d490f5cd2284e4af4617714d6fa621fe4f6 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x00000046258DDBA8>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond',))

Comment 1

[Andreea Pavel [:apavel]]

Connor, Kendall, we keep seeing network failures across all trees for builds:

Central: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&revision=d8a8178627c4fab05f1eb46ee40f55db207c7c18&selectedJob=299399710

Autoland: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&revision=96c4568ac1ee9344e1037f0e52de6494579c3993&selectedJob=299393570

We're also got a round of cron tasks failure emails, report that hg.mo is down as pushing to try returned operation timed out.

autoland cron taks failure: https://firefox-ci-tc.services.mozilla.com/tasks/colXWuX7RcG9UhZmvxoGxQ/runs/0/logs/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FcolXWuX7RcG9UhZmvxoGxQ%2Fruns%2F0%2Fartifacts%2Fpublic%2Flogs%2Flive.log#L18

Can you please take a look?

Reruns are green.

Comment 2

[Intermittent Failures Robot]

6 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6

Platform breakdown:

• windows2012-aarch64-shippable: 5
• windows2012-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633152&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 3

[Intermittent Failures Robot]

2 failures in 5252 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• mozilla-esr78: 1

Platform breakdown:

• windows2012-64-shippable: 1
• windows2012-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633152&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 3421 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 3125 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 3131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 3263 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows7-32-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2021-12-13&endday=2021-12-19&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 3165 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-01-31&endday=2022-02-06&tree=all

Comment 9

[Intermittent Failures Robot]

4 failures in 3540 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 3
  • opt: 3
• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-05-02&endday=2022-05-08&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 3317 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-05-09&endday=2022-05-15&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 3170 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 3245 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-07-25&endday=2022-07-31&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 3537 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows10-64-2004-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 14

[Intermittent Failures Robot]

2 failures in 3023 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• windows2012-32-shippable: 1
  • opt: 1
• windows7-32-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 15

[Intermittent Failures Robot]

9 failures in 3558 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 4
• autoland: 4

Platform and build breakdown:

• windows10-64-2004-asan-qr: 2
  • opt: 2
• windows10-64-2004-qr: 3
  • debug: 3
• windows10-32-2004-mingwclang-qr: 1
  • debug: 1
• windows10-32-2004-qr: 2
  • debug: 2
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2022-12-12&endday=2022-12-18&tree=all

Comment 16

[Intermittent Failures Robot]

12 failures in 3606 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3
• mozilla-central: 9

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • release: 1
• windows2012-64: 6
  • ccov: 2
  • debug: 3
  • opt: 1
• windows2012-32: 1
  • debug: 1
• windows2012-64-shippable: 2
  • opt: 2
• windows2012-32-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2023-01-30&endday=2023-02-05&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 3471 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2023-05-29&endday=2023-06-04&tree=all

Comment 18

[Intermittent Failures Robot]

18 failures in 433 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 18

Platform and build breakdown:

• windows11-64: 18
  • opt: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2023-08-23&endday=2023-08-23&tree=all

Comment 19

[Intermittent Failures Robot]

18 failures in 2218 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 18

Platform and build breakdown:

• windows11-64: 18
  • opt: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2023-08-21&endday=2023-08-27&tree=all

Comment 20

[Intermittent Failures Robot]

71 failures in 3267 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 2
• mozilla-beta: 69

Platform and build breakdown:

• windows2012-64: 2
  • opt: 1
  • ccov: 1
• windows2012-32-shippable: 21
  • opt: 21
• windows2012-32-devedition: 26
  • opt: 26
• windows2012-64-shippable: 5
  • opt: 5
• windows2012-64-devedition: 17
  • opt: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2023-09-04&endday=2023-09-10&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 3590 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows11-32-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2024-03-25&endday=2024-03-31&tree=all

Comment 22

[Connor Sheehan [:sheehan]]

I don't have any meaningful updates here. It seems like this is a relatively low occurrence timeout issue with Windows workers. Please re-needinfo me if more action from me is warranted on this bug.

Comment 23

[Intermittent Failures Robot]

3 failures in 4577 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform and build breakdown:

• windows2012-64: 1
  • opt: 1
• windows2012-32: 1
  • opt: 1
• windows2012-32-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 24

[Intermittent Failures Robot]

9 failures in 3459 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 9

Platform and build breakdown:

• windows2012-32-shippable: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2024-08-05&endday=2024-08-11&tree=all

Comment 25

[Intermittent Failures Robot]

4 failures in 3002 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• windows2012-32-shippable: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1633152&startday=2024-11-18&endday=2024-11-24&tree=all