Open Bug 1798511 Opened 3 years ago Updated 3 years ago

Intermittent ERROR:upload-symbols:Error: HTTPSConnectionPool(host='symbols.mozilla.org', port=443): Read timed out. (read timeout=300)

Categories

(Toolkit :: Crash Reporting, defect)

Product:
Toolkit
Component:
Crash Reporting
Type:
defect

Tracking

()

People

(Reporter: abutkovits, Unassigned)

Details

Parsed log

Full log

[task 2022-11-01T12:47:48.996Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:47:48.996Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:47:48.996Z] ====================
[task 2022-11-01T12:47:48.996Z] 
[task 2022-11-01T12:47:48.996Z] ====================
[task 2022-11-01T12:47:48.996Z] 
[task 2022-11-01T12:47:48.996Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:47:58.209Z] INFO:upload-symbols:Attempt 2 of 7...
[task 2022-11-01T12:48:02.570Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:48:02.570Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:48:02.570Z] ====================
[task 2022-11-01T12:48:02.570Z] 
[task 2022-11-01T12:48:02.570Z] ====================
[task 2022-11-01T12:48:02.570Z] 
[task 2022-11-01T12:48:02.570Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:48:17.304Z] INFO:upload-symbols:Attempt 3 of 7...
[task 2022-11-01T12:48:21.790Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:48:21.790Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:48:21.790Z] ====================
[task 2022-11-01T12:48:21.790Z] 
[task 2022-11-01T12:48:21.790Z] ====================
[task 2022-11-01T12:48:21.790Z] 
[task 2022-11-01T12:48:21.790Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:48:42.145Z] INFO:upload-symbols:Attempt 4 of 7...
[task 2022-11-01T12:48:46.384Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:48:46.385Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:48:46.385Z] ====================
[task 2022-11-01T12:48:46.385Z] 
[task 2022-11-01T12:48:46.385Z] ====================
[task 2022-11-01T12:48:46.385Z] 
[task 2022-11-01T12:48:46.385Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:49:21.725Z] INFO:upload-symbols:Attempt 5 of 7...
[task 2022-11-01T12:49:25.980Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:49:25.980Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:49:25.980Z] ====================
[task 2022-11-01T12:49:25.980Z] 
[task 2022-11-01T12:49:25.980Z] ====================
[task 2022-11-01T12:49:25.980Z] 
[task 2022-11-01T12:49:25.980Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:50:15.828Z] INFO:upload-symbols:Attempt 6 of 7...
[task 2022-11-01T12:50:20.144Z] ERROR:upload-symbols:Error: got HTTP response 429: 
[task 2022-11-01T12:50:20.144Z] ERROR:upload-symbols:Response body:
[task 2022-11-01T12:50:20.144Z] ====================
[task 2022-11-01T12:50:20.144Z] 
[task 2022-11-01T12:50:20.144Z] ====================
[task 2022-11-01T12:50:20.144Z] 
[task 2022-11-01T12:50:20.144Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:51:43.222Z] INFO:upload-symbols:Attempt 7 of 7...
[task 2022-11-01T12:56:48.079Z] ERROR:upload-symbols:Error: HTTPSConnectionPool(host='symbols.mozilla.org', port=443): Read timed out. (read timeout=300)
[task 2022-11-01T12:56:48.079Z] INFO:upload-symbols:Retrying...
[task 2022-11-01T12:56:48.079Z] /builds/worker/checkouts/gecko/toolkit/crashreporter/tools/upload_symbols.py:242: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
[task 2022-11-01T12:56:48.079Z]   log.warn("Maximum retries hit, giving up!")
[task 2022-11-01T12:56:48.079Z] WARNING:upload-symbols:Maximum retries hit, giving up!
[task 2022-11-01T12:56:48.511Z] Creating default state directory: /builds/worker/.mozbuild
[task 2022-11-01T12:56:48.511Z] Running "pip check" to verify compatibility between the system Python and the "mach" site.
[task 2022-11-01T12:56:48.511Z] Running "pip check" to verify compatibility between the system Python and the "common" site.
[task 2022-11-01T12:56:48.511Z] Site not up-to-date reason: "/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/common" does not exist
[taskcluster 2022-11-01 12:56:48.934Z] === Task Finished ===
[taskcluster 2022-11-01 12:56:48.934Z] Unsuccessful task run with exit code: 1 completed in 1232.777 seconds ```
Component: General → Infra
Product: Firefox Build System → Socorro

I don't know why this got bounced to Socorro, but it has nothing to do with crash ingestion, so I'm bouncing it back.

Skimming the logs, I suggest waiting longer between attempts because you're getting 429s.

Component: Infra → General
Product: Socorro → Firefox Build System
Component: General → Crash Reporting
Product: Firefox Build System → Toolkit

The severity field is not set for this bug.
:gsvelto, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(gsvelto)

Not a big deal fortunately

Severity: -- → S3
Flags: needinfo?(gsvelto)
You need to log in before you can comment on or make changes to this bug.