1799004 - Intermittent ERROR:upload-symbols:Error: got HTTP response 408: REQUEST_TIMEOUT | ERROR:upload-symbols:Response body

Status: RESOLVED FIXED

(Toolkit :: Crash Reporting, defect)

Description

[Atila Butkovits]

Parsed log

Full log

[task 2022-11-03T19:23:13.527Z] INFO:upload-symbols:xul.dll/636413CAB2BB000/xul.dll
[task 2022-11-03T19:23:29.319Z] INFO:upload-symbols:xul.pdb/509E001B92D1A6CD4C4C44205044422E1/xul.pdb
[task 2022-11-03T19:26:00.490Z] INFO:upload-symbols:xul.pdb/509E001B92D1A6CD4C4C44205044422E1/xul.sym
[task 2022-11-03T19:26:22.953Z] INFO:upload-symbols:xul.pdb/E26E57D113410B874C4C44205044422E1/xul.pdb
[task 2022-11-03T19:29:12.533Z] INFO:upload-symbols:xul.pdb/E26E57D113410B874C4C44205044422E1/xul.sym
[task 2022-11-03T19:29:44.567Z] INFO:upload-symbols:Using symbol upload token from the secrets service: "http://taskcluster/secrets/v1/secret/project/releng/gecko/build/level-3/gecko-symbol-upload"
[task 2022-11-03T19:29:44.749Z] INFO:upload-symbols:Uploading symbol file "/tmp/tmpa48fqtzv/symbols.zip" to "https://symbols.mozilla.org/upload/"
[task 2022-11-03T19:29:44.749Z] INFO:upload-symbols:Attempt 1 of 7...
[task 2022-11-03T19:34:51.329Z] ERROR:upload-symbols:Error: got HTTP response 408: REQUEST_TIMEOUT
[task 2022-11-03T19:34:51.329Z] ERROR:upload-symbols:Response body:
[task 2022-11-03T19:34:51.329Z] ====================
[task 2022-11-03T19:34:51.329Z] 
[task 2022-11-03T19:34:51.329Z] ====================
[task 2022-11-03T19:34:51.329Z] 
[task 2022-11-03T19:34:52.022Z] Creating default state directory: /builds/worker/.mozbuild
[task 2022-11-03T19:34:52.022Z] Running "pip check" to verify compatibility between the system Python and the "mach" site.
[task 2022-11-03T19:34:52.022Z] Running "pip check" to verify compatibility between the system Python and the "common" site.
[task 2022-11-03T19:34:52.022Z] Site not up-to-date reason: "/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/common" does not exist
[taskcluster 2022-11-03 19:34:52.529Z] === Task Finished ===
[taskcluster 2022-11-03 19:34:52.529Z] Unsuccessful task run with exit code: 1 completed in 780.963 seconds```

Comment 1

[Intermittent Failures Robot]

2 failures in 3626 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 1

Platform and build breakdown:

• windows2012-32: 1
  • debug: 1
• windows2012-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1799004&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:gsvelto, could you have a look please?

For more information, please visit auto_nag documentation.

Comment 3

[Gabriele Svelto [:gsvelto] (PTO)]

This is rather bad. Apparently Teken is trying to close the connection because it is idle, maybe the worker got stuck? Either way we should re-try uploading like we do for other transient errors.

Comment 4

[Gabriele Svelto [:gsvelto] (PTO)]

Attachment: Bug 1799004 - Re-try uploading symbols when hitting request timeout errors r=glandium

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bd3b9254960f
Re-try uploading symbols when hitting request timeout errors r=glandium

Comment 6

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/bd3b9254960f