1640031 - Perma static-analysis Exception: Download failed, no more retries!

Status: RESOLVED FIXED

(Firefox Build System :: Toolchains, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=303290291&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HEF8tGJwR368CMNfrTMUhQ/runs/2/artifacts/public/logs/live_backing.log

---

[fetches 2020-05-21T22:50:31.707Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RBNxN02SRTWafKhGQlY6IQ/artifacts/public/build/clang-tidy.tar.bz2 to z:\build\fetches\clang-tidy.tar.bz2
[fetches 2020-05-21T22:50:31.707Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RBNxN02SRTWafKhGQlY6IQ/artifacts/public/build/clang-tidy.tar.bz2
[fetches 2020-05-21T22:50:31.804Z] Download failed: HTTP Error 404: Not Found
[fetches 2020-05-21T22:50:31.806Z] Traceback (most recent call last):
[fetches 2020-05-21T22:50:31.806Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 681, in <module>
[fetches 2020-05-21T22:50:31.807Z] sys.exit(main())
[fetches 2020-05-21T22:50:31.807Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 677, in main
[fetches 2020-05-21T22:50:31.807Z] return args.func(args)
[fetches 2020-05-21T22:50:31.807Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 611, in command_task_artifacts
[fetches 2020-05-21T22:50:31.808Z] fetch_urls(downloads)
[fetches 2020-05-21T22:50:31.808Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 482, in fetch_urls
[fetches 2020-05-21T22:50:31.808Z] f.result()
[fetches 2020-05-21T22:50:31.808Z] File "C:\mozilla-build\python3\lib\concurrent\futures_base.py", line 432, in result
[fetches 2020-05-21T22:50:31.810Z] return self.__get_result()
[fetches 2020-05-21T22:50:31.810Z] File "C:\mozilla-build\python3\lib\concurrent\futures_base.py", line 384, in __get_result
[fetches 2020-05-21T22:50:31.810Z] raise self._exception
[fetches 2020-05-21T22:50:31.810Z] File "C:\mozilla-build\python3\lib\concurrent\futures\thread.py", line 56, in run
[fetches 2020-05-21T22:50:31.811Z] result = self.fn(*self.args, **self.kwargs)
[fetches 2020-05-21T22:50:31.811Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 461, in fetch_and_extract
[fetches 2020-05-21T22:50:31.812Z] download_to_path(url, dest_path, sha256=sha256, size=size)
[fetches 2020-05-21T22:50:31.812Z] File "z:/build/build/src\taskcluster\scripts\misc\fetch-content", line 241, in download_to_path
[fetches 2020-05-21T22:50:31.812Z] raise Exception("Download failed, no more retries!")
[fetches 2020-05-21T22:50:31.812Z] Exception: Download failed, no more retries!
[fetches 2020-05-21T22:50:31.829Z] removing z:/build/fetches
[fetches 2020-05-21T22:50:33.331Z] finished
[taskcluster 2020-05-21T22:50:33.349Z] Exit Code: 1
[taskcluster 2020-05-21T22:50:33.349Z] User Time: 15.625ms
[taskcluster 2020-05-21T22:50:33.349Z] Kernel Time: 0s
[taskcluster 2020-05-21T22:50:33.349Z] Wall Time: 8m22.9164428s
[taskcluster 2020-05-21T22:50:33.349Z] Result: FAILED
[taskcluster 2020-05-21T22:50:33.349Z] === Task Finished ===
[taskcluster 2020-05-21T22:50:33.349Z] Task Duration: 8m23.1614521s
[taskcluster:error] Uploading error artifact public/logs from file logs with message "Could not read directory 'Z:\task_1590099229\logs'", reason "file-missing-on-worker" and expiry 2021-05-21T21:52:33.750Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'Z:\task_1590099229\logs'
[taskcluster 2020-05-21T22:50:33.461Z] [mounts] Preserving cache: Moving "Z:\task_1590099229\build" to "Z:\caches\J1QbFP47STioVf1llWmR_g"
[taskcluster 2020-05-21T22:50:33.476Z] [mounts] Denying task_1590099229 access to 'Z:\caches\J1QbFP47STioVf1llWmR_g'
[taskcluster 2020-05-21T22:50:47.469Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HEF8tGJwR368CMNfrTMUhQ/runs/2/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2021-05-21T21:52:33.750Z
[taskcluster:error] exit status 1

Comment 1

[Cosmin Sabou [:CosminS]]

Chris, could these bustages be from 1637381?

Comment 2

[Cosmin Sabou [:CosminS]]

On second thought maybe related to the changes in Bug 1623355?
Also these bustages on m-c: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&revision=92c11f0bf14b71b70bec5351212ae237707f4a62&searchStr=android&selectedTaskRun=N76h__DKTXm5MG4b7ddsHg-0

Comment 3

[Cosmin Sabou [:CosminS]]

So it seems these are two different issues, the static analysis can't download build/clang-tidy.tar.bz2 because of Bug 1637381.
And for the condprof ones filed Bug 1640057.

Comment 4

[Chris AtLee [:catlee]]

Should be fixed by https://phabricator.services.mozilla.com/D76420

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1637381

Comment 6

[Intermittent Failures Robot]

3 failures in 4727 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows2012-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1640031&startday=2020-05-18&endday=2020-05-24&tree=all