1603990 - Perma Tier 2 Windows 10 AArch64 opt Can't download from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz

Status: RESOLVED DUPLICATE of bug 1603427

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281219159&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HOVraFiCT3SOJ7maAhsDWg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-12-15T00:44:43.351Z] 00:44:43 INFO - mkdir: C:\tasks\task_1576332964\build\blobber_upload_dir
[task 2019-12-15T00:44:43.352Z] 00:44:43 INFO - Running post-action listener: _resource_record_post_action
[task 2019-12-15T00:44:43.353Z] 00:44:43 INFO - [mozharness: 2019-12-15 00:44:43.352000Z] Finished clobber step (success)
[task 2019-12-15T00:44:43.353Z] 00:44:43 INFO - [mozharness: 2019-12-15 00:44:43.352000Z] Running download-and-extract step.
[task 2019-12-15T00:44:43.353Z] 00:44:43 INFO - Running pre-action listener: _resource_record_pre_action
[task 2019-12-15T00:44:43.353Z] 00:44:43 INFO - Running main action method: download_and_extract
[task 2019-12-15T00:44:43.353Z] 00:44:43 INFO - mkdir: C:\tasks\task_1576332964\build\tests
[task 2019-12-15T00:44:43.355Z] 00:44:43 INFO - Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.test_packages.json to C:\tasks\task_1576332964\build\target.test_packages.json
[task 2019-12-15T00:44:43.355Z] 00:44:43 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.test_packages.json', 'file_name': u'C:\tasks\task_1576332964\build\target.test_packages.json'}, attempt #1
[task 2019-12-15T00:44:43.922Z] 00:44:43 INFO - Downloaded 1373 bytes.
[task 2019-12-15T00:44:43.922Z] 00:44:43 INFO - Reading from file C:\tasks\task_1576332964\build\target.test_packages.json
[task 2019-12-15T00:44:43.923Z] 00:44:43 INFO - Downloading packages: [u'target.common.tests.tar.gz', u'target.raptor.tests.tar.gz', u'target.condprof.tests.tar.gz'] for test suite categories: [u'common', u'condprof', u'raptor']
[task 2019-12-15T00:44:43.923Z] 00:44:43 INFO - Downloading and extracting to C:\tasks\task_1576332964\build\tests these dirs * from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.common.tests.tar.gz
[task 2019-12-15T00:44:43.924Z] 00:44:43 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.common.tests.tar.gz'}, attempt #1
[task 2019-12-15T00:44:43.924Z] 00:44:43 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.common.tests.tar.gz into memory
[task 2019-12-15T00:44:45.891Z] 00:44:45 INFO - Content-Length response header: 22197730
[task 2019-12-15T00:44:45.891Z] 00:44:45 INFO - Bytes received: 22197730
[task 2019-12-15T00:46:05.486Z] 00:46:05 INFO - Downloading and extracting to C:\tasks\task_1576332964\build\tests these dirs * from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.raptor.tests.tar.gz
[task 2019-12-15T00:46:05.486Z] 00:46:05 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.raptor.tests.tar.gz'}, attempt #1
[task 2019-12-15T00:46:05.486Z] 00:46:05 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.raptor.tests.tar.gz into memory
[task 2019-12-15T00:46:06.242Z] 00:46:06 INFO - Content-Length response header: 11593422
[task 2019-12-15T00:46:06.242Z] 00:46:06 INFO - Bytes received: 11593422
[task 2019-12-15T00:46:08.519Z] 00:46:08 INFO - Downloading and extracting to C:\tasks\task_1576332964\build\tests these dirs * from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz
[task 2019-12-15T00:46:08.520Z] 00:46:08 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz'}, attempt #1
[task 2019-12-15T00:46:08.520Z] 00:46:08 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz into memory
[task 2019-12-15T00:46:08.625Z] 00:46:08 INFO - retry: attempt #1 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-12-15T00:46:08.626Z] 00:46:08 INFO - retry: Failed, sleeping 30 seconds before retrying
[task 2019-12-15T00:46:38.629Z] 00:46:38 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz'}, attempt #2
[task 2019-12-15T00:46:38.629Z] 00:46:38 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz into memory
[task 2019-12-15T00:46:38.781Z] 00:46:38 INFO - retry: attempt #2 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-12-15T00:46:38.782Z] 00:46:38 INFO - retry: Failed, sleeping 60 seconds before retrying
[task 2019-12-15T00:47:38.784Z] 00:47:38 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz'}, attempt #3
[task 2019-12-15T00:47:38.785Z] 00:47:38 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz into memory
[task 2019-12-15T00:47:39.407Z] 00:47:39 INFO - retry: attempt #3 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-12-15T00:47:39.409Z] 00:47:39 INFO - retry: Failed, sleeping 120 seconds before retrying
[task 2019-12-15T00:49:39.410Z] 00:49:39 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz'}, attempt #4
[task 2019-12-15T00:49:39.411Z] 00:49:39 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz into memory
[task 2019-12-15T00:49:39.571Z] 00:49:39 INFO - retry: attempt #4 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-12-15T00:49:39.572Z] 00:49:39 INFO - retry: Failed, sleeping 240 seconds before retrying
[task 2019-12-15T00:53:39.574Z] 00:53:39 INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz'}, attempt #5
[task 2019-12-15T00:53:39.575Z] 00:53:39 INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz into memory
[task 2019-12-15T00:53:39.843Z] 00:53:39 INFO - retry: attempt #5 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.843Z] 00:53:39 FATAL - Can't download from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cnPcxdZBQiumYT5sKBRMDA/artifacts/public/build/target.condprof.tests.tar.gz
[task 2019-12-15T00:53:39.843Z] 00:53:39 FATAL - Caught exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.843Z] 00:53:39 FATAL - Caught exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.844Z] 00:53:39 FATAL - Caught exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.844Z] 00:53:39 FATAL - Caught exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.844Z] 00:53:39 FATAL - Caught exception: HTTP Error 404: Not Found
[task 2019-12-15T00:53:39.844Z] 00:53:39 FATAL - Running post_fatal callback...
[task 2019-12-15T00:53:39.845Z] 00:53:39 FATAL - Exiting -1
[task 2019-12-15T00:53:39.847Z] 00:53:39 INFO - Running post-action listener: _resource_record_post_action
[task 2019-12-15T00:53:39.847Z] 00:53:39 INFO - Running post-action listener: find_tests_for_coverage
[task 2019-12-15T00:53:39.847Z] 00:53:39 INFO - Running post-action listener: find_tests_for_verification
[task 2019-12-15T00:53:39.848Z] 00:53:39 INFO - Running post-action listener: set_extra_try_arguments
[task 2019-12-15T00:53:39.848Z] 00:53:39 INFO - Running post-action listener: setup_coverage_tools
[task 2019-12-15T00:53:39.849Z] 00:53:39 INFO - [mozharness: 2019-12-15 00:53:39.848000Z] Finished download-and-extract step (failed)
[task 2019-12-15T00:53:39.850Z] 00:53:39 INFO - Running post-run listener: _resource_record_post_run
[taskcluster 2019-12-15T00:53:39.963Z] Exit Code: -1
[taskcluster 2019-12-15T00:53:39.963Z] User Time: 0s
[taskcluster 2019-12-15T00:53:39.963Z] Kernel Time: 93.75ms
[taskcluster 2019-12-15T00:53:39.963Z] Wall Time: 8m58.0868596s
[taskcluster 2019-12-15T00:53:39.963Z] Result: FAILED
[taskcluster 2019-12-15T00:53:39.964Z] === Task Finished ===
[taskcluster 2019-12-15T00:53:39.964Z] Task Duration: 8m58.0912167s
[taskcluster 2019-12-15T00:53:40.257Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2020-12-13T22:01:14.645Z
[taskcluster 2019-12-15T00:53:40.653Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HOVraFiCT3SOJ7maAhsDWg/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2020-12-13T22:01:14.645Z
[taskcluster:error] exit status -1

Comment 1

[Bogdan Tara[:bogdan_tara | bogdant]]

Sorry, not sure about the product and component.

Comment 2

[Intermittent Failures Robot]

16 failures in 198 pushes (0.081 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 5

Platform breakdown:

• windows10-aarch64: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603990&startday=2019-12-14&endday=2019-12-14&tree=all

Comment 3

[Mike Hommey [:glandium]]

Regression from bug 1600838.

Comment 5

[Intermittent Failures Robot]

68 failures in 4867 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 5
• autoland: 63

Platform breakdown:

• windows10-aarch64: 68

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603990&startday=2019-12-09&endday=2019-12-15&tree=all