Closed Bug 1670107 Opened 5 years ago Closed 5 years ago

Intermittent [taskcluster:error] Error downloading "public/image.tar.zst" from task ID "Ivt-quGQTUqOW68CDFBuRg". Error: connect ETIMEDOUT 35.190.5.182:443 Next Attempt in: 17391.90 ms.

Categories

(Core :: Networking, defect, P5)

Product:
Core
Component:
Networking
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=318043414&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/byDW4jr3Qw6U1PvP8FFKaA/runs/0/artifacts/public/logs/live_backing.log

[taskcluster 2020-10-08 19:19:04.010Z] using cache "gecko-level-3-tooltool-cache-v3-826d7cf339abd7b732b6" -> /builds/worker/tooltool-cache
[taskcluster 2020-10-08 19:19:05.270Z] Downloading artifact "public/image.tar.zst" from task ID: Ivt-quGQTUqOW68CDFBuRg.
[taskcluster:error] Error downloading "public/image.tar.zst" from task ID "Ivt-quGQTUqOW68CDFBuRg". Error: connect ETIMEDOUT 35.190.5.182:443 Next Attempt in: 17391.90 ms.
[taskcluster:error] Error downloading "public/image.tar.zst" from task ID "Ivt-quGQTUqOW68CDFBuRg". Error: connect ETIMEDOUT 35.190.5.182:443 Next Attempt in: 33022.27 ms.
[taskcluster 2020-10-08 19:24:12.034Z] Downloaded artifact successfully.
[taskcluster 2020-10-08 19:24:12.034Z] Downloaded 268.580 mb
[taskcluster 2020-10-08 19:24:12.034Z] Decompressing downloaded image
[taskcluster 2020-10-08 19:24:13.793Z] Loading docker image from downloaded archive.
[taskcluster 2020-10-08 19:24:27.145Z] Image 'public/image.tar.zst' from task 'Ivt-quGQTUqOW68CDFBuRg' loaded. Using image ID sha256:b5699cdf049d61f25bc04e2d52ddefd8915e6313b400e0e58a73e98176aaa93e.
[taskcluster 2020-10-08 19:25:27.871Z] === Task Starting ===
[setup 2020-10-08T19:25:28.499Z] run-task started in /builds/worker
[cache 2020-10-08T19:25:28.500Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2020-10-08T19:25:28.500Z] cache /builds/worker/tooltool-cache is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2020-10-08T19:25:28.500Z] volume /builds/worker/checkouts is a cache
[volume 2020-10-08T19:25:28.500Z] volume /builds/worker/tooltool-cache is a cache
[volume 2020-10-08T19:25:28.501Z] changing ownership of volume /builds/worker/workspace to 1000:1000
[setup 2020-10-08T19:25:28.501Z] running as worker:worker
[vcs 2020-10-08T19:25:28.501Z] fetching hgmointernal config from http://taskcluster/secrets/v1/secret/project/taskcluster/gecko/hgmointernal
[vcs 2020-10-08T19:25:28.599Z] hgmointernal rate hit; cloning from private hgweb mirror
[vcs 2020-10-08T19:25:28.599Z] fetching hg.mozilla.org fingerprint from http://taskcluster/secrets/v1/secret/project/taskcluster/gecko/hgfingerprint
[vcs 2020-10-08T19:25:28.674Z] executing ['hg', 'robustcheckout', '--sharebase', '/builds/worker/checkouts/hg-store', '--purge', '--config', 'hostsecurity.hg.mozilla.org:fingerprints=sha256:17:38:aa:92:0b:84:3e:aa:8e:52:52:e9:4c:2f:98:a9:0e:bf:6c:3e:e9:15:ff:0a:29:80:f7:06:02:5b:e8:48,sha256:8e:ad:f7:6a:eb:44:06:15:ed:f3:e4:69:a6:64:60:37:2d:ff:98:88:37:bf:d7:b8:40:84:01:48:9c:26:ce:d9', '--upstream', 'https://us-east-1.hgmointernal.net/mozilla-unified', '--revision', 'b308ba03bf38fb6a430e185255ef2ce7f109a854', 'https://us-east-1.hgmointernal.net/integration/autoland', '/builds/worker/checkouts/gecko']
[vcs 2020-10-08T19:25:28.728Z] (using Mercurial 4.8.1)
[vcs 2020-10-08T19:25:28.728Z] ensuring https://us-east-1.hgmointernal.net/integration/autoland@b308ba03bf38fb6a430e185255ef2ce7f109a854 is available at /builds/worker/checkouts/gecko
[vcs 2020-10-08T19:29:43.241Z] socket error: [Errno 110] Connection timed out
[vcs 2020-10-08T19:29:43.241Z] (retrying after network failure on attempt 1 of 3)
[vcs 2020-10-08T19:29:43.242Z] (waiting 6.24s before retry)
[vcs 2020-10-08T19:29:49.483Z] ensuring https://us-east-1.hgmointernal.net/integration/autoland@b308ba03bf38fb6a430e185255ef2ce7f109a854 is available at /builds/worker/checkouts/gecko
[vcs 2020-10-08T19:31:56.849Z] (cloning from upstream repo https://us-east-1.hgmointernal.net/mozilla-unified)
[vcs 2020-10-08T19:31:56.896Z] (sharing from new pooled repository 8ba995b74e18334ab3707f27e9eb8f4e37ba3d29)
[vcs 2020-10-08T19:34:04.335Z] applying clone bundle from https://s3-external-1.amazonaws.com/moz-hg-bundles-us-east-1/mozilla-unified/864d323183cdba59cdba3b0c7244741516376df1.stream-v2.hg
[vcs 2020-10-08T19:36:11.591Z] error fetching bundle: [Errno 110] Connection timed out
[vcs 2020-10-08T19:36:11.595Z] PERFHERDER_DATA: {"framework": {"name": "vcs"}, "suites": [{"extraOptions": ["c5n.4xlarge"], "hgVersion": "4.8.1", "lowerIsBetter": true, "name": "clone_errored", "serverUrl": "us-east-1.hgmointernal.net", "shouldAlert": false, "subtests": [], "value": 254.74303102493286}, {"extraOptions": ["c5n.4xlarge"], "hgVersion": "4.8.1", "lowerIsBetter": true, "name": "overall", "serverUrl": "us-east-1.hgmointernal.net", "shouldAlert": false, "subtests": [], "value": 642.8643419742584}, {"extraOptions": ["c5n.4xlarge"], "hgVersion": "4.8.1", "lowerIsBetter": true, "name": "overall_clone", "serverUrl": "us-east-1.hgmointernal.net", "shouldAlert": false, "subtests": [], "value": 642.8643419742584}, {"extraOptions": ["c5n.4xlarge"], "hgVersion": "4.8.1", "lowerIsBetter": true, "name": "overall_clone_fullcheckout", "serverUrl": "us-east-1.hgmointernal.net", "shouldAlert": false, "subtests": [], "value": 642.8643419742584}]}
[vcs 2020-10-08T19:36:11.595Z] abort: error applying bundle
[vcs 2020-10-08T19:36:11.595Z] (if this error persists, consider contacting the server operator or disable clone bundles via "--config ui.clonebundles=false")
[taskcluster 2020-10-08 19:36:11.929Z] === Task Finished ===
[taskcluster 2020-10-08 19:36:12.027Z] Artifact "public/build" not found at "/builds/worker/artifacts/"
[taskcluster 2020-10-08 19:36:12.170Z] Unsuccessful task run with exit code: 255 completed in 1028.161 seconds

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.