Open Bug 1968249 Opened 3 months ago Updated 3 months ago

slow download from firefoxci.taskcluster-artifacts.net on cache miss

Categories

(Cloud Services :: Operations: Taskcluster, defect)

Product:
Cloud Services
Component:
Operations: Taskcluster
Type:
defect

Tracking

(Not tracked)

People

(Reporter: jcristau, Unassigned)

References

Details

Downloading a taskcluster artifact through cloud cdn appears to be much slower than directly from the storage bucket, when the object is not cached:

$ wget -O/dev/null 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EERRRYBdTcydBGSkIk1WrA/artifacts/public/build/target.crashreporter-symbols.zip'
--2025-05-23 15:06:54--  https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EERRRYBdTcydBGSkIk1WrA/artifacts/public/build/target.crashreporter-symbols.zip
Resolving firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)... 35.190.5.182
Connecting to firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)|35.190.5.182|:443... connected.
HTTP request sent, awaiting response... 303 See Other
Location: https://firefoxci.taskcluster-artifacts.net/EERRRYBdTcydBGSkIk1WrA/0/public/build/target.crashreporter-symbols.zip [following]
--2025-05-23 15:06:55--  https://firefoxci.taskcluster-artifacts.net/EERRRYBdTcydBGSkIk1WrA/0/public/build/target.crashreporter-symbols.zip
Resolving firefoxci.taskcluster-artifacts.net (firefoxci.taskcluster-artifacts.net)... 34.36.125.136
Connecting to firefoxci.taskcluster-artifacts.net (firefoxci.taskcluster-artifacts.net)|34.36.125.136|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 517771558 (494M) [application/zip]
Saving to: ‘/dev/null’

/dev/null                                    14%[============>                                                                            ]  72.13M  4.20MB/s    eta 54s    ^C
$ wget --header='x-taskcluster-skip-cdn: 1' -O/dev/null 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EERRRYBdTcydBGSkIk1WrA/artifacts/public/build/target.crashreporter-symbols.zip'
--2025-05-23 15:08:13--  https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EERRRYBdTcydBGSkIk1WrA/artifacts/public/build/target.crashreporter-symbols.zip
Resolving firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)... 35.190.5.182
Connecting to firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)|35.190.5.182|:443... connected.
HTTP request sent, awaiting response... 303 See Other
Location: https://storage.googleapis.com/firefoxcitc-public-artifacts/EERRRYBdTcydBGSkIk1WrA/0/public/build/target.crashreporter-symbols.zip [following]
--2025-05-23 15:08:13--  https://storage.googleapis.com/firefoxcitc-public-artifacts/EERRRYBdTcydBGSkIk1WrA/0/public/build/target.crashreporter-symbols.zip
Resolving storage.googleapis.com (storage.googleapis.com)... 142.250.179.91, 142.250.179.123, 142.250.178.155, ...
Connecting to storage.googleapis.com (storage.googleapis.com)|142.250.179.91|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 517771558 (494M) [application/zip]
Saving to: ‘/dev/null’

/dev/null                                   100%[========================================================================================>] 493.79M  35.8MB/s    in 14s     

2025-05-23 15:08:27 (36.5 MB/s) - ‘/dev/null’ saved [517771558/517771558]

It's much better when the object is cached (~80MB/s), but the cache miss case is pretty awful.

See Also: → 1968011

With the object from bug 1968011 it's even worse:

$ wget -O/dev/null https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OtPQ75jrT4aCjjUeKfbJVQ/runs/0/artifacts/public/build/target.zip
--2025-05-23 16:31:22--  https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OtPQ75jrT4aCjjUeKfbJVQ/runs/0/artifacts/public/build/target.zip
Resolving firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)... 35.190.5.182
Connecting to firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)|35.190.5.182|:443... connected.
HTTP request sent, awaiting response... 303 See Other
Location: https://firefoxci.taskcluster-artifacts.net/OtPQ75jrT4aCjjUeKfbJVQ/0/public/build/target.zip [following]
--2025-05-23 16:31:22--  https://firefoxci.taskcluster-artifacts.net/OtPQ75jrT4aCjjUeKfbJVQ/0/public/build/target.zip
Resolving firefoxci.taskcluster-artifacts.net (firefoxci.taskcluster-artifacts.net)... 34.36.125.136
Connecting to firefoxci.taskcluster-artifacts.net (firefoxci.taskcluster-artifacts.net)|34.36.125.136|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 114000968 (109M) [application/zip]
Saving to: ‘/dev/null’

/dev/null                                   100%[========================================================================================>] 108.72M   856KB/s    in 2m 12s  

2025-05-23 16:33:34 (845 KB/s) - ‘/dev/null’ saved [114000968/114000968]

$ wget --header='x-taskcluster-skip-cdn: 1' -O/dev/null https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OtPQ75jrT4aCjjUeKfbJVQ/runs/0/artifacts/public/build/target.zip
--2025-05-23 16:33:58--  https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OtPQ75jrT4aCjjUeKfbJVQ/runs/0/artifacts/public/build/target.zip
Resolving firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)... 35.190.5.182
Connecting to firefox-ci-tc.services.mozilla.com (firefox-ci-tc.services.mozilla.com)|35.190.5.182|:443... connected.
HTTP request sent, awaiting response... 303 See Other
Location: https://storage.googleapis.com/firefoxcitc-public-artifacts/OtPQ75jrT4aCjjUeKfbJVQ/0/public/build/target.zip [following]
--2025-05-23 16:33:58--  https://storage.googleapis.com/firefoxcitc-public-artifacts/OtPQ75jrT4aCjjUeKfbJVQ/0/public/build/target.zip
Resolving storage.googleapis.com (storage.googleapis.com)... 2a00:1450:4007:810::201b, 2a00:1450:4007:80d::201b, 2a00:1450:4007:80e::201b, ...
Connecting to storage.googleapis.com (storage.googleapis.com)|2a00:1450:4007:810::201b|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 114000968 (109M) [application/zip]
Saving to: ‘/dev/null’

/dev/null                                   100%[========================================================================================>] 108.72M  23.6MB/s    in 5.4s    

2025-05-23 16:34:04 (20.3 MB/s) - ‘/dev/null’ saved [114000968/114000968]
You need to log in before you can comment on or make changes to this bug.