1833603 - firefox release pipeline relies on net-mozaws-{prod,stage}-delivery-* s3 buckets

Status: RESOLVED FIXED

(Release Engineering :: Release Automation, task)

Description

[Julien Cristau [:jcristau]]

We've moved archive.mozilla.org to be backed by gcs buckets so tasks need to stop relying on downloading from the s3 buckets directly.

Comment 1

[Julien Cristau [:jcristau]]

https://searchfox.org/mozilla-central/search?q=net-mozaws&path=&case=false&regexp=false

Comment 2

[Julien Cristau [:jcristau]]

Attachment: Bug 1833603 - update flatpak repackage task to download from archive.m.o instead of s3 buckets directly. r?#releng

Comment 3

[Julien Cristau [:jcristau]]

Attachment: Bug 1833603 - wip: switch release-generate-checksums from s3 to gcs

Comment 4

[Intermittent Failures Robot]

2 failures in 3578 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2

Platform and build breakdown:

• linux64-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1833603&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 5

[Julien Cristau [:jcristau]]

Attachment: Bug 1833603 - use google cloud storage instead of amazon s3 for release-generate-checksums task. r?#releng

Comment 6

[Julien Cristau [:jcristau]]

Attachment: Bug 1833603 - update snap repackage task to download from archive.m.o instead of s3 buckets directly. r?#releng

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/837ef9e285bd
use google cloud storage instead of amazon s3 for release-generate-checksums task. r=releng-reviewers,bhearsum DONTBUILD
https://hg.mozilla.org/integration/autoland/rev/b8d6207023b9
update flatpak repackage task to download from archive.m.o instead of s3 buckets directly. r=releng-reviewers,bhearsum,hneiva DONTBUILD
https://hg.mozilla.org/integration/autoland/rev/7d7efb2b73d4
update snap repackage task to download from archive.m.o instead of s3 buckets directly. r=releng-reviewers,bhearsum DONTBUILD

Comment 8

[Julien Cristau [:jcristau]]

tested in staging release: https://treeherder.mozilla.org/jobs?repo=try&revision=2259eb6c7fbafef22bb8b579964d4df74e3333fb

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/837ef9e285bd
https://hg.mozilla.org/mozilla-central/rev/b8d6207023b9
https://hg.mozilla.org/mozilla-central/rev/7d7efb2b73d4

Comment 10

[Julien Cristau [:jcristau]]

ni?self to request esr102 uplift after 115 is in beta

Comment 11

[Julien Cristau [:jcristau]]

Comment on attachment 9335226 [details]
Bug 1833603 - use google cloud storage instead of amazon s3 for release-generate-checksums task. r?#releng

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: we'd like to stop uploading release artifacts to s3, and use gcs exclusively, but these tasks use the s3 buckets directly; this switches them to use archive.mozilla.org itself, or the corresponding gcs buckets.
• User impact if declined: n/a
• Fix Landed on Version: 115
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): No issues on beta since this landed.

I'll note the release-generate-checksums change will need a corresponding update for comm-esr102.

Comment 12

[Julien Cristau [:jcristau]]

:rjl FYI about the comm-esr102 impact if/when this goes into mozilla-esr102.

Comment 13

[Donal Meehan [:dmeehan]]

Comment on attachment 9335226 [details]
Bug 1833603 - use google cloud storage instead of amazon s3 for release-generate-checksums task. r?#releng

Approved for 102.13esr.

Comment 14

[Donal Meehan [:dmeehan]]

Comment on attachment 9335228 [details]
Bug 1833603 - update snap repackage task to download from archive.m.o instead of s3 buckets directly. r?#releng

Approved for 102.13esr.

Comment 15

[Donal Meehan [:dmeehan]]

https://hg.mozilla.org/releases/mozilla-esr102/rev/c9ae202c8cae
https://hg.mozilla.org/releases/mozilla-esr102/rev/5741ffac993d

Comment 16

[Rob Lemley [:rjl]]

(In reply to Julien Cristau [:jcristau] from comment #12)

:rjl FYI about the comm-esr102 impact if/when this goes into mozilla-esr102.

danke.