1249765 - Upload hg bundles to S3 bucket in us-west-1

Status: RESOLVED FIXED

(Developer Services :: Mercurial: hg.mozilla.org, defect)

Description

[Gregory Szorc [:gps]]

We are currently uploading hg bundles to buckets in us-west-2 and us-east-1. We have TaskCluster infrastructure in us-west-1. We should be uploading bundles to us-west-1 so the new IP filtering in bug 1249197 will serve S3 URLs to TaskCluster clients.

I have already created the S3 bucket. We just need to change the code to start uploading to us-west-1.

Comment 1

[Gregory Szorc [:gps]]

Attachment: MozReview Request: hgmo: upload hg bundles to us-west-1 (bug 1249765); r?hwine

TaskCluster has workers in us-west-1. We should upload hg bundles to
a bucket in us-west-1 so clients in usw1 can download from S3 within the
same AWS region.

I estimate the storage costs for this new region will run us around
$20/mo. The cost shouldn't even be worth worrying about :)

Review commit: https://reviewboard.mozilla.org/r/35675/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/35675/

Comment 2

[hwine]

Comment on attachment 8721464 [details]
MozReview Request: hgmo: upload hg bundles to us-west-1 (bug 1249765); r?hwine

https://reviewboard.mozilla.org/r/35675/#review32357

lgtm - emoji support yet? :thumbsup: :(

Comment 3

[Gregory Szorc [:gps]]

https://hg.mozilla.org/hgcustom/version-control-tools/rev/24d0f9419046d4c108685ea5d6a252545b8f0efc
hgmo: upload hg bundles to us-west-1 (bug 1249765); r=hwine

Comment 4

[Gregory Szorc [:gps]]

Deployed to prod and I'm generating bundles now.

There was a hiccup initially where the new S3 bucket didn't have appropriate permissions set. But things are working now. mozilla-central is advertising the bundles in us-west-1. Other repos are still generating.

Comment 5

[Gregory Szorc [:gps]]

https://hg.mozilla.org/hgcustom/version-control-tools/rev/b5f340ea4a1c1f12e0304cc0ec5395e4078bea2f
hgserver: update test output to reflect bundle upload to us-west-1 (bug 1249765)