1222227 - Tracking bug for migration from ftp.m.o to S3 (b2g)

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Nick Thomas [:nthomas] (UTC+12)]

This includes public uploads to stage, and private ones to pvtbuilds2 and friends.

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

There's several parts to this. Many builds are moving to TC, but not until mid-Dec. Mulet on Windows & Mac, and ICS emulator builds are staying on buildbot and need to be handled here. We're planning to migrate b2g to S3 on Nov 25.

This bug is limited to
* swapping public uploads for mulet and ICS emulator, as well as any builds that haven't moved to TC yet, to the new upload hosts
* in a dep bug we'll redo manifest upload. Socorro files will continue as is but upload via S3, manifests are going to TC

Later we'll teach emulator builds to upload to TC too, so that we can stop using pvtbuilds2. The sticky bit there is the tests which need to get from behind auth.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [gecko] Migrate to new upload hosts, and redo Socorro and source manifest uploads

This isn't in the order you'll see it, but logically it's grouped as:

* move to S3 for public uploads
  * use upload.ffxbld.productdelivery.prod.mozaws.net instead of stage.m.o
  * remove _BUG1218570_OVERRIDES in branch_specifics, so Mulet goes that way too

* Socorro upload shifts to S3 API
 * keeps the socorro_<target>_YYYY-MM-DD-HH.json naming which the Socorro scraper expects, but ditches socorro_<target>.json
 * rename the action to upload-socorro-json, copy credentials into mock (all the changes in b2g/config)
 * add new config (bucket, credentials, etc). The duplicated branches config should be shared with manifests but I'd like to fix that in a followup. The "'ash': 999.0" line is just for testing, and will be culled before landing on b2g-i and co

* Source manifests go to TC
 * mulet is already doing this via fx_desktop.py this is for devices and emulator via b2g_build.py
 * copy in _initialize_taskcluster() and _taskcluster_upload() from mozharness.mozilla.building.buildbase, then adjust for b2g snowflake-ness
 * swaps to consistent sources.xml naming, since the index/tasks keep the files separate
 * where we run buildbot and TC jobs for same configuraion I think we'll stomp on each other in the index. Not sure how to avoid that if they're set up the same. Hopefully this doesn't matter for manifests, if the partners care only for git revisions.

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [puppet] Upload logs via new upload hosts

This was a special case we added because b2g hadn't moved yet, and we'll fall back to the * handling earlier in the file

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [buildbot-configs] Update stage_server for b2g

This mainly affects the 2.2 branches where we still use buildbot factories. The try change is a no-op based on a master dump, it just looked wrong to be using the ffxbld upload host.

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8691933 [details] [diff] [review]
[gecko] Migrate to new upload hosts, and redo Socorro and source manifest uploads

This is blowing up on ash (dep builds failing it activate the venv; nightly builds failing on mapper). I'm going to disable socorro and source manifest upload so we can proceed with migration today, then fix asap.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [gecko] New upload host, disables socorro + source manifest upload

Comment 7

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8691942 [details] [diff] [review]
[buildbot-configs] Update stage_server for b2g

https://hg.mozilla.org/build/buildbot-configs/rev/41ffacf18573
https://hg.mozilla.org/build/buildbot-configs/rev/aec20f1c38b8

Comment 8

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8691936 [details] [diff] [review]
[puppet] Upload logs via new upload hosts

https://hg.mozilla.org/build/puppet/rev/610585188696
https://hg.mozilla.org/build/puppet/rev/35dca06a6611

Up to 30min to deploy.

Comment 11

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8692131 [details] [diff] [review]
[gecko] New upload host, disables socorro + source manifest upload

https://hg.mozilla.org/integration/b2g-inbound/rev/75f773254be6
https://hg.mozilla.org/integration/fx-team/rev/3e7edd0d28a6
https://hg.mozilla.org/integration/mozilla-inbound/rev/6fad1abcf96b

Comment 12

[Nick Thomas [:nthomas] (UTC+12)]

https://hg.mozilla.org/releases/mozilla-b2g44_v2_5/rev/a883c12a75da

Still need to look at the 2.2 and 2.2r b2g branches.

Comment 13

[Nick Thomas [:nthomas] (UTC+12)]

https://hg.mozilla.org/releases/mozilla-b2g37_v2_2/rev/55474d171658
https://hg.mozilla.org/releases/mozilla-b2g37_v2_2r/rev/d9b68938de6e

Comment 14

[Nick Thomas [:nthomas] (UTC+12)]

We carried this off today without incident. Bug 1228214 to re-enable source manifest and socorro data upload.

Comment 15

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/75f773254be6

Comment 16

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/3e7edd0d28a6

Comment 17

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/6fad1abcf96b