1589706 - Migrate all firefox-ci related jobs to use AWS Provider

Status: RESOLVED FIXED

(Release Engineering :: Firefox-CI Administration, task)

Description

[Tom Prince [:tomprince]]

The new Firefox CI taskcluster instance will not have AWS Provisioner. In preparation for that migration, move all load to worker-manager's AWS Provider instead.

Comment 1

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Allow specifying worker-config and launchConfig by instance-type; r?Callek

This is needed for specifying configuration for volumes, which can vary between
EBS and non-EBS backed instances.

Comment 2

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Migrate hg-push worker to AWS provider; r?Callek

Comment 3

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Remove unused b-android worker type; r?Callek

Comment 4

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add support worker worker-manager pool aliases; r?Callek

Comment 5

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Migrate hg-push worker to AWS provider; r=Callek

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/71f00b917fb9
Remove unused b-android worker type; r=Callek
https://hg.mozilla.org/integration/autoland/rev/c3f3c9dd3537
Add support worker worker-manager pool aliases; r=Callek

Comment 7

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/71f00b917fb9
https://hg.mozilla.org/mozilla-central/rev/c3f3c9dd3537

Comment 8

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add level-1 and test gecko docker-workers; r?Callek

Comment 9

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Migrate linux test docker-workers to AWS Provider; r?Callek

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e9e6c8d830a0
[firefox-ci] Migrate linux test docker-workers to AWS Provider; r=Callek

Comment 11

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add more invalid worker/availability-zone combinations; r?Callek

Comment 12

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/e9e6c8d830a0

Comment 13

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Ensure that trusted images are used with level-3 workers; r?aki

Comment 14

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Remove obsolete taskcluster-images worker-type; r?aki

Comment 15

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add level 2 gecko workers; r?Callek

Comment 16

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add level 3 gecko workers; r?Callek

Comment 17

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Use AWS Provider-based decision worker; r?Callek

Comment 18

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Use AWS Provider-based linux builld workers; r?Callek

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ebb1e8ee2223
[firefox-ci] Use AWS Provider-based decision worker; r=Callek
https://hg.mozilla.org/integration/autoland/rev/1754c242268f
[firefox-ci] Use AWS Provider-based linux builld workers; r=Callek

Comment 20

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/ebb1e8ee2223
https://hg.mozilla.org/mozilla-central/rev/1754c242268f

Comment 21

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Prepare worker type definitions for generic-worker;

Comment 22

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add windows worker pools;

Comment 23

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add gecko-misc aws-provider worker pool;

Comment 24

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add support for generic-worker gecko worker pools;

1. Add support for distinct worker-config for different worker implemenations.
2. Rename worker level to security. Level 1/t windows workers have different
   security groups that level 1/t docker workers.

Comment 25

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Switch windows workers to aws-provider worker pools;

Comment 26

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Switch gecko-misc workers to aws-provider worker pools;

Comment 27

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Remove some obsolete code related to old staging clusters;

We originally had a different plan related to migrating worker-types to a new cluster.
Remove the code that supported that.

Comment 28

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Continue to use aws-provisioner t-win10-64-gpu-s worker;

This worker-type isn't working with worker-manager, so backout the change
switching to it.

Comment 29

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/5009aaef0c99
[firefox-ci] Switch windows workers to aws-provider worker pools; r=Callek a=me
https://hg.mozilla.org/mozilla-central/rev/8f4c7949e850
[firefox-ci] Switch gecko-misc workers to aws-provider worker pools; r=Callek a=me
https://hg.mozilla.org/mozilla-central/rev/dd4b06c1b982
[firefox-ci] Remove some obsolete code related to old staging clusters; r=Callek a=me
https://hg.mozilla.org/mozilla-central/rev/e8b7c48d4e7e
[firefox-ci] Continue to use aws-provisioner t-win10-64-gpu-s worker; r=Callek a=me

Comment 30

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: [firefox-ci] Switch to using aws-provider workers;

Comment 31

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add administrator scopes for AWS-Provider windows workers; r?Callek

Comment 32

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Update gecko-t/t-win10-64-gpu-s workers to a working image; r?Callek

Comment 33

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add comm windows worker pools; r?Callek

Comment 34

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add nss windows worker pools; r?Callek

Comment 35

[Pulsebot]

Backout by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/4e078e69f405
Backed out changeset e8b7c48d4e7e now that gecko-t/t-win10-64-gpu-s is working.

Comment 36

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Switch to using aws-provider worker-pool; r?sheehan

Comment 37

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add aws-provider workers for hg; r?Callek

Comment 38

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add aws-provider workers from releng repositories; r?Callek

Comment 39

[Phabricator Automation]

Comment on attachment 9107294 [details]
Bug 1589706: [firefox-ci] Switch to using aws-provider workers;

Revision D52225 was moved to bug 1595153. Setting attachment 9107294 [details] to obsolete.

Comment 40

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add aws-provider workers for app-services; r?mhentges

Comment 41

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Use aws-provider workers for cron tasks; r?Callek

Comment 42

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Update websocktunnel audience and host

Comment 43

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/02488754532b
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/f5d645dfa6b1
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/c5846f4cbd6a
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/e614c3f5c7f6
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/66b949224fbd
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/38bc4646518b
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/debb8f2dbcde
FIREFOX_ESR_68_2_X_RELBRANCH https://hg.mozilla.org/releases/mozilla-esr68/rev/034d83f90ded

Comment 44

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/hgcustom/version-control-tools/rev/2645a89d25dc
Switch to using aws-provider worker-pool; r=sheehan

Comment 45

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Remove aws-provisioner tasks scopes to make pushes fail faster; r?Callek

Comment 46

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Add aws-provider workers for ci-{admin,config}; r?aki

Comment 47

[Tom Prince [:tomprince]]

Attachment: Bug 1589706: Use aws-provider workers for ci-config; r?aki