1583557 - Replace manual GCP linux pool with one managed by worker-manager

Status: RESOLVED FIXED

(Taskcluster :: Workers, task)

Description

[Chris Cooper [:coop] (he/him)]

As has become apparent in bug 1570148, we need to decomm the existing manually-managed pool of linux workers in favour of a proper worker pool that uses the GCP projects managed by relops.

This will involve a bunch of changes:

• updating worker types for existing tier-3 builds in GCP (e.g. [1], [2])
• changes to ci-configuration to include the new worker pool [3]
• testing to make sure builders work, including sccache hits (bug 1570148)

1. https://hg.mozilla.org/mozilla-central/file/79b08a0a1c3fa2834e668b205fd69ff79c8630d1/taskcluster/taskgraph/util/workertypes.py#l14
2. https://hg.mozilla.org/mozilla-central/file/79b08a0a1c3fa2834e668b205fd69ff79c8630d1/taskcluster/ci/build/linux.yml#l1192 (and other platform-specific ymls)
3. https://hg.mozilla.org/ci/ci-configuration/file/8ef9a588b99c0fa28c8c6a39db0d78e8cc8d61cc/worker-pools.yml

Comment 1

[Brian Stack [:bstack]]

Attachment: Bug 1583557 - Add linux builders in gcp

Comment 2

[Brian Stack [:bstack]]

Attachment: Bug 1583557 - Don't do level 3 with these new workers anymore

Comment 3

[Brian Stack [:bstack]]

Attachment: Bug 1583557 - Add back in level 3 and increase instance size

Comment 4

[Brian Stack [:bstack]]

ok, I believe these are "working". next step I guess is testing and iterating on whatever goes wrong

Comment 5

[Brian Stack [:bstack]]

Attachment: Bug 1583557 - Increase workerpool size

Comment 6

[Brian Stack [:bstack]]

I haven't heard of any issues with this since we launched it. I'll close for now and we can reopen if it turns out something isn't working with provisioning.