1601736 - Use preemptible instances in GCP

Status: RESOLVED FIXED

(Release Engineering :: Firefox-CI Administration, defect)

Description

[Chris Cooper [:coop] (he/him)]

We've been running on on-demand instances in GCP rather than preemptible. We need to change this before we migrate any further workloads or we'll end up paying too much.

It's a pretty simple addition to the ci-configs, the equivalent of:

"scheduling": {
"onHostMaintenance": "TERMINATE",
"automaticRestart": false,
"preemptible": true
},

Patch incoming.

Comment 1

[Chris Cooper [:coop] (he/him)]

Attachment: Bug 1601736 - use preemptible instances in GCP

Comment 2

[Chris Cooper [:coop] (he/him)]

Attachment: Bug 1601736 - remove extraneous syntax

Depends on D56045

Comment 3

[Mihai Tabara [:mtabara]⌚️GMT]

Deployed.

Comment 4

[Tom Prince [:tomprince]]

We should not set these options per-instance, but rather globally.

Comment 5

[Tom Prince [:tomprince]]

Attachment: Bug 1601736: Force gcp worker to be preemptible; r?aki

Comment 6

[Tom Prince [:tomprince]]

Attachment: Bug 1601736: Remove gcp worker filtering, as the workers have been removed; r?aki

We initially filtered out some worker-pools from worker-manager providers
in the legacy cluster that didn't exist in the firefox-ci cluster. Now
that those have been removed, we can stop filtering them out.

Comment 7

[Tom Prince [:tomprince]]

Attachment: Bug 1601736: Remove unused worker-pools; r?aki

These worker pools have never been used in the firefox-ci cluster. They were
test workers in the legacy cluster with provider ids that are not in the new
cluster.

Comment 8

[Tom Prince [:tomprince]]

Attachment: Bug 1601736: Remove unused worker-pools; r?aki

These worker pools have never been used in the firefox-ci cluster. They were
test workers in the legacy cluster with provider ids that are not in the new
cluster.

Comment 9

[Tom Prince [:tomprince]]

Attachment: Backed out 2 changesets (bug 1601736): Remove explicty gcp worker scheduling settings; r?aki

These are hard-coded in ci-admin (and if we ever need non-prememtible workers
we can add a setting to control that there).

Backed out changeset 45c9502ffe23 (bug 1601736)
Backed out changeset cf2dffcf28c6 (bug 1601736)