Closed Bug 1768865 Opened 3 years ago Closed 2 years ago

Update taskcluster-worker.net certificates on all docker-worker workers that serve live logs before 2022/06/16

Categories

(Infrastructure & Operations :: RelOps: Posix OS, task, P2)

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: pmoore, Assigned: masterwayz)

References

Details

(Whiteboard: [relops-general])

Attachments

(8 files)

New certificate needed for docker-worker workers in FirefoxCI and Community-TC.

The last time this was done was bug 1714818.

This is mostly a manual affair at the moment as docker-worker is approaching end-of-life.

For Community-TC, we have an image set that we can update with the new cert in the bootstrap.sh script inside this image set.

For FirefoxCI we'll need to perform a similar process, but with different aws_filters and gcp_filters, for each of the affected image sets used in production. Bug 1714818 gives a bit more detail on the process. Essentially, the imageset.sh script can be used to start an instance based on the previous AWS AMIs / GCP images, patch the host environment to have the updated certificate, and then shutdown and snapshot the machine to generate new AWS AMIs / GCP images. Once this has been done, the ci-configuration repo can be updated to use the updated images for FirefoxCI, and in Community-TC, tc-admin can be run to update the worker pools.

Looks like we have a DigiCert certificate at the moment:

Common name: *.taskcluster-worker.net
SANs: *.taskcluster-worker.net, taskcluster-worker.net
Organization: Mozilla Corporation
Location: Mountain View, California, US
Valid from June 10, 2021 to June 16, 2022
Serial Number: 064cdf334a214e0f7a565bceaebe8003
Signature Algorithm: sha256WithRSAEncryption
Issuer: DigiCert TLS RSA SHA256 2020 CA1

Depends on: 1768879
Summary: taskcluster-worker.net certificate expires on 2022/06/16 → Update taskcluster-worker.net certificates on all docker-worker workers that serve live logs before 2022/06/16

Deployed to Community-TC docker-worker workers (only affected pool is proj-taskcluster/aws-test).

Live logs working, and certificates are correct:

Common name: *.taskcluster-worker.net
SANs: *.taskcluster-worker.net, taskcluster-worker.net
Organization: Mozilla Corporation
Location: Mountain View, California, US
Valid from May 11, 2022 to June 12, 2023
Serial Number: 037ee7df2ec376820cd846bd5b822a2d
Signature Algorithm: sha256WithRSAEncryption
Issuer: DigiCert TLS RSA SHA256 2020 CA1

Common name: DigiCert TLS RSA SHA256 2020 CA1
Organization: DigiCert Inc
Location: US
Valid from April 13, 2021 to April 13, 2031
Serial Number: 06d8d904d5584346f68a2fa754227ec4
Signature Algorithm: sha256WithRSAEncryption
Issuer: DigiCert Global Root CA

Unique AMIs in FirefoxCI, determined by running mozilla-history, and then grepping for ami- in the generated WorkerPools directory:

ami-0088f6f069a63870e
ami-009cce218d63116de
ami-00f2cff76f39b3333
ami-0128afe4764e1e1b0
ami-015aa627cafe4cca7
ami-01db0b27d4878f677
ami-01e485efdaf4adc46
ami-022c0b744b13e611e
ami-02641726e4b419ba4
ami-026ed942b8c9d7503
ami-02f981615a8102d24
ami-03c5857f47d11d797
ami-04731c2ad4e13306b
ami-0483d5338c35a6bf7
ami-04a4865797a61b24d
ami-04f6d199fb4335a2f
ami-050c052ed6df6a2cf
ami-0520ba0d12752373c
ami-06342dd8da2c37197
ami-06f345a21f6faad86
ami-07019f350daecd3bd
ami-07158734d06a46355
ami-07db1c26bda143e33
ami-0800e67eddba22aa7
ami-08dcc6990d39afe94
ami-08f30fc003814c298
ami-0926dadf98882995d
ami-098ffef5cf401c46d
ami-09c8f4c0b88a9d335
ami-0a4c44377468bfa3f
ami-0c723de2ffe641a90
ami-0c76678a5bdb06f4e
ami-0c87b43691de5ef70
ami-0cb04cbc768d418a5
ami-0cecd6bf98b15e862
ami-0d05851ab254517de
ami-0d80b9acdefa73057
ami-0ded8859755ebede7
ami-0df9550ff5dffff81
ami-0eb7fd3631b03ab9b
ami-0ebc5c792d8418b65
ami-0eda623438535d185
ami-0f083b98e4afaffa4
ami-0f549567e4654e936
ami-0f9193bae5a2b7026
ami-0fd21b9566eba5684

Filtering by worker pool definitions that contain property deviceManagement (a config setting which all docker-worker worker pools should have) and then matching this against https://hg.mozilla.org/ci/ci-configuration/file/tip/worker-images.yml we find the following four unique AMI sets in use:

  • docker-worker-v202004241848-hvm-builder-bug1676214
  • docker-worker-v202004241848-hvm-builder-trusted-bug1705196
  • monopacker-docker-worker-2020-05-04T14-30-19Z-bug1676214
  • monopacker-docker-worker-2020-08-05t22-29-20z-bug1676214

This matches the ami sets from the previous cert upgrade in https://phabricator.services.mozilla.com/D127682 from bug 1714818 exactly.

The affected gcp images affected can be found using the same technique, and this returns:

  • projects/fxci-production-level3-workers/global/images/fxci-level3-gcp-0y049yr8imhe3lz4vlcn
  • projects/taskcluster-imaging/global/images/fxci-level1-gcp-0y9sk1q1wfj5d06y0nea
  • projects/taskcluster-imaging/global/images/ubuntu-1404

This matches the list from last time too, but additionally includes projects/taskcluster-imaging/global/images/ubuntu-1404.

It looks like this image is used only by gecko-1/masterwayz-bug1764751. I will coordinate with :masterwayz about this.

See Also: → 1764751

The new *.taskcluster.net certificate, expires June 12, 2023.

Attached file DigiCertCA.crt

New DigiCert intermediary certificate, expires April 13, 2031.

I have created new GCP / AWS images for all the FirefoxCI docker-worker worker pools (with the exception of gecko-1/masterwayz-bug1764751 which is being handled separately in bug 1764751 comment 7). See comment 5 for the breakdown by image (set).

The above patch will update the production worker pools to use them, on landing.

Note, the new machine images were generated by running this cert-patching script against the old machine images.

This is the same technique that was used in bug 1714818 in October to patch the certificates then, and also the technique used in comment 2 to update Community-TC cluster too, so it should be fairly reliable. I was also able to confirm that none of the machine images had changed since the previous update in bug 1714818.

Pushed by asasaki@mozilla.com: https://hg.mozilla.org/ci/ci-configuration/rev/596186d337cc Update gcp and aws images for docker-worker worker pools, r=releng-reviewers,aki

All seems to be fine, e.g. from a recent live log of a job for a running try push, I see the new expiry date of June 12 2023.

 $ echo | openssl s_client -connect apt6joiaaaaybuklkyu7x7b5g7ibhjxcppwvxkc5qwhascjz.taskcluster-worker.net:32770 2> /dev/null | openssl x509 -noout -dates
notBefore=May 12 00:00:00 2022 GMT
notAfter=Jun 12 23:59:59 2023 GMT
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED

Has community-tc been fixed? The raw log for https://community-tc.services.mozilla.com/tasks/fJ6G9jXyTcaj0D7Kwi0TTw/runs/0/logs/public/logs/live.log showed an expired cert alert (expired 2022-06-17).

Flags: needinfo?(pmoore)

Tooru also hit an expired certificate error for interactive workers on firefox-ci.

I get the following right now:

$ echo | openssl s_client -connect epctnkiaaaayeasleg5h4fbanqkqj6dullo2d6mb54tzp2l5.taskcluster-worker.net:46023 2> /dev/null | openssl x509 -noout -dates
notBefore=Jun 11 00:00:00 2021 GMT
notAfter=Jun 16 23:59:59 2022 GMT
Flags: needinfo?(pmoore)
See Also: → 1772714

I believe worker certs from bug 1772714 and bug 1764751 are currently being updated. Dave, can you confirm? Thanks!

Flags: needinfo?(dhouse)

I still get the old cert, when using Interactive task's shell.

$ echo | openssl s_client -connect ej5ptriaaaayegwxrfsj4h6h3fyqnrwjca2elqv5aycc3gdf.taskcluster-worker.net:41428 2> /dev/null | openssl x509 -noout -dates
notBefore=Jun 11 00:00:00 2021 GMT
notAfter=Jun 16 23:59:59 2022 GMT

perhaps it's not updated properly?

I still get the old cert, when using Interactive task's shell.

$ echo | openssl s_client -connect ej5ptriaaaayegwxrfsj4h6h3fyqnrwjca2elqv5aycc3gdf.taskcluster-worker.net:41428 2> /dev/null | openssl x509 -noout -dates
notBefore=Jun 11 00:00:00 2021 GMT
notAfter=Jun 16 23:59:59 2022 GMT

perhaps it's not updated properly?

I'm afraid so. See comment 15, there are a couple of updates still in flight.

Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Assignee: pmoore → dhouse
Component: Workers → RelOps: Posix OS
Product: Taskcluster → Infrastructure & Operations
See Also: → 1786307
See Also: → 1785152
Whiteboard: [relops-general]
See Also: → 1799786
Duplicate of this bug: 1799786

I will take this from dhouse's plate.

Assignee: dhouse → mgoossens
Status: REOPENED → ASSIGNED
Flags: needinfo?(dhouse)
Duplicate of this bug: 1785152
Blocks: 1786307
See Also: 1786307
Pushed by mgoossens@mozilla.com: https://hg.mozilla.org/ci/ci-configuration/rev/7fc2bf502c14 Create livelog testing pool for level 1 GCP builders r=ahal
Attachment #9302956 - Attachment description: Bug 1768865 - Create livelog testing pool for level 1 GCP testers r=ahal! → Bug 1768865 - Create livelog testing pool for level 1 GCP testers r=#releng-reviewers
Pushed by mgoossens@mozilla.com: https://hg.mozilla.org/ci/ci-configuration/rev/aef9090229d4 Create livelog testing pool for level 1 GCP testers r=releng-reviewers,gbrown
Pushed by mgoossens@mozilla.com: https://hg.mozilla.org/ci/ci-configuration/rev/9e528d981a10 Use image with new livelog cert on GCP level 1 testers and builders r=releng-reviewers,jlorenzo

Hi, this should be fixed now.
Could you verify?

Flags: needinfo?(pmoore)

Others have verified that this is fixed on the GCP side.
I recall AWS also working already so we should be good here.

Status: ASSIGNED → RESOLVED
Closed: 3 years ago2 years ago
Flags: needinfo?(pmoore)
Resolution: --- → FIXED

(In reply to Michelle Goossens [:masterwayz] from comment #27)

Hi, this should be fixed now.
Could you verify?

So it looks like in firefox-ci there are a lot of unique image sets in use...

I wrote a script to generate a report, and got these results:

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-32380c6
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-32380c6
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-32380c6
Used by:
  gecko-t⁄win11-64-2009-gpu-beta

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northcentralus-20h1-evd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northeurope-20h1-evd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-alpha
Used by:
  gecko-t⁄win10-64-2004-gpu-alpha

Machine images:
  ami-03c5857f47d11d797
  ami-0800e67eddba22aa7
  ami-0c723de2ffe641a90
  ami-01e485efdaf4adc46
Used by:
  gecko-t⁄t-win7-32-beta

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-centralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-eastus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-eastus2-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-westus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-westus2-20h1-evd-892e806
Used by:
  comm-t⁄win10-64-2004
  gecko-t⁄win10-64-2004-beta
  gecko-t⁄win10-64-2004-source-ssd
  gecko-t⁄win10-64-2004-source
  gecko-t⁄win10-64-2004-ssd
  gecko-t⁄win10-64-2004

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-eastus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northeurope-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-westeurope-20h1-evd-892e806
Used by:
  gecko-t⁄win10-64-2004-ssd-gpu

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012-r2-64-centralus-2012-R2-Datacenter-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012-r2-64-northcentralus-2012-R2-Datacenter-alpha
Used by:
  gecko-1⁄win2012-azure-f32
  gecko-1⁄win2012-azure

Machine images:
  ami-09c8f4c0b88a9d335
  ami-0eb7fd3631b03ab9b
  ami-0a4c44377468bfa3f
Used by:
  mozillavpn-1⁄b-win2012

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-alpha
Used by:
  gecko-t⁄win11-64-2009-gpu-alpha

Machine images:
  ami-08f30fc003814c298
  ami-0c76678a5bdb06f4e
  ami-0520ba0d12752373c
Used by:
  mpd001-3⁄b-win2012

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westeurope-win11-21h2-avd-alpha
Used by:
  gecko-t⁄win11-64-2009-gpu
  gecko-t⁄win11-64-2009-perf

Machine images:
  ami-029998f24ee67c828
  ami-0023a52f54d07188e
  ami-0b9ad26d4f2651ee9
Used by:
  adhoc-1⁄b-linux
  adhoc-1⁄decision
  adhoc-1⁄images
  app-services-1⁄b-linux
  app-services-1⁄decision
  app-services-1⁄images
  ci-1⁄decision
  ci-1⁄images
  ci-3⁄decision
  ci-3⁄images
  ci-t⁄linux
  code-analysis-1⁄linux
  code-analysis-3⁄linux
  code-coverage⁄bot
  code-review⁄bot
  comm-1⁄b-linux-large
  comm-1⁄b-linux-xlarge
  comm-1⁄b-linux
  comm-1⁄decision
  comm-1⁄images
  comm-2⁄b-linux-large
  comm-2⁄b-linux-xlarge
  comm-2⁄b-linux
  comm-2⁄decision
  comm-2⁄images
  comm-t⁄misc
  comm-t⁄t-linux-large
  comm-t⁄t-linux-xlarge-source
  comm-t⁄t-linux-xlarge
  gecko-1⁄b-linux-aws
  gecko-1⁄b-linux-large
  gecko-1⁄b-linux-perf
  gecko-1⁄b-linux-xlarge
  gecko-1⁄b-linux
  gecko-1⁄decision
  gecko-1⁄images
  gecko-2⁄b-linux-large
  gecko-2⁄b-linux-xlarge
  gecko-2⁄b-linux
  gecko-2⁄decision
  gecko-2⁄images
  gecko-t⁄misc
  gecko-t⁄t-linux-large
  gecko-t⁄t-linux-xlarge-source
  gecko-t⁄t-linux-xlarge
  glean-1⁄b-linux
  glean-1⁄decision
  glean-1⁄images
  infra⁄build-decision
  kaios-1⁄b-linux-large
  kaios-1⁄b-linux-xlarge
  kaios-1⁄b-linux
  kaios-1⁄decision
  kaios-1⁄images
  kaios-2⁄b-linux-large
  kaios-2⁄b-linux-xlarge
  kaios-2⁄b-linux
  kaios-2⁄decision
  kaios-2⁄images
  kaios-t⁄misc
  kaios-t⁄t-linux-xlarge-source
  kaios-t⁄t-linux-xlarge
  l10n-1⁄decision
  l10n-1⁄images
  l10n-1⁄linux
  l10n-3⁄decision
  l10n-3⁄images
  l10n-3⁄linux
  mobile-1⁄b-linux-large
  mobile-1⁄b-linux-xlarge
  mobile-1⁄b-linux
  mobile-1⁄bitrise
  mobile-1⁄decision
  mobile-1⁄images
  mozillaonline-1⁄b-linux
  mozillaonline-3⁄b-linux
  mozillavpn-1⁄b-linux-large
  mozillavpn-1⁄b-linux
  mozillavpn-1⁄decision
  mozillavpn-1⁄images
  nss-1⁄linux
  nss-3⁄linux
  project-relman⁄relman-svc
  releng-1⁄b-linux
  releng-1⁄decision
  releng-1⁄linux
  releng-t⁄linux
  relops-3⁄decision
  scriptworker-1⁄b-linux
  scriptworker-1⁄decision
  scriptworker-1⁄images
  taskgraph-1⁄decision
  taskgraph-1⁄images
  taskgraph-3⁄decision
  taskgraph-3⁄images
  taskgraph-t⁄linux
  xpi-1⁄b-linux
  xpi-1⁄decision
  xpi-1⁄images

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus2-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus2-win11-21h2-avd
Used by:
  gecko-t⁄win11-64-2009-ssd-datatest

Machine images:
  ami-02641726e4b419ba4
  ami-0ebc5c792d8418b65
  ami-0cecd6bf98b15e862
Used by:
  gecko-t⁄t-win7-32-gpu

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus2-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus2-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus2-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westus2-win11-21h2-avd-alpha
Used by:
  gecko-t⁄win11-64-2009-source
  gecko-t⁄win11-64-2009-ssd
  gecko-t⁄win11-64-2009

Machine images:
  ami-0b4be552fadff3b32
  ami-033412e2574dff89d
  ami-0b4affa0b42f6c9d2
Used by:
  comm-3⁄b-win2012
  gecko-3⁄b-win2012
  mozillavpn-3⁄b-win2012

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-trusted-u1804-2022-08-12b
Used by:
  adhoc-3⁄b-linux-gcp
  adhoc-3⁄decision-gcp
  adhoc-3⁄images-gcp
  app-services-3⁄b-linux-gcp
  app-services-3⁄decision-gcp
  app-services-3⁄images-gcp
  ci-3⁄decision-gcp
  ci-3⁄images-gcp
  code-analysis-3⁄linux-gcp
  comm-3⁄b-linux-gcp
  comm-3⁄b-linux-large-gcp
  comm-3⁄b-linux-xlarge-gcp
  comm-3⁄decision-gcp
  comm-3⁄images-gcp
  gecko-3⁄b-linux-gcp
  gecko-3⁄b-linux-large-gcp
  gecko-3⁄b-linux-xlarge-gcp
  gecko-3⁄decision-gcp
  gecko-3⁄images-gcp
  glean-3⁄b-linux-gcp
  glean-3⁄decision-gcp
  glean-3⁄images-gcp
  l10n-3⁄decision-gcp
  l10n-3⁄images-gcp
  l10n-3⁄linux-gcp
  mobile-3⁄b-linux-gcp
  mobile-3⁄b-linux-large-gcp
  mobile-3⁄b-linux-xlarge-gcp
  mobile-3⁄decision-gcp
  mobile-3⁄images-gcp
  mozillaonline-3⁄b-linux-gcp
  mozillavpn-3⁄b-linux-gcp
  mozillavpn-3⁄b-linux-large-gcp
  mozillavpn-3⁄decision-gcp
  mozillavpn-3⁄images-gcp
  nss-3⁄linux-gcp
  releng-3⁄b-linux-gcp
  releng-3⁄decision-gcp
  releng-3⁄linux-gcp
  relops-3⁄decision-gcp
  scriptworker-3⁄b-linux-gcp
  scriptworker-3⁄decision-gcp
  scriptworker-3⁄images-gcp
  taskgraph-3⁄decision-gcp
  taskgraph-3⁄images-gcp
  xpi-3⁄b-linux-gcp
  xpi-3⁄decision-gcp
  xpi-3⁄images-gcp

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-centralus-20h1-evd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northcentralus-20h1-evd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northeurope-20h1-evd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-alpha
Used by:
  gecko-t⁄win10-64-2004-alpha

Machine images:
  ami-0f083b98e4afaffa4
  ami-009cce218d63116de
  ami-050c052ed6df6a2cf
  ami-04731c2ad4e13306b
Used by:
  gecko-1⁄b-win2012-beta

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-centralus-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-eastus-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-eastus2-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-northcentralus-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-southcentralus-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-westus-20h1-evd-f160361
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/gecko-t-win10-64-2004-westus2-20h1-evd-f160361
Used by:
  gecko-t⁄win10-64-2004-ssd-datatest

Machine images:
  ami-01db0b27d4878f677
  ami-04a4865797a61b24d
  ami-098ffef5cf401c46d
  ami-06f345a21f6faad86
Used by:
  gecko-t⁄t-win7-32

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-08-00z
Used by:
  adhoc-1⁄b-linux-gcp
  adhoc-1⁄decision-gcp
  adhoc-1⁄images-gcp
  app-services-1⁄b-linux-gcp
  app-services-1⁄decision-gcp
  app-services-1⁄images-gcp
  ci-1⁄decision-gcp
  ci-1⁄images-gcp
  ci-t⁄linux-gcp
  code-analysis-1⁄linux-gcp
  comm-1⁄b-linux-gcp
  comm-1⁄b-linux-large-gcp
  comm-1⁄b-linux-xlarge-gcp
  comm-1⁄decision-gcp
  comm-1⁄images-gcp
  comm-2⁄b-linux-gcp
  comm-2⁄b-linux-large-gcp
  comm-2⁄b-linux-xlarge-gcp
  comm-2⁄decision-gcp
  comm-2⁄images-gcp
  comm-t⁄misc-gcp
  gecko-1⁄b-linux-gcp
  gecko-1⁄b-linux-large-gcp
  gecko-1⁄b-linux-xlarge-gcp
  gecko-1⁄decision-gcp
  gecko-1⁄images-gcp
  gecko-1⁄masterwayz-bug1768865
  gecko-2⁄b-linux-gcp
  gecko-2⁄b-linux-large-gcp
  gecko-2⁄b-linux-xlarge-gcp
  gecko-2⁄decision-gcp
  gecko-2⁄images-gcp
  gecko-t⁄misc-gcp
  glean-1⁄b-linux-gcp
  glean-1⁄decision-gcp
  glean-1⁄images-gcp
  kaios-1⁄decision-gcp
  kaios-1⁄images-gcp
  kaios-2⁄decision-gcp
  kaios-2⁄images-gcp
  kaios-t⁄misc-gcp
  l10n-1⁄decision-gcp
  l10n-1⁄images-gcp
  l10n-1⁄linux-gcp
  mobile-1⁄b-linux-gcp
  mobile-1⁄b-linux-large-gcp
  mobile-1⁄b-linux-xlarge-gcp
  mobile-1⁄decision-gcp
  mobile-1⁄images-gcp
  mozillaonline-1⁄b-linux-gcp
  mozillavpn-1⁄b-linux-gcp
  mozillavpn-1⁄b-linux-large-gcp
  mozillavpn-1⁄decision-gcp
  mozillavpn-1⁄images-gcp
  nss-1⁄linux-gcp
  releng-1⁄b-linux-gcp
  releng-1⁄decision-gcp
  releng-1⁄linux-gcp
  releng-t⁄linux-gcp
  scriptworker-1⁄b-linux-gcp
  scriptworker-1⁄decision-gcp
  scriptworker-1⁄images-gcp
  taskgraph-1⁄decision-gcp
  taskgraph-1⁄images-gcp
  taskgraph-t⁄linux-gcp
  xpi-1⁄b-linux-gcp
  xpi-1⁄decision-gcp
  xpi-1⁄images-gcp

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd-32380c6
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-32380c6
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-32380c6
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-32380c6
Used by:
  gecko-t⁄win11-64-2009-beta

Machine images:
  ami-0df9550ff5dffff81
  ami-022c0b744b13e611e
  ami-0d80b9acdefa73057
Used by:
  gecko-t⁄t-win7-32-gpu-b

Machine images:
  ami-05da2634276f45d19
  ami-0fcf189854b467e9b
  ami-0f4e3c8c96f80b2c2
Used by:
  gecko-t⁄t-linux-metal-alpha
  gecko-t⁄t-linux-metal

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-eastus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northeurope-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-westeurope-20h1-evd-892e806
Used by:
  gecko-t⁄win10-64-2004-gpu
  gecko-t⁄win10-64-2004-perf

Machine images:
  ami-07db1c26bda143e33
  ami-026ed942b8c9d7503
  ami-00f2cff76f39b3333
  ami-08dcc6990d39afe94
Used by:
  relops-3⁄win2019

Machine images:
  ami-0088f6f069a63870e
  ami-09c8f4c0b88a9d335
  ami-0eb7fd3631b03ab9b
  ami-0a4c44377468bfa3f
Used by:
  comm-1⁄b-win2012
  comm-2⁄b-win2012
  gecko-1⁄b-win2012
  gecko-2⁄b-win2012

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2022-64-2009-centralus-2022-datacenter-azure-edition-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2022-64-2009-northcentralus-2022-datacenter-azure-edition-alpha
Used by:
  gecko-1⁄win2022-alpha-f32
  gecko-1⁄win2022-alpha

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-eastus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-westeurope-win11-21h2-avd-alpha
Used by:
  gecko-t⁄win11-64-2009-ssd-gpu

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012r2-64-l1-centralus-2012-R2-Datacenter-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012r2-64-l1-northcentralus-2012-R2-Datacenter-alpha
Used by:
  comm-1⁄b-win2012-azure
  comm-2⁄b-win2012-azure
  gecko-1⁄b-win2012-azure-alpha
  gecko-1⁄b-win2012-azure-beta
  gecko-1⁄b-win2012-azure
  gecko-2⁄b-win2012-azure
  mozillavpn-1⁄b-win2012-azure
  nss-1⁄b-win2012-azure

Machine images:
  ami-0b9ad26d4f2651ee9
Used by:
  gecko-1⁄b-linux-experiment

Machine images:
  ami-0d05851ab254517de
  ami-02f981615a8102d24
Used by:
  nss-1⁄win2012r2
  nss-3⁄win2012r2

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-30-29z
Used by:
  gecko-1⁄masterwayz-bug1799740

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012-r2-64-compare-centralus-2012-R2-Datacenter-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win2012-r2-64-compare-northcentralus-2012-R2-Datacenter-alpha
Used by:
  gecko-1⁄win2012-compare

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northcentralus-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-northeurope-20h1-evd-892e806
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win10-64-2004-southcentralus-20h1-evd-892e806
Used by:
  gecko-t⁄win10-64-2004-gpu-beta

Machine images:
  ami-06ff4e113eb9b82f1
  ami-0f3aeed3a8934d0e3
  ami-0988039a161c85c08
Used by:
  adhoc-3⁄b-linux
  adhoc-3⁄decision
  adhoc-3⁄images
  app-services-3⁄b-linux
  app-services-3⁄decision
  app-services-3⁄images
  comm-3⁄b-linux-large
  comm-3⁄b-linux-xlarge
  comm-3⁄b-linux
  comm-3⁄decision
  comm-3⁄images
  gecko-3⁄b-linux-aws
  gecko-3⁄b-linux-large
  gecko-3⁄b-linux-xlarge
  gecko-3⁄b-linux
  gecko-3⁄decision
  gecko-3⁄images
  gecko-3⁄t-linux-xlarge
  glean-3⁄b-linux
  glean-3⁄decision
  glean-3⁄images
  mobile-3⁄b-linux-large
  mobile-3⁄b-linux-xlarge
  mobile-3⁄b-linux
  mobile-3⁄bitrise
  mobile-3⁄decision
  mobile-3⁄images
  mozillavpn-3⁄b-linux-large
  mozillavpn-3⁄b-linux
  mozillavpn-3⁄decision
  mozillavpn-3⁄images
  releng-3⁄b-linux
  releng-3⁄decision
  releng-3⁄linux
  scriptworker-3⁄b-linux
  scriptworker-3⁄decision
  scriptworker-3⁄images
  xpi-3⁄b-linux
  xpi-3⁄decision
  xpi-3⁄images

Machine images:
  ami-03c1455d18c76e538
  ami-0a453fd7085b8c21a
  ami-0a5ccc3a82b0d3cf2
Used by:
  gecko-1⁄b-linux-alpha
  gecko-t⁄t-linux-large-alpha
  kaios-t⁄t-linux-metal

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-u14-04-2022-11-10
Used by:
  comm-t⁄t-linux-large-gcp
  comm-t⁄t-linux-xlarge-gcp
  comm-t⁄t-linux-xlarge-source-gcp
  gecko-t⁄t-linux-kvm-gcp
  gecko-t⁄t-linux-large-gcp
  gecko-t⁄t-linux-xlarge-gcp
  gecko-t⁄t-linux-xlarge-source-gcp
  gecko-t⁄t-masterwayz-linux-large-gcp

Machine images:
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-centralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northcentralus-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-northeurope-win11-21h2-avd-alpha
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd
  /subscriptions/108d46d5-fe9b-4850-9a7d-8c914aa6c1f0/resourceGroups/rg-packer-through-cib/providers/Microsoft.Compute/images/win11-64-2009-southcentralus-win11-21h2-avd-alpha
Used by:
  gecko-t⁄win11-64-2009-alpha

I'll close this bug as done, and if anything isn't updated, I think that should be handled in separate bugs. Perhaps relops can review this list and see if anything else needs patching. Thanks!

In summary, there appear to be 39 image sets and 98 images in use:

  • 4 GCP image sets (4 unique images)
  • 16 AWS image sets (46 unique images)
  • 19 azure image sets (48 unique images)

Filtering this down to the docker worker image sets only, we seem to have

  • 4 GCP image sets
  • 5 AWS image sets
  • 0
Machine images:
  ami-06ff4e113eb9b82f1
  ami-0988039a161c85c08
  ami-0f3aeed3a8934d0e3
Used by:
  adhoc-3/b-linux
  adhoc-3/decision
  adhoc-3/images
  app-services-3/b-linux
  app-services-3/decision
  app-services-3/images
  comm-3/b-linux-large
  comm-3/b-linux-xlarge
  comm-3/b-linux
  comm-3/decision
  comm-3/images
  gecko-3/b-linux-aws
  gecko-3/b-linux-large
  gecko-3/b-linux-xlarge
  gecko-3/b-linux
  gecko-3/decision
  gecko-3/images
  gecko-3/t-linux-xlarge
  glean-3/b-linux
  glean-3/decision
  glean-3/images
  mobile-3/b-linux-large
  mobile-3/b-linux-xlarge
  mobile-3/b-linux
  mobile-3/bitrise
  mobile-3/decision
  mobile-3/images
  mozillavpn-3/b-linux-large
  mozillavpn-3/b-linux
  mozillavpn-3/decision
  mozillavpn-3/images
  releng-3/b-linux
  releng-3/decision
  releng-3/linux
  scriptworker-3/b-linux
  scriptworker-3/decision
  scriptworker-3/images
  xpi-3/b-linux
  xpi-3/decision
  xpi-3/images

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-trusted-u1804-2022-08-12b
Used by:
  adhoc-3/b-linux-gcp
  adhoc-3/decision-gcp
  adhoc-3/images-gcp
  app-services-3/b-linux-gcp
  app-services-3/decision-gcp
  app-services-3/images-gcp
  ci-3/decision-gcp
  ci-3/images-gcp
  code-analysis-3/linux-gcp
  comm-3/b-linux-gcp
  comm-3/b-linux-large-gcp
  comm-3/b-linux-xlarge-gcp
  comm-3/decision-gcp
  comm-3/images-gcp
  gecko-3/b-linux-gcp
  gecko-3/b-linux-large-gcp
  gecko-3/b-linux-xlarge-gcp
  gecko-3/decision-gcp
  gecko-3/images-gcp
  glean-3/b-linux-gcp
  glean-3/decision-gcp
  glean-3/images-gcp
  l10n-3/decision-gcp
  l10n-3/images-gcp
  l10n-3/linux-gcp
  mobile-3/b-linux-gcp
  mobile-3/b-linux-large-gcp
  mobile-3/b-linux-xlarge-gcp
  mobile-3/decision-gcp
  mobile-3/images-gcp
  mozillaonline-3/b-linux-gcp
  mozillavpn-3/b-linux-gcp
  mozillavpn-3/b-linux-large-gcp
  mozillavpn-3/decision-gcp
  mozillavpn-3/images-gcp
  nss-3/linux-gcp
  releng-3/b-linux-gcp
  releng-3/decision-gcp
  releng-3/linux-gcp
  relops-3/decision-gcp
  scriptworker-3/b-linux-gcp
  scriptworker-3/decision-gcp
  scriptworker-3/images-gcp
  taskgraph-3/decision-gcp
  taskgraph-3/images-gcp
  xpi-3/b-linux-gcp
  xpi-3/decision-gcp
  xpi-3/images-gcp

Machine images:
  ami-05da2634276f45d19
  ami-0f4e3c8c96f80b2c2
  ami-0fcf189854b467e9b
Used by:
  gecko-t/t-linux-metal-alpha
  gecko-t/t-linux-metal

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-08-00z
Used by:
  adhoc-1/b-linux-gcp
  adhoc-1/decision-gcp
  adhoc-1/images-gcp
  app-services-1/b-linux-gcp
  app-services-1/decision-gcp
  app-services-1/images-gcp
  ci-1/decision-gcp
  ci-1/images-gcp
  ci-t/linux-gcp
  code-analysis-1/linux-gcp
  comm-1/b-linux-gcp
  comm-1/b-linux-large-gcp
  comm-1/b-linux-xlarge-gcp
  comm-1/decision-gcp
  comm-1/images-gcp
  comm-2/b-linux-gcp
  comm-2/b-linux-large-gcp
  comm-2/b-linux-xlarge-gcp
  comm-2/decision-gcp
  comm-2/images-gcp
  comm-t/misc-gcp
  gecko-1/b-linux-gcp
  gecko-1/b-linux-large-gcp
  gecko-1/b-linux-xlarge-gcp
  gecko-1/decision-gcp
  gecko-1/images-gcp
  gecko-1/masterwayz-bug1768865
  gecko-2/b-linux-gcp
  gecko-2/b-linux-large-gcp
  gecko-2/b-linux-xlarge-gcp
  gecko-2/decision-gcp
  gecko-2/images-gcp
  gecko-t/misc-gcp
  glean-1/b-linux-gcp
  glean-1/decision-gcp
  glean-1/images-gcp
  kaios-1/decision-gcp
  kaios-1/images-gcp
  kaios-2/decision-gcp
  kaios-2/images-gcp
  kaios-t/misc-gcp
  l10n-1/decision-gcp
  l10n-1/images-gcp
  l10n-1/linux-gcp
  mobile-1/b-linux-gcp
  mobile-1/b-linux-large-gcp
  mobile-1/b-linux-xlarge-gcp
  mobile-1/decision-gcp
  mobile-1/images-gcp
  mozillaonline-1/b-linux-gcp
  mozillavpn-1/b-linux-gcp
  mozillavpn-1/b-linux-large-gcp
  mozillavpn-1/decision-gcp
  mozillavpn-1/images-gcp
  nss-1/linux-gcp
  releng-1/b-linux-gcp
  releng-1/decision-gcp
  releng-1/linux-gcp
  releng-t/linux-gcp
  scriptworker-1/b-linux-gcp
  scriptworker-1/decision-gcp
  scriptworker-1/images-gcp
  taskgraph-1/decision-gcp
  taskgraph-1/images-gcp
  taskgraph-t/linux-gcp
  xpi-1/b-linux-gcp
  xpi-1/decision-gcp
  xpi-1/images-gcp

Machine images:
  ami-0023a52f54d07188e
  ami-029998f24ee67c828
  ami-0b9ad26d4f2651ee9
Used by:
  adhoc-1/b-linux
  adhoc-1/decision
  adhoc-1/images
  app-services-1/b-linux
  app-services-1/decision
  app-services-1/images
  ci-1/decision
  ci-1/images
  ci-3/decision
  ci-3/images
  ci-t/linux
  code-analysis-1/linux
  code-analysis-3/linux
  code-coverage/bot
  code-review/bot
  comm-1/b-linux-large
  comm-1/b-linux-xlarge
  comm-1/b-linux
  comm-1/decision
  comm-1/images
  comm-2/b-linux-large
  comm-2/b-linux-xlarge
  comm-2/b-linux
  comm-2/decision
  comm-2/images
  comm-t/misc
  comm-t/t-linux-large
  comm-t/t-linux-xlarge-source
  comm-t/t-linux-xlarge
  gecko-1/b-linux-aws
  gecko-1/b-linux-large
  gecko-1/b-linux-perf
  gecko-1/b-linux-xlarge
  gecko-1/b-linux
  gecko-1/decision
  gecko-1/images
  gecko-2/b-linux-large
  gecko-2/b-linux-xlarge
  gecko-2/b-linux
  gecko-2/decision
  gecko-2/images
  gecko-t/misc
  gecko-t/t-linux-large
  gecko-t/t-linux-xlarge-source
  gecko-t/t-linux-xlarge
  glean-1/b-linux
  glean-1/decision
  glean-1/images
  infra/build-decision
  kaios-1/b-linux-large
  kaios-1/b-linux-xlarge
  kaios-1/b-linux
  kaios-1/decision
  kaios-1/images
  kaios-2/b-linux-large
  kaios-2/b-linux-xlarge
  kaios-2/b-linux
  kaios-2/decision
  kaios-2/images
  kaios-t/misc
  kaios-t/t-linux-xlarge-source
  kaios-t/t-linux-xlarge
  l10n-1/decision
  l10n-1/images
  l10n-1/linux
  l10n-3/decision
  l10n-3/images
  l10n-3/linux
  mobile-1/b-linux-large
  mobile-1/b-linux-xlarge
  mobile-1/b-linux
  mobile-1/bitrise
  mobile-1/decision
  mobile-1/images
  mozillaonline-1/b-linux
  mozillaonline-3/b-linux
  mozillavpn-1/b-linux-large
  mozillavpn-1/b-linux
  mozillavpn-1/decision
  mozillavpn-1/images
  nss-1/linux
  nss-3/linux
  project-relman/relman-svc
  releng-1/b-linux
  releng-1/decision
  releng-1/linux
  releng-t/linux
  relops-3/decision
  scriptworker-1/b-linux
  scriptworker-1/decision
  scriptworker-1/images
  taskgraph-1/decision
  taskgraph-1/images
  taskgraph-3/decision
  taskgraph-3/images
  taskgraph-t/linux
  xpi-1/b-linux
  xpi-1/decision
  xpi-1/images

Machine images:
  ami-0b9ad26d4f2651ee9
Used by:
  gecko-1/b-linux-experiment

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-30-29z
Used by:
  gecko-1/masterwayz-bug1799740

Machine images:
  ami-03c1455d18c76e538
  ami-0a453fd7085b8c21a
  ami-0a5ccc3a82b0d3cf2
Used by:
  gecko-1/b-linux-alpha
  gecko-t/t-linux-large-alpha
  kaios-t/t-linux-metal

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-u14-04-2022-11-10
Used by:
  comm-t/t-linux-large-gcp
  comm-t/t-linux-xlarge-gcp
  comm-t/t-linux-xlarge-source-gcp
  gecko-t/t-linux-kvm-gcp
  gecko-t/t-linux-large-gcp
  gecko-t/t-linux-xlarge-gcp
  gecko-t/t-linux-xlarge-source-gcp
  gecko-t/t-masterwayz-linux-large-gcp

I've reviewed the above list of 9 image sets, and it looks like 5 were created by you, and 4 were created by me.

Machine images:
  ami-06ff4e113eb9b82f1
  ami-0988039a161c85c08
  ami-0f3aeed3a8934d0e3
Created by
  michelle Fri Sep 09 16:47:58 2022 +0000
Used by:
  adhoc-3/b-linux
  adhoc-3/decision
  adhoc-3/images
  app-services-3/b-linux
  app-services-3/decision
  app-services-3/images
  comm-3/b-linux-large
  comm-3/b-linux-xlarge
  comm-3/b-linux
  comm-3/decision
  comm-3/images
  gecko-3/b-linux-aws
  gecko-3/b-linux-large
  gecko-3/b-linux-xlarge
  gecko-3/b-linux
  gecko-3/decision
  gecko-3/images
  gecko-3/t-linux-xlarge
  glean-3/b-linux
  glean-3/decision
  glean-3/images
  mobile-3/b-linux-large
  mobile-3/b-linux-xlarge
  mobile-3/b-linux
  mobile-3/bitrise
  mobile-3/decision
  mobile-3/images
  mozillavpn-3/b-linux-large
  mozillavpn-3/b-linux
  mozillavpn-3/decision
  mozillavpn-3/images
  releng-3/b-linux
  releng-3/decision
  releng-3/linux
  scriptworker-3/b-linux
  scriptworker-3/decision
  scriptworker-3/images
  xpi-3/b-linux
  xpi-3/decision
  xpi-3/images

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-trusted-u1804-2022-08-12b
Created by:
  michelle Thu Sep 01 13:36:08 2022 +0000
Used by:
  adhoc-3/b-linux-gcp
  adhoc-3/decision-gcp
  adhoc-3/images-gcp
  app-services-3/b-linux-gcp
  app-services-3/decision-gcp
  app-services-3/images-gcp
  ci-3/decision-gcp
  ci-3/images-gcp
  code-analysis-3/linux-gcp
  comm-3/b-linux-gcp
  comm-3/b-linux-large-gcp
  comm-3/b-linux-xlarge-gcp
  comm-3/decision-gcp
  comm-3/images-gcp
  gecko-3/b-linux-gcp
  gecko-3/b-linux-large-gcp
  gecko-3/b-linux-xlarge-gcp
  gecko-3/decision-gcp
  gecko-3/images-gcp
  glean-3/b-linux-gcp
  glean-3/decision-gcp
  glean-3/images-gcp
  l10n-3/decision-gcp
  l10n-3/images-gcp
  l10n-3/linux-gcp
  mobile-3/b-linux-gcp
  mobile-3/b-linux-large-gcp
  mobile-3/b-linux-xlarge-gcp
  mobile-3/decision-gcp
  mobile-3/images-gcp
  mozillaonline-3/b-linux-gcp
  mozillavpn-3/b-linux-gcp
  mozillavpn-3/b-linux-large-gcp
  mozillavpn-3/decision-gcp
  mozillavpn-3/images-gcp
  nss-3/linux-gcp
  releng-3/b-linux-gcp
  releng-3/decision-gcp
  releng-3/linux-gcp
  relops-3/decision-gcp
  scriptworker-3/b-linux-gcp
  scriptworker-3/decision-gcp
  scriptworker-3/images-gcp
  taskgraph-3/decision-gcp
  taskgraph-3/images-gcp
  xpi-3/b-linux-gcp
  xpi-3/decision-gcp
  xpi-3/images-gcp

Machine images:
  ami-05da2634276f45d19
  ami-0f4e3c8c96f80b2c2
  ami-0fcf189854b467e9b
Created by:
  pmoore Mon May 16 17:23:21 2022 +0000
Used by:
  gecko-t/t-linux-metal-alpha
  gecko-t/t-linux-metal

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-08-00z
Created by
  michelle Thu Nov 10 15:05:53 2022 +0000
Used by:
  adhoc-1/b-linux-gcp
  adhoc-1/decision-gcp
  adhoc-1/images-gcp
  app-services-1/b-linux-gcp
  app-services-1/decision-gcp
  app-services-1/images-gcp
  ci-1/decision-gcp
  ci-1/images-gcp
  ci-t/linux-gcp
  code-analysis-1/linux-gcp
  comm-1/b-linux-gcp
  comm-1/b-linux-large-gcp
  comm-1/b-linux-xlarge-gcp
  comm-1/decision-gcp
  comm-1/images-gcp
  comm-2/b-linux-gcp
  comm-2/b-linux-large-gcp
  comm-2/b-linux-xlarge-gcp
  comm-2/decision-gcp
  comm-2/images-gcp
  comm-t/misc-gcp
  gecko-1/b-linux-gcp
  gecko-1/b-linux-large-gcp
  gecko-1/b-linux-xlarge-gcp
  gecko-1/decision-gcp
  gecko-1/images-gcp
  gecko-1/masterwayz-bug1768865
  gecko-2/b-linux-gcp
  gecko-2/b-linux-large-gcp
  gecko-2/b-linux-xlarge-gcp
  gecko-2/decision-gcp
  gecko-2/images-gcp
  gecko-t/misc-gcp
  glean-1/b-linux-gcp
  glean-1/decision-gcp
  glean-1/images-gcp
  kaios-1/decision-gcp
  kaios-1/images-gcp
  kaios-2/decision-gcp
  kaios-2/images-gcp
  kaios-t/misc-gcp
  l10n-1/decision-gcp
  l10n-1/images-gcp
  l10n-1/linux-gcp
  mobile-1/b-linux-gcp
  mobile-1/b-linux-large-gcp
  mobile-1/b-linux-xlarge-gcp
  mobile-1/decision-gcp
  mobile-1/images-gcp
  mozillaonline-1/b-linux-gcp
  mozillavpn-1/b-linux-gcp
  mozillavpn-1/b-linux-large-gcp
  mozillavpn-1/decision-gcp
  mozillavpn-1/images-gcp
  nss-1/linux-gcp
  releng-1/b-linux-gcp
  releng-1/decision-gcp
  releng-1/linux-gcp
  releng-t/linux-gcp
  scriptworker-1/b-linux-gcp
  scriptworker-1/decision-gcp
  scriptworker-1/images-gcp
  taskgraph-1/decision-gcp
  taskgraph-1/images-gcp
  taskgraph-t/linux-gcp
  xpi-1/b-linux-gcp
  xpi-1/decision-gcp
  xpi-1/images-gcp

Machine images:
  ami-0023a52f54d07188e
  ami-029998f24ee67c828
  ami-0b9ad26d4f2651ee9
Created by
  pmoore Mon May 16 17:23:21 2022 +0000
Used by:
  adhoc-1/b-linux
  adhoc-1/decision
  adhoc-1/images
  app-services-1/b-linux
  app-services-1/decision
  app-services-1/images
  ci-1/decision
  ci-1/images
  ci-3/decision
  ci-3/images
  ci-t/linux
  code-analysis-1/linux
  code-analysis-3/linux
  code-coverage/bot
  code-review/bot
  comm-1/b-linux-large
  comm-1/b-linux-xlarge
  comm-1/b-linux
  comm-1/decision
  comm-1/images
  comm-2/b-linux-large
  comm-2/b-linux-xlarge
  comm-2/b-linux
  comm-2/decision
  comm-2/images
  comm-t/misc
  comm-t/t-linux-large
  comm-t/t-linux-xlarge-source
  comm-t/t-linux-xlarge
  gecko-1/b-linux-aws
  gecko-1/b-linux-large
  gecko-1/b-linux-perf
  gecko-1/b-linux-xlarge
  gecko-1/b-linux
  gecko-1/decision
  gecko-1/images
  gecko-2/b-linux-large
  gecko-2/b-linux-xlarge
  gecko-2/b-linux
  gecko-2/decision
  gecko-2/images
  gecko-t/misc
  gecko-t/t-linux-large
  gecko-t/t-linux-xlarge-source
  gecko-t/t-linux-xlarge
  glean-1/b-linux
  glean-1/decision
  glean-1/images
  infra/build-decision
  kaios-1/b-linux-large
  kaios-1/b-linux-xlarge
  kaios-1/b-linux
  kaios-1/decision
  kaios-1/images
  kaios-2/b-linux-large
  kaios-2/b-linux-xlarge
  kaios-2/b-linux
  kaios-2/decision
  kaios-2/images
  kaios-t/misc
  kaios-t/t-linux-xlarge-source
  kaios-t/t-linux-xlarge
  l10n-1/decision
  l10n-1/images
  l10n-1/linux
  l10n-3/decision
  l10n-3/images
  l10n-3/linux
  mobile-1/b-linux-large
  mobile-1/b-linux-xlarge
  mobile-1/b-linux
  mobile-1/bitrise
  mobile-1/decision
  mobile-1/images
  mozillaonline-1/b-linux
  mozillaonline-3/b-linux
  mozillavpn-1/b-linux-large
  mozillavpn-1/b-linux
  mozillavpn-1/decision
  mozillavpn-1/images
  nss-1/linux
  nss-3/linux
  project-relman/relman-svc
  releng-1/b-linux
  releng-1/decision
  releng-1/linux
  releng-t/linux
  relops-3/decision
  scriptworker-1/b-linux
  scriptworker-1/decision
  scriptworker-1/images
  taskgraph-1/decision
  taskgraph-1/images
  taskgraph-3/decision
  taskgraph-3/images
  taskgraph-t/linux
  xpi-1/b-linux
  xpi-1/decision
  xpi-1/images

Machine images:
  ami-0b9ad26d4f2651ee9
Created by:
  pmoore Mon May 16 17:23:21 2022 +0000
Used by:
  gecko-1/b-linux-experiment

Machine images:
  projects/taskcluster-imaging/global/images/docker-firefoxci-gcp-l1-googlecompute-2022-11-09t23-30-29z
Created by
  michelle Thu Nov 10 15:05:53 2022 +0000:
Used by:
  gecko-1/masterwayz-bug1799740

Machine images:
  ami-03c1455d18c76e538
  ami-0a453fd7085b8c21a
  ami-0a5ccc3a82b0d3cf2
Created by:
  pmoore Mon May 16 17:23:21 2022 +0000
Used by:
  gecko-1/b-linux-alpha
  gecko-t/t-linux-large-alpha
  kaios-t/t-linux-metal

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-u14-04-2022-11-10
Created by:
  michelle Thu Nov 10 22:09:17 2022 +0000
Used by:
  comm-t/t-linux-large-gcp
  comm-t/t-linux-xlarge-gcp
  comm-t/t-linux-xlarge-source-gcp
  gecko-t/t-linux-kvm-gcp
  gecko-t/t-linux-large-gcp
  gecko-t/t-linux-xlarge-gcp
  gecko-t/t-linux-xlarge-source-gcp
  gecko-t/t-masterwayz-linux-large-gcp

@masterwayz, can you check these two please? It looks like they were created in September, which I think is before you knew about the updated key. Just two image sets that may be affected, but they are used in a lot of different worker pools:

Machine images:
  ami-06ff4e113eb9b82f1
  ami-0988039a161c85c08
  ami-0f3aeed3a8934d0e3
Created by
  michelle Fri Sep 09 16:47:58 2022 +0000
Used by:
  adhoc-3/b-linux
  adhoc-3/decision
  adhoc-3/images
  app-services-3/b-linux
  app-services-3/decision
  app-services-3/images
  comm-3/b-linux-large
  comm-3/b-linux-xlarge
  comm-3/b-linux
  comm-3/decision
  comm-3/images
  gecko-3/b-linux-aws
  gecko-3/b-linux-large
  gecko-3/b-linux-xlarge
  gecko-3/b-linux
  gecko-3/decision
  gecko-3/images
  gecko-3/t-linux-xlarge
  glean-3/b-linux
  glean-3/decision
  glean-3/images
  mobile-3/b-linux-large
  mobile-3/b-linux-xlarge
  mobile-3/b-linux
  mobile-3/bitrise
  mobile-3/decision
  mobile-3/images
  mozillavpn-3/b-linux-large
  mozillavpn-3/b-linux
  mozillavpn-3/decision
  mozillavpn-3/images
  releng-3/b-linux
  releng-3/decision
  releng-3/linux
  scriptworker-3/b-linux
  scriptworker-3/decision
  scriptworker-3/images
  xpi-3/b-linux
  xpi-3/decision
  xpi-3/images

Machine images:
  projects/taskcluster-imaging/global/images/docker-worker-gcp-trusted-u1804-2022-08-12b
Created by:
  michelle Thu Sep 01 13:36:08 2022 +0000
Used by:
  adhoc-3/b-linux-gcp
  adhoc-3/decision-gcp
  adhoc-3/images-gcp
  app-services-3/b-linux-gcp
  app-services-3/decision-gcp
  app-services-3/images-gcp
  ci-3/decision-gcp
  ci-3/images-gcp
  code-analysis-3/linux-gcp
  comm-3/b-linux-gcp
  comm-3/b-linux-large-gcp
  comm-3/b-linux-xlarge-gcp
  comm-3/decision-gcp
  comm-3/images-gcp
  gecko-3/b-linux-gcp
  gecko-3/b-linux-large-gcp
  gecko-3/b-linux-xlarge-gcp
  gecko-3/decision-gcp
  gecko-3/images-gcp
  glean-3/b-linux-gcp
  glean-3/decision-gcp
  glean-3/images-gcp
  l10n-3/decision-gcp
  l10n-3/images-gcp
  l10n-3/linux-gcp
  mobile-3/b-linux-gcp
  mobile-3/b-linux-large-gcp
  mobile-3/b-linux-xlarge-gcp
  mobile-3/decision-gcp
  mobile-3/images-gcp
  mozillaonline-3/b-linux-gcp
  mozillavpn-3/b-linux-gcp
  mozillavpn-3/b-linux-large-gcp
  mozillavpn-3/decision-gcp
  mozillavpn-3/images-gcp
  nss-3/linux-gcp
  releng-3/b-linux-gcp
  releng-3/decision-gcp
  releng-3/linux-gcp
  relops-3/decision-gcp
  scriptworker-3/b-linux-gcp
  scriptworker-3/decision-gcp
  scriptworker-3/images-gcp
  taskgraph-3/decision-gcp
  taskgraph-3/images-gcp
  xpi-3/b-linux-gcp
  xpi-3/decision-gcp
  xpi-3/images-gcp

Michelle, could you check the validity of the certs on the two image sets in comment 33, that were made in September?

Since they appear to be level 3 worker pools, perhaps they do not need the cert at all, but I wanted to check to be sure.

Status: RESOLVED → REOPENED
Flags: needinfo?(mgoossens)
Resolution: FIXED → ---

Everything GCP is updated. I did not touch AWS as I was pretty sure this was already done before, unless I am incorrect about that.

Flags: needinfo?(mgoossens) → needinfo?(pmoore)
Attachment #9303599 - Attachment description: Bug 1768865 - Livelog GCP testing pool cleanup r=ahal! → Bug 1768865 - Livelog GCP testing pool cleanup r=jcristau
Pushed by mgoossens@mozilla.com: https://hg.mozilla.org/ci/ci-configuration/rev/d22bcc1f2a65 Livelog GCP testing pool cleanup r=jcristau
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → FIXED
Flags: needinfo?(pmoore)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: