1865683 - bump python in build-decision image from 3.8 to 3.11

Status: RESOLVED FIXED

(Release Engineering :: Firefox-CI Administration, task)

Comment 1

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - bump build-decision to python3.11. r?#releng

Comment 2

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - maintenance: clean up docker container on exit. r?#releng

Also pass --interactive so one can e.g. interrupt the pin process.

Comment 3

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - maintenance: also bump build-decision requirements when running pin.sh. r?#releng

Comment 4

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - pin platformdirs<4 to workaround virtualenv incompatibility. r?#releng

Comment 5

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - update pinned requirements. r?#releng

Comment 6

[Julien Cristau [:jcristau]]

One side effect of this is we're upgrading the version of mercurial (6.3.2) on the tests-unit-build-decision task, but the checkout dir is potentially shared with other tasks that use an older mercurial (5.6.1), and break, e.g. https://firefoxci.taskcluster-artifacts.net/CiB4vpBQQvKtE_RKX8iDyA/0/public/logs/live_backing.log:

[vcs 2023-11-21T09:43:47.892Z] executing ['hg', 'robustcheckout', '--sharebase', '/builds/worker/checkouts/hg-store', '--purge', '--upstream', 'https://hg.mozilla.org/ci/ci-configuration-try', '--branch', 'b6bce496ec902b99c7e71a411637ac14682c5309', 'https://hg.mozilla.org/ci/ci-configuration-try', '/builds/worker/checkouts/vcs']
[vcs 2023-11-21T09:43:48.010Z] (using Mercurial 5.6.1)
[vcs 2023-11-21T09:43:48.010Z] ensuring https://hg.mozilla.org/ci/ci-configuration-try@b6bce496ec902b99c7e71a411637ac14682c5309 is available at /builds/worker/checkouts/vcs
[vcs 2023-11-21T09:43:48.011Z] (existing repository shared store: /builds/worker/checkouts/hg-store/bfe454dd560bdac5d4c9bf438ff4e50e17353af9/.hg)
[vcs 2023-11-21T09:43:48.530Z] PERFHERDER_DATA: {"framework": {"name": "vcs"}, "suites": [{"extraOptions": ["projects/887720501152/machineTypes/n2-standard-4"], "hgVersion": "5.6.1", "lowerIsBetter": true, "name": "overall", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 0.5198326110839844}, {"extraOptions": ["projects/887720501152/machineTypes/n2-standard-4"], "hgVersion": "5.6.1", "lowerIsBetter": true, "name": "overall_nopull", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 0.5198326110839844}, {"extraOptions": ["projects/887720501152/machineTypes/n2-standard-4"], "hgVersion": "5.6.1", "lowerIsBetter": true, "name": "overall_nopull_fullcheckout", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 0.5198326110839844}, {"extraOptions": ["projects/887720501152/machineTypes/n2-standard-4"], "hgVersion": "5.6.1", "lowerIsBetter": true, "name": "overall_nopull_populatedwdir", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 0.5198326110839844}]}
[vcs 2023-11-21T09:43:48.530Z] abort: repository requires features unknown to this Mercurial: share-safe!
[vcs 2023-11-21T09:43:48.530Z] (see https://mercurial-scm.org/wiki/MissingRequirement for more information)

We need to bump the cache name for that task somehow, but taskgraph doesn't seem to currently provide a way to do that, instead it makes assumptions about the hg version that's on the docker images, which it can't really do safely (it was fine in gecko, not so much in the shared taskgraph).

Comment 7

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - maintenance: include decision task dependency updates in pin.sh. r?#releng

Comment 8

[Julien Cristau [:jcristau]]

Attachment: Bug 1865683 - fix type comparison warnings from flake8. r?#releng

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/119ff986193e
bump build-decision to python3.11. r=releng-reviewers,hneiva
https://hg.mozilla.org/ci/ci-configuration/rev/fbd88a08c74e
maintenance: clean up docker container on exit. r=releng-reviewers,bhearsum
https://hg.mozilla.org/ci/ci-configuration/rev/c6b6a6244bd7
maintenance: also bump build-decision requirements when running pin.sh. r=releng-reviewers,bhearsum
https://hg.mozilla.org/ci/ci-configuration/rev/2472eba8fadf
fix type comparison warnings from flake8. r=releng-reviewers,bhearsum
https://hg.mozilla.org/ci/ci-configuration/rev/d29e15c700b6
update pinned requirements. r=releng-reviewers,bhearsum,hneiva
https://hg.mozilla.org/ci/ci-configuration/rev/d8eb09a39586
maintenance: include decision task dependency updates in pin.sh. r=releng-reviewers,bhearsum

Comment 10

[BMO Github Automation]

Attachment: [mozilla-releng/relengdocs] Update how-to for build-decision dependencies update (bug 1865683) (#256)