1626357 - Upgrade mercurial to 5.3+ using python3 on posix hardware workers

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: Posix OS, task)

Description

[:dhouse]

We need to upgrade Mercurial version from 5.2 to 5.3+
re: https://bugzilla.mozilla.org/show_bug.cgi?id=1604486#c58

Comment 1

[:dhouse]

this upgrade is being done as part of upgrading the posix hardware worker OS's, to Ubuntu 18 and Macos catalina/bigsur. On linux, the upgrade has been delayed because of robustcheckout being slow with newer mercurial, https://bugzilla.mozilla.org/show_bug.cgi?id=1672816. The macos r8/catalina upgrade is a work-in-progress, and afaik is proceeding with an upgrade of mercurial.

Comment 2

[:dhouse]

The upgrade has been delayed on the linux hardware workers because hg 4.9 and newer are slow with robustcheckout
https://github.com/mozilla-platform-ops/ronin_puppet/blob/master/modules/linux_packages/manifests/python3_mercurial.pp

The mac hardware workers are using hg 5.1 and newer, https://github.com/mozilla-platform-ops/ronin_puppet/blob/master/modules/packages/manifests/mercurial.pp#L6 , https://github.com/mozilla-platform-ops/ronin_puppet/blob/754661ed0695944306c1c2fa7793e13007173eae/data/roles/gecko_t_osx_1015_r8.yaml#L40

Comment 3

[:dhouse]

The new mac hardware workers, R8's and M1's, are on hg 5.5.2

Comment 4

[Mike Hommey [:glandium]]

(In reply to :dhouse from comment #3)

The new mac hardware workers, R8's and M1's, are on hg 5.5.2

The mac arm64 workers are on 5.5.2 with python 2.7. The mac x86-64 workers are on 5.1 with python 2.7.

Comment 5

[Andrew Erickson [:aerickson]]

I just checked some of the R8 hosts (gecko-t-osx-1015-r8) and they're on 5.5.2.

Where are you seeing 5.1 (worker pools or hosts)?

Comment 6

[Mike Hommey [:glandium]]

gecko-{1,3}-b-osx-1015.

Comment 7

[Mike Hommey [:glandium]]

Please note we should move away from python 2.7.

Comment 8

[Mike Hommey [:glandium]]

I guess linux counts as posix, so I'll add here: Linux generic workers are on Mercurial 4.8.1, also running on python 2.7. (at least on the gecko-t-linux-talos-1804 pool)

Comment 9

[Andrew Erickson [:aerickson]]

gecko-t-linux-talos-1804 now has hg 6.4.5 (using python3). They've had python3 for awhile, but the hg binary was using python2.

Comment 10

[Andrew Erickson [:aerickson]]

The macs should now be on hg 5.3+ (5.5.2). Please let us know if you see anything different.

Comment 11

[Andrew Erickson [:aerickson]]

Tracking the work to get all of the hg banglines changed to python3 on the macs in https://mozilla-hub.atlassian.net/browse/RELOPS-1005.

Comment 12

[Mike Hommey [:glandium]]

Macs are still using python2: https://firefoxci.taskcluster-artifacts.net/Ih6k7vUhQ9OZzmM0Ayftfw/0/public/logs/live_backing.log

Comment 13

[Andrew Erickson [:aerickson]]

We're still working on fixing the banglines to not use py2. Retitling and reopening.

Comment 14

[Andrew Erickson [:aerickson]]

:rcurran has completed work to update all Macs to have a Python 3 bangline running Hg 6.4.5 (https://mozilla-hub.atlassian.net/browse/RELOPS-1005).