1569899 - Install python-zstandard on windows workers

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: OpenCloudConfig, task)

Description

[Mike Hommey [:glandium]]

Bug 1569124 added git fetches with zstandard compression only, but Windows workers don't have python-zstandard for fetch-content to use those, so add support for .xz for them.

Comment 1

[Mike Hommey [:glandium]]

Attachment: Bug 1569899 - Allow to create .xz archives for git fetches.

Bug 1569124 added git fetches with zstandard compression only, but
Windows workers don't have python-zstandard for fetch-content to use
those, so add support for .xz for them.

Comment 2

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=5cbd1ad65d2f756f71b9eaf64e0dbda52fce22fc
this is just a smoke-test [try-push](https://hg.mozilla.org/try/rev/5cbd1ad65d2f756f71b9eaf64e0dbda52fce22fc) to validate that windows amis with python 3 zstandard installed behave normally on regular builds.
the beta amis for this test were updated here: [change](https://github.com/mozilla-releng/OpenCloudConfig/commit/deb3a5b), [build](https://tools.taskcluster.net/task-group-inspector/#/X34XuQalTeuSA70BbLg0mw)

Comment 3

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: GitHub Pull Request

this patch to occ pip installs zstandard to all ec2 windows worker types. the patch was tested on beta workers as described in comment 2 above.

Comment 4

[Rob Thijssen [:grenade (EET/UTC+0300)]]

zstandard ami deployment to all ec2 windows worker types in progress...

• https://github.com/mozilla-releng/OpenCloudConfig/commit/c981b12c8337d889441f61d21d2e6daefbb64aff
• https://tools.taskcluster.net/task-group-inspector/#/cTrtEzTmTmCom_8auXuGNg

Comment 5

[Rob Thijssen [:grenade (EET/UTC+0300)]]

patch didn't take on gecko-t-win7-32-gpu due to a deployment error there (unrelated to zstandard). i will reattempt deployment on that worker type over the weekend or monday.

Comment 6

[Stephen Donner [:stephend] Not actively reading bugmail]

Mass-removing myself from cc; search for 12b9dfe4-ece3-40dc-8d23-60e179f64ac1 or any reasonable part thereof, to mass-delete these notifications (and sorry!)