1860630 - Perma bootstrap-voidlinux ModuleNotFoundError: No module named 'zstandard'

Status: RESOLVED FIXED

(Firefox Build System :: Android Studio and Gradle Integration, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=433440666&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AfzTb6vUTkuyZuy_J5RLdQ/runs/0/artifacts/public/logs/live_backing.log

---

Downloading... 100.0 %
Error running mach:
    mach --log-no-times artifact toolchain --from-task HEkieD-hRgSW0JOglB0AeA:public/build/clang.tar.zst
The error occurred in code that was called by the mach command. This is either
a bug in the called code itself or in the way that mach is calling it.
You can invoke ``./mach busted`` to check if this issue is already on file. If it
isn't, please use ``./mach busted file artifact`` to report it. If ``./mach busted`` is
misbehaving, you can also inspect the dependencies of bug 1543241.
If filing a bug, please include the full output of mach, including this error
message.
The details of the failure are as follows:
ModuleNotFoundError: No module named 'zstandard'
  File "/mozilla-unified/python/mozbuild/mozbuild/artifact_commands.py", line 590, in artifact_toolchain
    unpack_file(local)
  File "/mozilla-unified/python/mozbuild/mozbuild/action/tooltool.py", line 1008, in unpack_file
    import zstandard
[taskcluster 2023-10-23 16:59:29.069Z] === Task Finished ===
[taskcluster 2023-10-23 16:59:29.069Z] Unsuccessful task run with exit code: 1 completed in 1332.392 seconds

Comment 1

[Mike Hommey [:glandium]]

Root cause is https://github.com/indygreg/python-zstandard/issues/204 and the lack of a compiler on the bootstrap setup to build the wheel from source.

Comment 2

[Intermittent Failures Robot]

5 failures in 3657 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform and build breakdown:

• android-5-0-armv7: 4
  • opt: 4
• linux64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-10-23&endday=2023-10-29&tree=all

Comment 3

[Intermittent Failures Robot]

4 failures in 3356 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform and build breakdown:

• android-5-0-armv7: 2
  • opt: 2
• linux64: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-10-30&endday=2023-11-05&tree=all

Comment 4

[[:sergesanspaille]]

Attachment: Bug 1860630 - Add build prerequisite for voidlinux bootstrap r=glandium

Comment 5

[Natalia Csoregi [:nataliaCs]]

It appears on Linux as well: https://treeherder.mozilla.org/jobs?repo=autoland&revision=201fc291a2c0f9c8fd86c7bf5647cf7d179ca563&selectedTaskRun=PyhGjucSRB2w0Bv_PCYEhA.0&searchStr=Linux%2Cx64%2Copt%2CBootstrap%2Cbootstrap-voidlinux-browser%2Cvoidlinux

Comment 6

[Intermittent Failures Robot]

4 failures in 3288 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform and build breakdown:

• android-5-0-armv7: 2
  • opt: 2
• linux64: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-11-06&endday=2023-11-12&tree=all

Comment 7

[Mike Hommey [:glandium]]

Attachment: Bug 1860630 - Upgrade zstandard to 0.22.

Comment 8

[Intermittent Failures Robot]

13 failures in 3623 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 5

Platform and build breakdown:

• android-5-0-armv7: 8
  • opt: 8
• linux64: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-11-20&endday=2023-11-26&tree=all

Comment 9

[Intermittent Failures Robot]

8 failures in 4108 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 4

Platform and build breakdown:

• linux64: 4
  • opt: 4
• android-5-0-armv7: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-11-27&endday=2023-12-03&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 3671 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform and build breakdown:

• linux64: 3
  • opt: 3
• android-5-0-armv7: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-12-04&endday=2023-12-10&tree=all

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/83540e45dfb8
Upgrade zstandard to 0.22. r=glandium CLOSED TREE

Comment 12

[Noemi Erli[:noemi_erli]]

Backed out changeset 83540e45dfb8 (Bug 1860630) for causing mach related bustage

Log: https://treeherder.mozilla.org/logviewer?job_id=439853407&repo=autoland&lineNumber=366

Backout: https://hg.mozilla.org/integration/autoland/rev/47c0d122a8e0c91ea8199bfa1fafec89fff4da10

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f1f84112a8dd
Upgrade zstandard to 0.22. r=firefox-build-system-reviewers,mach-reviewers,sergesanspaille,ahochheiden

Comment 14

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/f1f84112a8dd

Comment 15

[Intermittent Failures Robot]

8 failures in 4224 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 3

Platform and build breakdown:

• android-5-0-armv7: 4
  • opt: 4
• linux64: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1860630&startday=2023-12-11&endday=2023-12-17&tree=all