Closed Bug 2058685 Opened 1 month ago Closed 1 month ago

Intermittent mozlint.errors.LintException: mozcheck binary is unavailable: could not locate a prebuilt binary (MOZ_FETCHES_DIR/mozcheck) and the source build failed. Ensure the linter task fetches the relevant mozcheck toolchain, or that cargo is ava

Categories

(Developer Infrastructure :: Lint and Formatting, defect, P5)

Product:
Developer Infrastructure
Component:
Lint and Formatting
Type:
defect

Tracking

(firefox-esr140 unaffected, firefox-esr153 unaffected, firefox153 unaffected, firefox154 unaffected, firefox155 fixed)

Status:
RESOLVED FIXED
Milestone:
155 Branch
Tracking Flags:
Tracking Status
firefox-esr140 --- unaffected
firefox-esr153 --- unaffected
firefox153 --- unaffected
firefox154 --- unaffected
firefox155 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: glandium)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Bug 2058685 - Resolve the mozcheck binary in mozlint's parent process
48 bytes, text/x-phabricator-request
Details | Review

Filed by: rperta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=581410271&repo=autoland&task=enUnbotoT6GEvhALkfty6w.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/enUnbotoT6GEvhALkfty6w/runs/0/artifacts/public/logs/live_backing.log

taskcluster 2026-07-28T19:46:14.120Z] Worker Type (gecko-t/t-linux-docker-amd) settings:
[taskcluster 2026-07-28T19:46:14.120Z]   {
[taskcluster 2026-07-28T19:46:14.120Z]     "generic-worker": {
[taskcluster 2026-07-28T19:46:14.120Z]       "config": {
[taskcluster 2026-07-28T19:46:14.120Z]         "headlessTasks": true
[taskcluster 2026-07-28T19:46:14.120Z]       },
[taskcluster 2026-07-28T19:46:14.120Z]       "engine": "multiuser",
[taskcluster 2026-07-28T19:46:14.120Z]       "go-arch": "amd64",
[taskcluster 2026-07-28T19:46:14.120Z]       "go-os": "linux",
[taskcluster 2026-07-28T19:46:14.120Z]       "go-version": "go1.26.2",
[taskcluster 2026-07-28T19:46:14.120Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v99.2.1",
[taskcluster 2026-07-28T19:46:14.120Z]       "revision": "ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-07-28T19:46:14.120Z]       "source": "https://github.com/taskcluster/taskcluster/commits/ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-07-28T19:46:14.120Z]       "version": "99.2.1"
[taskcluster 2026-07-28T19:46:14.120Z]     },
[taskcluster 2026-07-28T19:46:14.120Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2026-05-04",
[taskcluster 2026-07-28T19:46:14.120Z]     "instance-id": "3139863749176113212",
[taskcluster 2026-07-28T19:46:14.120Z]     "instance-type": "projects/887720501152/machineTypes/c3d-standard-8-lssd",
[taskcluster 2026-07-28T19:46:14.120Z]     "local-ipv4": "10.128.2.65",
[taskcluster 2026-07-28T19:46:14.120Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2026-07-28T19:46:14.120Z]     "public-hostname": "gecko-t-t-linux-docker-amd-cydsuvucsm6joqxxe9ssua.c.fxci-production-level1-workers.internal",
[taskcluster 2026-07-28T19:46:14.120Z]     "public-ipv4": "34.58.160.105",
[taskcluster 2026-07-28T19:46:14.120Z]     "region": "us-central1",
[taskcluster 2026-07-28T19:46:14.120Z]     "zone": "us-central1-a"
[taskcluster 2026-07-28T19:46:14.120Z]   }
[taskcluster 2026-07-28T19:46:14.120Z] Task ID: enUnbotoT6GEvhALkfty6w
[taskcluster 2026-07-28T19:46:14.120Z] === Task Starting ===
[taskcluster 2026-07-28T19:46:14.939Z] [mounts] No existing writable directory cache 'gecko-level-3-checkouts-hg58-v3-f55e4b2a13d893f84d45' - creating /home/generic-worker/caches/Q6NQXlkjR46XbXRyernoeQ
[taskcluster 2026-07-28T19:46:14.939Z] [mounts] Creating directory /home/task_178526797359811/cache0
[taskcluster 2026-07-28T19:46:14.949Z] [mounts] Successfully mounted writable directory cache '/home/task_178526797359811/cache0'
[taskcluster 2026-07-28T19:46:14.949Z] [mounts] No existing writable directory cache 'gecko-level-3-uv-v3-f55e4b2a13d893f84d45' - creating /home/generic-worker/caches/RCWqkpKNQnyOvugu8fnD_w
[taskcluster 2026-07-28T19:46:14.949Z] [mounts] Creating directory /home/task_178526797359811/cache1
[taskcluster 2026-07-28T19:46:14.958Z] [mounts] Successfully mounted writable directory cache '/home/task_178526797359811/cache1'
[taskcluster 2026-07-28T19:46:14.958Z] [mounts] No existing writable directory cache 'gecko-level-3-pip-v3-f55e4b2a13d893f84d45' - creating /home/generic-worker/caches/Z3m1XuzrQjiXTDjSembbZg
[taskcluster 2026-07-28T19:46:14.958Z] [mounts] Creating directory /home/task_178526797359811/cache2
[taskcluster 2026-07-28T19:46:14.967Z] [mounts] Successfully mounted writable directory cache '/home/task_178526797359811/cache2'
[taskcluster 2026-07-28T19:46:14.967Z] [mounts] Downloading task ZNTT0B9kSJeOui1h9OyraQ artifact public/image.tar.zst to /home/generic-worker/downloads/abO2hRGhRBGdPztdvjtJAQ
[taskcluster 2026-07-28T19:46:16.804Z] [mounts] Downloaded 336458301 bytes with SHA256 cb487691f9c01ef8e05466cc88dea0ebf1f95ac03c8cc45c94e1dbfd116b8e5a from task ZNTT0B9kSJeOui1h9OyraQ artifact public/image.tar.zst to /home/generic-worker/downloads/abO2hRGhRBGdPztdvjtJAQ
[taskcluster:warn 2026-07-28T19:46:16.804Z] [mounts] Download /home/generic-worker/downloads/abO2hRGhRBGdPztdvjtJAQ of task ZNTT0B9kSJeOui1h9OyraQ artifact public/image.tar.zst has SHA256 cb487691f9c01ef8e05466cc88dea0ebf1f95ac03c8cc45c94e1dbfd116b8e5a but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2026-07-28T19:46:16.804Z] [mounts] File mount "dockerimage" handled by registered handler (cache: /home/generic-worker/downloads/abO2hRGhRBGdPztdvjtJAQ, SHA256: cb487691f9c01ef8e05466cc88dea0ebf1f95ac03c8cc45c94e1dbfd116b8e5a)
[taskcluster 2026-07-28T19:46:16.805Z] [d2g] Loading docker image
[taskcluster 2026-07-28T19:46:28.394Z] [d2g] Loaded docker image "lint:latest"
[taskcluster 2026-07-28T19:46:28.394Z] Executing command 0: docker run -t --name taskcontainer_eiOYeydVT2CNNNz1_7YfPQ --memory-swap -1 --pids-limit -1 --pull=never --log-driver=none --cap-add=SYS_PTRACE '--add-host=localhost.localdomain:127.0.0.1' -v /home/task_178526797359811/cache0:/builds/worker/checkouts -v '/home/task_178526797359811/cache1:/builds/worker/.task-cache/uv' -v '/home/task_178526797359811/cache2:/builds/worker/.task-cache/pip' --add-host=taskcluster:host-gateway --env-file 'env.list' 9403630f25b869d0705e14b3383873a29660b0d56b35427b431f77d28894eeac /builds/worker/bin/run-task-hg --gecko-checkout=/builds/worker/checkouts/gecko --task-cwd=/builds/worker/checkouts/gecko -- bash -cx './mach lint -v -l license -f treeherder -f json:/builds/worker/mozlint.json .'
[setup 2026-07-28T19:46:32.491+00:00] run-task started in /builds/worker
[cache 2026-07-28T19:46:32.492+00:00] cache /builds/worker/.task-cache/pip is empty; writing requirements: gid=1000 uid=1000 version=1
/builds/worker/bin/run-task-hg:220: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  now = datetime.datetime.utcnow().isoformat().encode("utf-8")
[cache 2026-07-28T19:46:32.493+00:00] cache /builds/worker/.task-cache/uv is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2026-07-28T19:46:32.494+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2026-07-28T19:46:32.494+00:00] changing ownership of volume /builds/worker/.task-cache/npm to 1000:1000
[volume 2026-07-28T19:46:32.494+00:00] volume /builds/worker/.task-cache/pip is a cache
[volume 2026-07-28T19:46:32.494+00:00] volume /builds/worker/.task-cache/uv is a cache
[volume 2026-07-28T19:46:32.494+00:00] volume /builds/worker/checkouts is a cache
[setup 2026-07-28T19:46:32.494+00:00] running as worker:worker
[vcs 2026-07-28T19:46:32.494+00:00] fetching hgmointernal config from http://taskcluster/secrets/v1/secret/project/taskcluster/gecko/hgmointernal
[vcs 2026-07-28T19:46:32.658+00:00] region google/us-central1 not yet supported; using public hg.mozilla.org service
[vcs 2026-07-28T19:46:32.658+00:00] executing ['hg', 'robustcheckout', '--sharebase', '/builds/worker/checkouts/hg-store', '--purge', '--upstream', 'https://hg.mozilla.org/mozilla-unified', '--revision', 'd924d284bc0473d77d28ed7b7941f3d45dbbbd27', 'https://hg.mozilla.org/integration/autoland', '/builds/worker/checkouts/gecko']
[vcs 2026-07-28T19:46:32.771+00:00] (using Mercurial 7.0.1)
[vcs 2026-07-28T19:46:32.771+00:00] ensuring https://hg.mozilla.org/integration/autoland@d924d284bc0473d77d28ed7b7941f3d45dbbbd27 is available at /builds/worker/checkouts/gecko
[vcs 2026-07-28T19:46:33.259+00:00] real URL is https://hg-edge.mozilla.org/mozilla-unified
[vcs 2026-07-28T19:46:33.509+00:00] (cloning from upstream repo https://hg.mozilla.org/mozilla-unified)
[vcs 2026-07-28T19:46:33.799+00:00] (sharing from new pooled repository 8ba995b74e18334ab3707f27e9eb8f4e37ba3d29)
[vcs 2026-07-28T19:46:34.330+00:00] real URL is https://hg-edge.mozilla.org/mozilla-unified
[vcs 2026-07-28T19:46:34.656+00:00] applying clone bundle from https://storage.googleapis.com/moz-hg-bundles-gcp-us-central1/mozilla-unified/b87f6816605dd8cfea998da03fa806daadcaf387.stream-v2.hg
[vcs 2026-07-28T19:46:34.720+00:00] 995577 files to transfer, 6.54 GB of data
[vcs 2026-07-28T19:46:36.721+00:00] 
[vcs 2026-07-28T19:46:37.721+00:00] clone [=>                                           ]  373494337/7017558714 36s
[vcs 2026-07-28T19:46:38.721+00:00] clone [==>                                          ]  518496523/7017558714 38s
[vcs 2026-07-28T19:46:39.721+00:00] clone [===>                                         ]  710674887/7017558714 36s
[vcs 2026-07-28T19:46:40.721+00:00] clone [====>                                        ]  847107913/7017558714 37s
[vcs 2026-07-28T19:46:41.721+00:00] clone [=====>                                       ]  974340121/7017558714 38s
[vcs 2026-07-28T19:46:42.721+00:00] clone [=====>                                       ] 1085831534/7017558714 39s
[vcs 2026-07-28T19:46:43.721+00:00] clone [======>                                      ] 1174305164/7017558714 40s
[vcs 2026-07-28T19:46:44.722+00:00] clone [=======>                                     ] 1348580465/7017558714 38s
[vcs 2026-07-28T19:46:45.722+00:00] clone [========>                                    ] 1434472056/7017558714 39s
[vcs 2026-07-28T19:46:46.722+00:00] clone [=========>                                   ] 1574375311/7017558714 39s
[vcs 2026-07-28T19:46:47.722+00:00] clone [==========>                                  ] 1731923981/7017558714 37s
[vcs 2026-07-28T19:46:48.722+00:00] clone [===========>                                 ] 1871825968/7017558714 36s
[vcs 2026-07-28T19:46:49.722+00:00] clone [===========>                                 ] 1922726345/7017558714 38s
[vcs 2026-07-28T19:46:50.722+00:00] clone [============>                                ] 2047554346/7017558714 37s
[vcs 2026-07-28T19:46:51.722+00:00] clone [============>                                ] 2072487145/7017558714 39s
[vcs 2026-07-28T19:46:52.722+00:00] clone [============>                                ] 2099478060/7017558714 40s
[vcs 2026-07-28T19:46:53.723+00:00] clone [============>                                ] 2124287809/7017558714 42s
[vcs 2026-07-28T19:46:54.723+00:00] clone [=============>                               ] 2184753326/7017558714 43s
[vcs 2026-07-28T19:46:55.723+00:00] clone [=============>                               ] 2259732746/7017558714 43s
[vcs 2026-07-28T19:46:56.723+00:00] clone [=============>                               ] 2294094898/7017558714 44s
[vcs 2026-07-28T19:46:57.723+00:00] clone [==============>                              ] 2399423961/7017558714 43s
[vcs 2026-07-28T19:46:58.723+00:00] clone [==============>                              ] 2494100640/7017558714 42s
[vcs 2026-07-28T19:46:59.723+00:00] clone [===============>                             ] 2527925107/7017558714 43s
[vcs 2026-07-28T19:47:00.723+00:00] clone [===============>                             ] 2543467684/7017558714 44s
[vcs 2026-07-28T19:47:01.723+00:00] clone [===============>                             ] 2558898174/7017558714 46s
[vcs 2026-07-28T19:47:02.723+00:00] clone [===============>                             ] 2577268800/7017558714 47s
[vcs 2026-07-28T19:47:03.724+00:00] clone [================>                            ] 2658836642/7017558714 46s
[vcs 2026-07-28T19:47:04.724+00:00] clone [=================>                           ] 2896820178/7017558714 42s
[vcs 2026-07-28T19:47:05.724+00:00] clone [==================>                          ] 3020173796/7017558714 40s
[vcs 2026-07-28T19:47:06.724+00:00] clone [===================>                         ] 3141506372/7017558714 39s
[vcs 2026-07-28T19:47:07.724+00:00] clone [====================>                        ] 3336634788/7017558714 36s
[vcs 2026-07-28T19:47:08.724+00:00] clone [=====================>                       ] 3572215074/7017558714 32s
[vcs 2026-07-28T19:47:09.811+00:00] clone [=======================>                     ] 3821320316/7017558714 29s
[vcs 2026-07-28T19:47:10.811+00:00] clone [========================>                    ] 3940758174/7017558714 28s
[vcs 2026-07-28T19:47:11.811+00:00] clone [=========================>                   ] 4112203697/7017558714 26s
[vcs 2026-07-28T19:47:12.811+00:00] clone [==========================>                  ] 4250656051/7017558714 25s
[vcs 2026-07-28T19:47:13.811+00:00] clone [==========================>                  ] 4266405390/7017558714 25s
[vcs 2026-07-28T19:47:14.811+00:00] clone [==========================>                  ] 4282287874/7017558714 25s
[vcs 2026-07-28T19:47:15.811+00:00] clone [==========================>                  ] 4329585075/7017558714 25s
[vcs 2026-07-28T19:47:16.811+00:00] clone [==========================>                  ] 4349161047/7017558714 26s
[vcs 2026-07-28T19:47:17.811+00:00] clone [===========================>                 ] 4368315177/7017558714 26s
[vcs 2026-07-28T19:47:18.811+00:00] clone [===========================>                 ] 4386478048/7017558714 26s
[vcs 2026-07-28T19:47:19.811+00:00] clone [===========================>                 ] 4416869474/7017558714 26s
[vcs 2026-07-28T19:47:20.811+00:00] clone [===========================>                 ] 4454785188/7017558714 26s
[vcs 2026-07-28T19:47:21.811+00:00] clone [===========================>                 ] 4482546307/7017558714 27s
[vcs 2026-07-28T19:47:22.811+00:00] clone [============================>                ] 4535680972/7017558714 26s
[vcs 2026-07-28T19:47:23.811+00:00] clone [============================>                ] 4567242664/7017558714 26s
[vcs 2026-07-28T19:47:24.811+00:00] clone [============================>                ] 4579716068/7017558714 27s
[vcs 2026-07-28T19:47:25.811+00:00] clone [============================>                ] 4597210384/7017558714 27s
[vcs 2026-07-28T19:47:26.812+00:00] clone [============================>                ] 4647328588/7017558714 27s
[vcs 2026-07-28T19:47:27.812+00:00] clone [=============================>               ] 4752223166/7017558714 25s
[vcs 2026-07-28T19:47:28.812+00:00] clone [===============================>             ] 5009866760/7017558714 22s
[vcs 2026-07-28T19:47:29.813+00:00] clone [===============================>             ] 5086541954/7017558714 21s
[vcs 2026-07-28T19:47:30.813+00:00] clone [================================>            ] 5210390721/7017558714 20s
[vcs 2026-07-28T19:47:31.813+00:00] clone [=================================>           ] 5316562199/7017558714 18s
[vcs 2026-07-28T19:47:32.813+00:00] clone [==================================>          ] 5463524637/7017558714 17s
[vcs 2026-07-28T19:47:33.813+00:00] clone [==================================>          ] 5581515448/7017558714 15s
[vcs 2026-07-28T19:47:34.813+00:00] clone [===================================>         ] 5716846111/7017558714 14s
[vcs 2026-07-28T19:47:35.813+00:00] clone [====================================>        ] 5821722189/7017558714 13s
[vcs 2026-07-28T19:47:36.947+00:00] clone [======================================>      ] 6092354338/7017558714 10s
[vcs 2026-07-28T19:47:37.947+00:00] clone [=======================================>     ] 6313341730/7017558714 07s
[vcs 2026-07-28T19:47:38.948+00:00] clone [=========================================>   ] 6661937896/7017558714 04s
[vcs 2026-07-28T19:47:39.146+00:00] clone [===========================================> ] 6974838978/7017558714 01s
[vcs 2026-07-28T19:47:39.146+00:00]                                                                                 
[vcs 2026-07-28T19:47:39.146+00:00] stream-cloned 995577 files / 6.54 GB in 64.4 seconds (104 MB/sec)
[vcs 2026-07-28T19:47:39.657+00:00] finished applying clone bundle
[vcs 2026-07-28T19:47:40.185+00:00] searching for changes
[vcs 2026-07-28T19:47:40.976+00:00] adding changesets
[vcs 2026-07-28T19:47:41.083+00:00] adding manifests
[vcs 2026-07-28T19:47:41.184+00:00] 
[vcs 2026-07-28T19:47:43.226+00:00] manifests [                                                       ]   5/458 12s
[vcs 2026-07-28T19:47:43.253+00:00] manifests [===>                                                   ]  37/458 26s
[vcs 2026-07-28T19:47:43.253+00:00]                                                                                 
[vcs 2026-07-28T19:47:43.253+00:00] adding file changes
[vcs 2026-07-28T19:47:44.914+00:00] added 458 changesets with 3230 changes to 2367 files
[vcs 2026-07-28T19:47:44.914+00:00] new changesets 631ed84b8254:d924d284bc04
[vcs 2026-07-28T19:47:52.521+00:00] searching for changes
[vcs 2026-07-28T19:47:52.577+00:00] no changes found
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark aurora
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark autoland
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark beta
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark central
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr10
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr102
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr115
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr128
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr140
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr153
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr17
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr24
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr31
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr38
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr45
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr52
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr60
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr68
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr78
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark esr91
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark fx-team
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark inbound
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark release
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark tags-beta
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark tags-esr140
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark tags-main
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark tags-release
[vcs 2026-07-28T19:47:53.195+00:00] adding remote bookmark tags-unified
[vcs 2026-07-28T19:47:55.769+00:00] (warning: large working directory being used without fsmonitor enabled; enable fsmonitor to improve performance; see "hg help -e fsmonitor")
[vcs 2026-07-28T19:47:56.685+00:00] 
[vcs 2026-07-28T19:47:57.698+00:00] updating [                                                      ]    100/472200
[vcs 2026-07-28T19:47:58.720+00:00] updating [>                                                 ]  16000/472200 30s
[vcs 2026-07-28T19:47:59.722+00:00] updating [==>                                               ]  30800/472200 30s
[vcs 2026-07-28T19:48:00.725+00:00] updating [===>                                              ]  45800/472200 29s
[vcs 2026-07-28T19:48:01.727+00:00] updating [=====>                                            ]  60500/472200 28s
[vcs 2026-07-28T19:48:02.734+00:00] updating [======>                                           ]  73300/472200 28s
[vcs 2026-07-28T19:48:03.739+00:00] updating [========>                                         ]  87700/472200 27s
[vcs 2026-07-28T19:48:04.740+00:00] updating [=========>                                        ] 103100/472200 26s
[vcs 2026-07-28T19:48:05.744+00:00] updating [===========>                                      ] 118300/472200 25s
[vcs 2026-07-28T19:48:06.745+00:00] updating [=============>                                    ] 133400/472200 24s
[vcs 2026-07-28T19:48:07.749+00:00] updating [==============>                                   ] 147900/472200 23s
[vcs 2026-07-28T19:48:08.756+00:00] updating [================>                                 ] 165900/472200 21s
[vcs 2026-07-28T19:48:09.760+00:00] updating [==================>                               ] 180100/472200 20s
[vcs 2026-07-28T19:48:10.767+00:00] updating [==================>                               ] 185900/472200 21s
[vcs 2026-07-28T19:48:11.789+00:00] updating [===================>                              ] 196100/472200 20s
[vcs 2026-07-28T19:48:13.393+00:00] updating [====================>                             ] 207300/472200 20s
[vcs 2026-07-28T19:48:14.430+00:00] updating [=====================>                            ] 214200/472200 21s
[vcs 2026-07-28T19:48:15.438+00:00] updating [======================>                           ] 224100/472200 20s
[vcs 2026-07-28T19:48:16.445+00:00] updating [=======================>                          ] 235000/472200 19s
[vcs 2026-07-28T19:48:17.448+00:00] updating [=========================>                        ] 249800/472200 18s
[vcs 2026-07-28T19:48:18.456+00:00] updating [===========================>                      ] 267100/472200 16s
[vcs 2026-07-28T19:48:19.468+00:00] updating [============================>                     ] 280700/472200 15s
[vcs 2026-07-28T19:48:20.482+00:00] updating [=============================>                    ] 289900/472200 15s
[vcs 2026-07-28T19:48:21.502+00:00] updating [===============================>                  ] 303100/472200 14s
[vcs 2026-07-28T19:48:22.511+00:00] updating [===============================>                  ] 311500/472200 13s
[vcs 2026-07-28T19:48:23.528+00:00] updating [================================>                 ] 317700/472200 13s
[vcs 2026-07-28T19:48:24.530+00:00] updating [==================================>               ] 333700/472200 12s
[vcs 2026-07-28T19:48:25.533+00:00] updating [====================================>             ] 349700/472200 10s
[vcs 2026-07-28T19:48:26.538+00:00] updating [=====================================>            ] 364100/472200 09s
[vcs 2026-07-28T19:48:27.547+00:00] updating [=======================================>          ] 378000/472200 08s
[vcs 2026-07-28T19:48:28.552+00:00] updating [========================================>         ] 392200/472200 07s
[vcs 2026-07-28T19:48:29.554+00:00] updating [=========================================>        ] 405800/472200 06s
[vcs 2026-07-28T19:48:30.556+00:00] updating [===========================================>      ] 419400/472200 05s
[vcs 2026-07-28T19:48:31.560+00:00] updating [============================================>     ] 433800/472200 03s
[vcs 2026-07-28T19:48:32.563+00:00] updating [==============================================>   ] 447100/472200 02s
[vcs 2026-07-28T19:48:33.985+00:00] updating [===============================================>  ] 458400/472200 02s
[vcs 2026-07-28T19:48:35.106+00:00] updating [================================================> ] 468450/472200 01s
[vcs 2026-07-28T19:48:37.243+00:00]                                                                                 
[vcs 2026-07-28T19:48:37.243+00:00] 472200 files updated, 0 files merged, 0 files removed, 0 files unresolved
[vcs 2026-07-28T19:48:37.336+00:00] updated to d924d284bc0473d77d28ed7b7941f3d45dbbbd27
[vcs 2026-07-28T19:48:37.336+00:00] PERFHERDER_DATA: {"framework": {"name": "vcs"}, "suites": [{"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "clone", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 79.69229888916016}, {"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "update", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 44.12867569923401}, {"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "overall", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 124.56483578681946}, {"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "overall_pull", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 124.56483578681946}, {"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "overall_pull_fullcheckout", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 124.56483578681946}, {"extraOptions": ["projects/887720501152/machineTypes/c3d-standard-8-lssd"], "hgVersion": "7.0.1", "lowerIsBetter": true, "name": "overall_pull_emptywdir", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 124.56483578681946}]}
[vcs 2026-07-28T19:48:37.611+00:00] TinderboxPrint:<a href=https://hg.mozilla.org/integration/autoland/rev/d924d284bc0473d77d28ed7b7941f3d45dbbbd27 title='Built from autoland revision d924d284bc0473d77d28ed7b7941f3d45dbbbd27'>d924d284bc0473d77d28ed7b7941f3d45dbbbd27</a>
[setup 2026-07-28T19:48:37.611+00:00] GECKO_PATH is /builds/worker/checkouts/gecko
[setup 2026-07-28T19:48:37.611+00:00] MOZ_FETCHES_DIR is /builds/worker/fetches
[setup 2026-07-28T19:48:37.611+00:00] MOZ_PYTHON_HOME is /builds/worker/fetches/python
[setup 2026-07-28T19:48:37.611+00:00] PIP_CACHE_DIR is /builds/worker/.task-cache/pip
[setup 2026-07-28T19:48:37.611+00:00] UV_CACHE_DIR is /builds/worker/.task-cache/uv
[setup 2026-07-28T19:48:37.611+00:00] MOZ_UV_HOME is /builds/worker/fetches/uv
[fetches 2026-07-28T19:48:37.611+00:00] fetching artifacts
[fetches 2026-07-28T19:48:37.611+00:00] executing ['/usr/bin/python3', '-u', '/builds/worker/bin/fetch-content', 'task-artifacts']
[fetches 2026-07-28T19:48:37.674+00:00] attempt 1/5
[fetches 2026-07-28T19:48:37.674+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EAqvJpheQA-RspWqJmBB3A/artifacts/public/build/mozcheck.tar.zst to /builds/worker/fetches/mozcheck.tar.zst
[fetches 2026-07-28T19:48:37.674+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EAqvJpheQA-RspWqJmBB3A/artifacts/public/build/mozcheck.tar.zstattempt 1/5
[fetches 2026-07-28T19:48:37.675+00:00] attempt 1/5
[fetches 2026-07-28T19:48:37.675+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dVCLXdJ5QK6tnRnPbHgfvA/artifacts/public/build/uv.tar.zst to /builds/worker/fetches/uv.tar.zst
[fetches 2026-07-28T19:48:37.675+00:00] 
[fetches 2026-07-28T19:48:37.675+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IntQfVO3Q9isl5_99vjFqg/artifacts/public/build/python.tar.zst to /builds/worker/fetches/python.tar.zst
[fetches 2026-07-28T19:48:37.675+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IntQfVO3Q9isl5_99vjFqg/artifacts/public/build/python.tar.zst
[fetches 2026-07-28T19:48:37.675+00:00] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dVCLXdJ5QK6tnRnPbHgfvA/artifacts/public/build/uv.tar.zst
[fetches 2026-07-28T19:48:37.862+00:00] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EAqvJpheQA-RspWqJmBB3A/artifacts/public/build/mozcheck.tar.zst resolved to 1369029 bytes with sha256 8f9993133b46655469511c9013e8ecac2d71461ed72bf7ca03c05a6844075c45 in 0.188s
[fetches 2026-07-28T19:48:37.862+00:00] Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EAqvJpheQA-RspWqJmBB3A/artifacts/public/build/mozcheck.tar.zst
[fetches 2026-07-28T19:48:37.862+00:00] Extracting /builds/worker/fetches/mozcheck.tar.zst to /builds/worker/fetches
[fetches 2026-07-28T19:48:37.873+00:00] /builds/worker/fetches/mozcheck.tar.zst extracted in 0.011s
[fetches 2026-07-28T19:48:37.874+00:00] Removing /builds/worker/fetches/mozcheck.tar.zst
[fetches 2026-07-28T19:48:38.039+00:00] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dVCLXdJ5QK6tnRnPbHgfvA/artifacts/public/build/uv.tar.zst resolved to 19900633 bytes with sha256 a9a1e2595d9d291ae77570285ad94708b2668a33e648dfeb43358e6fe3825545 in 0.363s
[fetches 2026-07-28T19:48:38.039+00:00] Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dVCLXdJ5QK6tnRnPbHgfvA/artifacts/public/build/uv.tar.zst
[fetches 2026-07-28T19:48:38.039+00:00] Extracting /builds/worker/fetches/uv.tar.zst to /builds/worker/fetches
[fetches 2026-07-28T19:48:39.017+00:00] /builds/worker/fetches/uv.tar.zst extracted in 0.978s
[fetches 2026-07-28T19:48:39.017+00:00] Removing /builds/worker/fetches/uv.tar.zst
[fetches 2026-07-28T19:48:39.180+00:00] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IntQfVO3Q9isl5_99vjFqg/artifacts/public/build/python.tar.zst resolved to 110669867 bytes with sha256 cc81746d93ebbfefa299ed2ed1343e8945846ec47b46c1434dc979af8d090eba in 1.505s
[fetches 2026-07-28T19:48:39.180+00:00] Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IntQfVO3Q9isl5_99vjFqg/artifacts/public/build/python.tar.zst
[fetches 2026-07-28T19:48:39.180+00:00] Extracting /builds/worker/fetches/python.tar.zst to /builds/worker/fetches
[fetches 2026-07-28T19:48:40.060+00:00] /builds/worker/fetches/python.tar.zst extracted in 0.880s
[fetches 2026-07-28T19:48:40.060+00:00] Removing /builds/worker/fetches/python.tar.zst
[fetches 2026-07-28T19:48:40.067+00:00] PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 2.394137927999992, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2026-07-28T19:48:40.082+00:00] finished fetching artifacts
[setup 2026-07-28T19:48:40.082+00:00] Setting up local python environment
[setup 2026-07-28T19:48:40.082+00:00] updated PATH with python artifact: /builds/worker/fetches/python/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
[setup 2026-07-28T19:48:40.082+00:00] Adding uv to PATH
[setup 2026-07-28T19:48:40.082+00:00] updated PATH with uv artifact: /builds/worker/fetches/uv:/builds/worker/fetches/python/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
[task 2026-07-28T19:48:40.082+00:00] executing ['bash', '-cx', './mach lint -v -l license -f treeherder -f json:/builds/worker/mozlint.json .']in /builds/worker/checkouts/gecko
[task 2026-07-28T19:48:40.083+00:00] bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8): No such file or directory
[task 2026-07-28T19:48:40.083+00:00] + ./mach lint -v -l license -f treeherder -f json:/builds/worker/mozlint.json .
[task 2026-07-28T19:48:45.001+00:00] Creating default state directory: /builds/worker/.mozbuild
[task 2026-07-28T19:48:45.001+00:00] Creating local state directory: /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69
[task 2026-07-28T19:48:45.001+00:00] Creating the 'lint' site at /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/lint
[task 2026-07-28T19:49:49.865+00:00] 19:49:49.862 license (239) | Passing the following paths:
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/configure.py  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/eslint-rollouts.config.mjs  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/.codex  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/supply-chain  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/.zed  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/servo  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/memory  
[task 2026-07-28T19:49:49.865+00:00] /builds/worker/checkouts/gecko/stylelint-rollouts.config.js
[task 2026-07-28T19:49:50.696+00:00] 19:49:50.696 license (244) | Passing the following paths:
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/.prettierrc.js  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/uriloader  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/accessible  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/eslint.config.mjs  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/caps  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/storage  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/hal  
[task 2026-07-28T19:49:50.696+00:00] /builds/worker/checkouts/gecko/taskcluster
[task 2026-07-28T19:49:53.938+00:00] 19:49:53.938 license (242) | Passing the following paths:
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/gradle  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/eslint-ignores.config.mjs  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/services  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/intl  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/gfx  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/srcdir-resolver.js  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/chrome  
[task 2026-07-28T19:49:53.938+00:00] /builds/worker/checkouts/gecko/eslint-subdirs.config.mjs
[task 2026-07-28T19:49:54.664+00:00] 19:49:54.663 license (246) | Passing the following paths:
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/.babel-eslint.rc.js  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/mozglue  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/modules  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/xpfe  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/.stylelintrc.js  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/media  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/tools  
[task 2026-07-28T19:49:54.664+00:00] /builds/worker/checkouts/gecko/devtools
[task 2026-07-28T19:50:01.928+00:00] 19:50:01.927 license (239) | Finished in 12.35 seconds
[task 2026-07-28T19:50:02.031+00:00] 19:50:02.030 license (244) | Finished in 12.45 seconds
[task 2026-07-28T19:50:02.281+00:00] 19:50:02.281 license (243) | Passing the following paths:
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/layout  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/.github  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/.ycm_extra_conf.py  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/image  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/config  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/editor  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/netwerk  
[task 2026-07-28T19:50:02.281+00:00] /builds/worker/checkouts/gecko/browser
[task 2026-07-28T19:50:02.780+00:00] 19:50:02.780 license (241) | Passing the following paths:
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/mobile  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/docshell  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/gradle.properties  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/python  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/build  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/docs  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/toolkit  
[task 2026-07-28T19:50:02.780+00:00] /builds/worker/checkouts/gecko/.vscode
[task 2026-07-28T19:50:02.947+00:00] 19:50:02.946 license (240) | Passing the following paths:
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/xpcom  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/security  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/widget  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/eslint-file-globals.config.mjs  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/dom  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/.cargo  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/remote  
[task 2026-07-28T19:50:02.947+00:00] /builds/worker/checkouts/gecko/mfbt
[task 2026-07-28T19:50:04.318+00:00] 19:50:04.318 license (241) | Building mozcheck from source...
[task 2026-07-28T19:50:04.321+00:00] 19:50:04.321 license (243) | Finished in 14.74 seconds
[task 2026-07-28T19:50:04.323+00:00] 19:50:04.323 license (241) | Failed to build mozcheck: [Errno 2] No such file or directory: 'cargo'
[task 2026-07-28T19:50:04.324+00:00] 19:50:04.324 license (241) | license failed
[task 2026-07-28T19:50:04.324+00:00] Traceback (most recent call last):
[task 2026-07-28T19:50:04.324+00:00]   File "/builds/worker/checkouts/gecko/python/mozlint/mozlint/roller.py", line 81, in _run_worker
[task 2026-07-28T19:50:04.324+00:00]     res = func(paths, config, **lintargs)
[task 2026-07-28T19:50:04.324+00:00]   File "/builds/worker/checkouts/gecko/python/mozlint/mozlint/types.py", line 72, in __call__
[task 2026-07-28T19:50:04.324+00:00]     return self._lint(paths, config, **lintargs)
[task 2026-07-28T19:50:04.324+00:00]   File "/builds/worker/checkouts/gecko/python/mozlint/mozlint/types.py", line 161, in _lint
[task 2026-07-28T19:50:04.324+00:00]     return func(files, config, **lintargs)
[task 2026-07-28T19:50:04.324+00:00]   File "/builds/worker/checkouts/gecko/tools/lint/mozcheck/__init__.py", line 93, in lint
[task 2026-07-28T19:50:04.324+00:00]     raise LintException(
[task 2026-07-28T19:50:04.324+00:00] mozlint.errors.LintException: mozcheck binary is unavailable: could not locate a prebuilt binary (MOZ_FETCHES_DIR/mozcheck) and the source build failed. Ensure the linter task fetches the relevant mozcheck toolchain, or that cargo is available locally.
[task 2026-07-28T19:50:04.324+00:00] 19:50:04.324 license (241) | Finished in 14.75 seconds
[task 2026-07-28T19:50:04.434+00:00] 19:50:04.434 license (242) | Finished in 14.86 seconds
[task 2026-07-28T19:50:04.692+00:00] 19:50:04.692 license (240) | Finished in 15.11 seconds
[task 2026-07-28T19:50:05.028+00:00] 19:50:05.028 license (246) | Finished in 15.45 seconds
[task 2026-07-28T19:50:10.773+00:00] 19:50:10.773 license (245) | Passing the following paths:
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/extensions  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/.agents  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/ipc  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/eslint-test-paths.config.mjs  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/parser  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/startupcache  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/.claude  
[task 2026-07-28T19:50:10.773+00:00] /builds/worker/checkouts/gecko/js
[task 2026-07-28T19:50:12.249+00:00] 19:50:12.249 license (245) | Finished in 22.67 seconds
[task 2026-07-28T19:50:12.320+00:00] No lint issues found.
[taskcluster 2026-07-28T19:50:12.882Z]                        Exit Code: 1
[taskcluster 2026-07-28T19:50:12.882Z]                        User Time: 17.284ms
[taskcluster 2026-07-28T19:50:12.882Z]                      Kernel Time: 24.691ms
[taskcluster 2026-07-28T19:50:12.882Z]                        Wall Time: 3m44.487467081s
[taskcluster 2026-07-28T19:50:12.882Z]  Average Available System Memory: 29.58 GiB
[taskcluster 2026-07-28T19:50:12.882Z]       Average System Memory Used: 1.76 GiB
[taskcluster 2026-07-28T19:50:12.882Z]          Peak System Memory Used: 4.20 GiB
[taskcluster 2026-07-28T19:50:12.882Z]              Total System Memory: 31.34 GiB
[taskcluster 2026-07-28T19:50:12.882Z]                           Result: FAILED
[taskcluster 2026-07-28T19:50:12.890Z] === Task Finished ===
[taskcluster 2026-07-28T19:50:12.890Z] Task Duration: 3m44.495167681s
[taskcluster 2026-07-28T19:50:13.744Z] [mounts] Preserving cache: Moving "/home/task_178526797359811/cache0" to "/home/generic-worker/caches/Q6NQXlkjR46XbXRyernoeQ"
[taskcluster 2026-07-28T19:50:13.744Z] [mounts] Preserving cache: Moving "/home/task_178526797359811/cache1" to "/home/generic-worker/caches/RCWqkpKNQnyOvugu8fnD_w"
[taskcluster 2026-07-28T19:50:13.745Z] [mounts] Preserving cache: Moving "/home/task_178526797359811/cache2" to "/home/generic-worker/caches/Z3m1XuzrQjiXTDjSembbZg"
[taskcluster:error] exit status 1
Flags: needinfo?(mh+mozilla)
Keywords: regression
Regressed by: 2057371
See Also: → 2036399

Set release status flags based on info from the regressing bug 2057371

status-firefox153: --- → unaffected
status-firefox154: --- → unaffected
status-firefox155: --- → affected
status-firefox-esr140: --- → unaffected
status-firefox-esr153: --- → unaffected

Assuming my local reproduction is identical to what's happening on CI, mach lint runs several tasks in parallel processes, each of which are invoking bootstrap_toolchain, which ultimately calls mach taskgraph tasks, which calls hg, and doing so fails with BlockingIOError: [Errno 11] Resource temporarily unavailable in /some/ (but not all) subprocesses.

I guess there are two problems here:

  • bootstrap_toolchain should probably not end up running mach taskgraph tasks on CI. It (probably) doesn't use its result anyways.
  • we should avoid running mach taskgraph tasks in several subprocesses at the same time. Whether that's by calling bootstrap_toolchain earlier or adding some form of locking is to be determined. This is still necessary even if the first problem is fixed because this may affect running mach lint locally too.
Assignee: nobody → mh+mozilla
Flags: needinfo?(mh+mozilla)

None of the mozcheck-backed linters declare a setup key, so
mozcheck:setup, which calls _find_mozcheck_binary() and possibly
bootstraps mozcheck doesn't run before mozlint runs the linters.

mozlint runs linters in a ProcessPoolExecutor, and all those processes
may end up calling _find_mozcheck_binary() themselves at the same time.
In that case, they may all run mach taskgraph tasks, in turn running
hg and later possibly cargo. In some cases, that could lead to
random failures.

By declaring mozcheck:setup as a setup for all the linters, the binary
is now resolved (and possibly bootstrapped) only once, before linter
processes are spawn.

setup and lint also have to agree on the root they pass down, or
_get_mozcheck_target_dir() can hand them two different target directories and
the workers end up rebuilding anyway; both now go through _resolve_root().

Pushed by mh@glandium.org: https://github.com/mozilla-firefox/firefox/commit/b0e2f7838f59 https://hg.mozilla.org/integration/autoland/rev/d0035ec058a5 Resolve the mozcheck binary in mozlint's parent process r=linter-reviewers,sylvestre

https://hg.mozilla.org/mozilla-central/rev/d0035ec058a5

Status: NEW → RESOLVED
Closed: 1 month ago
status-firefox155: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 155 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: