Closed Bug 1847210 Opened 10 months ago Closed 10 months ago

Perma toolchains custom-car Error: Command 'python3 src/testing/generate_location_tags.py --out src/testing/location_tags.json' returned non-zero exit status 127

Categories

(Firefox Build System :: Task Configuration, defect)

Product:
Firefox Build System
Component:
Task Configuration
Type:
defect

Tracking

(firefox118 fixed)

Status:
RESOLVED FIXED
Milestone:
118 Branch
Tracking Flags:
Tracking Status
firefox118 --- fixed

People

(Reporter: noemi_erli, Assigned: kshampur)

Details

Attachments

(1 file)

Bug 1847210 - Run the cipd setup script due to missing files in macOS and Linux CaR builds. r?#perftest
48 bytes, text/x-phabricator-request
Details | Review

First occurrence on this merge.
Trying to backfill causes this to fail on jobs which initially passed.
https://treeherder.mozilla.org/jobs?repo=mozilla-central&group_state=expanded&collapsedPushes=842382&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&searchStr=toolchains%2Copt%2Ctoolchain%2Cbuilds%2Cfor%2Clinux%2C64-bits%2Ctoolchain-linux64-custom-car%2Ccustom-car&tochange=94da8bb07baea6212776a4b3ddcebff2c08eab98&fromchange=323a980eddb18489b9d7de1ffeff427026574b4c

[task 2023-08-04T10:45:57.086Z] ________ running 'python3 src/third_party/depot_tools/download_from_google_storage.py --no_resume --no_auth --bucket chromium-ads-detection -s src/third_party/subresource-filter-ruleset/data/UnindexedRules.sha1' in '/builds/worker/custom_car/chromium'
[task 2023-08-04T10:45:57.086Z] 0> Downloading src/third_party/subresource-filter-ruleset/data/UnindexedRules@435e1c4c5fd9bc6200c03006415aa1a7864f13ef...
[task 2023-08-04T10:45:57.086Z] Downloading 1 files took 4.391050 second(s)
[task 2023-08-04T10:46:02.578Z] ________ running 'python3 src/tools/update_pgo_profiles.py --target=linux update --gs-url-base=chromium-optimization-profiles/pgo_profiles' in '/builds/worker/custom_car/chromium'
[task 2023-08-04T10:46:02.578Z] Copying gs://chromium-optimization-profiles/pgo_profiles/chrome-linux-main-1691107151-3fc55521a193ae24514b589c4cdabe4026374370.profdata...
[task 2023-08-04T10:46:02.578Z] / [0 files][    0.0 B/ 61.7 MiB]                                                
[task 2023-08-04T10:46:02.578Z] Downloading to temp gzip filename /builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1691107151-3fc55521a193ae24514b589c4cdabe4026374370.profdata_.gztmp
[task 2023-08-04T10:46:02.578Z] -
[task 2023-08-04T10:46:02.578Z] - [0 files][ 36.9 MiB/ 61.7 MiB]                                                
[task 2023-08-04T10:46:02.578Z] \
[task 2023-08-04T10:46:02.578Z] Uncompressing temporarily gzipped file to /builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1691107151-3fc55521a193ae24514b589c4cdabe4026374370.profdata...
[task 2023-08-04T10:46:02.578Z] \ [1 files][ 61.7 MiB/ 61.7 MiB]                                                
[task 2023-08-04T10:46:02.578Z] \ [1 files][ 61.7 MiB/ 61.7 MiB]                                                
[task 2023-08-04T10:46:02.578Z] |
[task 2023-08-04T10:46:02.578Z] Operation completed over 1 objects/61.7 MiB.                                     
[task 2023-08-04T10:46:05.351Z] ________ running 'python3 src/v8/tools/builtins-pgo/download_profiles.py download --depot-tools src/third_party/depot_tools' in '/builds/worker/custom_car/chromium'
[task 2023-08-04T10:46:05.507Z] ________ running 'python3 src/testing/generate_location_tags.py --out src/testing/location_tags.json' in '/builds/worker/custom_car/chromium'
[task 2023-08-04T10:46:05.507Z] /builds/worker/custom_car/chromium/src/third_party/depot_tools/dirmd: line 14: /builds/worker/custom_car/chromium/src/third_party/depot_tools/.cipd_bin/dirmd: No such file or directory
[task 2023-08-04T10:46:05.508Z] Error: Command 'python3 src/testing/generate_location_tags.py --out src/testing/location_tags.json' returned non-zero exit status 127 in /builds/worker/custom_car/chromium
[task 2023-08-04T10:46:05.508Z] /builds/worker/custom_car/chromium/src/third_party/depot_tools/dirmd: line 14: /builds/worker/custom_car/chromium/src/third_party/depot_tools/.cipd_bin/dirmd: No such file or directory
[task 2023-08-04T10:46:05.508Z] 
[taskcluster 2023-08-04 10:46:07.836Z] === Task Finished ===
[taskcluster 2023-08-04 10:46:07.961Z] Artifact "public/build" not found at "/builds/worker/artifacts/": (HTTP code 404) no such container - Could not find the file /builds/worker/artifacts/ in container 6df747a7aefbab1c8ba36385332514b5ebdc566042be6977863879d0becf9d55 
[taskcluster 2023-08-04 10:46:08.032Z] Unsuccessful task run with exit code: 2 completed in 546.937 seconds

Mike, could this be caused by the changes in Bug 1846862?

Flags: needinfo?(mh+mozilla)

the same Error: Command 'python3 src/testing/generate_location_tags.py --out src/testing/location_tags.json' ... is happening on CaR macOS too it seems. e.g. so I don't think it is caused by the debian change in Bug 1846862

But in this push from yesterday it is fine even after linux failed at first.

At the moment I am unsure yet if this is an issue caused by upstream changes or not

Flags: needinfo?(kshampur)

Due to some upstream changes, cipd binaries were not properly being
setup and necessary files were missing during the run hooks step (like dirmd).
This is only affecting macOS and Linux, so this patch just directly runs
the setup script before we proceed with the rest of the build sequence.

Assignee: nobody → kshampur
Attachment #9347521 - Attachment description: WIP: Bug 1847210 - Run the cipd setup script due to missing files in macOS and Linux CaR builds. r?#perftest → Bug 1847210 - Run the cipd setup script due to missing files in macOS and Linux CaR builds. r?#perftest
Status: NEW → ASSIGNED
Pushed by kshampur@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/6a6e81b1dfb4
Run the cipd setup script due to missing files in macOS and Linux CaR builds. r=perftest-reviewers,sparky
Flags: needinfo?(kshampur)
Flags: needinfo?(mh+mozilla)

https://hg.mozilla.org/mozilla-central/rev/6a6e81b1dfb4

Status: ASSIGNED → RESOLVED
Closed: 10 months ago
status-firefox118: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 118 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: