Open Bug 2010445 Opened 14 hours ago Updated 13 hours ago

Perma custom-car toolchain [taskcluster:error] exit status 2 | single tracking bug

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Type:
defect

Tracking

(Not tracked)

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

Details

(Keywords: intermittent-failure)

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=543675133&repo=mozilla-central&task=Y-tiDjmdSuSm8qx4Sem1Hg.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Y-tiDjmdSuSm8qx4Sem1Hg/runs/0/artifacts/public/logs/live_backing.log

 running 'vpython3 scripts/deps/sync_rollup_libs.py' in '/builds/worker/custom_car/chromium/src/third_party/devtools-frontend/src'
[task 2026-01-15T01:34:29.606+00:00] 
[task 2026-01-15T01:34:29.606+00:00] 
[task 2026-01-15T01:34:29.606+00:00] Warnings:
[task 2026-01-15T01:34:29.606+00:00] git update is recommended.
[task 2026-01-15T01:34:29.606+00:00] Installed git version is 2.39.2;
[task 2026-01-15T01:34:29.606+00:00] depot_tools recommends version 2.46.0 or later.
[task 2026-01-15T01:34:29.606+00:00] Disable this warning by setting the GCLIENT_SUPPRESS_GIT_VERSION_WARNING
[task 2026-01-15T01:34:29.606+00:00] environment variable to 1.
[task 2026-01-15T01:34:29.641+00:00] 
[task 2026-01-15T01:34:29.641+00:00] # PGO data should be in src/chrome/build/pgo_profiles/
[task 2026-01-15T01:34:29.641+00:00] # with a name like "chrome-{OS}-<some unique identifier>"
[task 2026-01-15T01:34:29.641+00:00] export PGO_DATA_DIR="$CUSTOM_CAR_DIR/chromium/src/chrome/build/pgo_profiles"
[task 2026-01-15T01:34:29.641+00:00] + export PGO_DATA_DIR=/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles
[task 2026-01-15T01:34:29.641+00:00] + PGO_DATA_DIR=/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles
[task 2026-01-15T01:34:29.641+00:00] for entry in "$PGO_DATA_DIR"/*
[task 2026-01-15T01:34:29.641+00:00] do
[task 2026-01-15T01:34:29.641+00:00]   if [ -f "$entry" ]; then
[task 2026-01-15T01:34:29.641+00:00]     if [[ "$entry" == *"$PGO_SUBSTR"* ]]; then
[task 2026-01-15T01:34:29.641+00:00]         echo "Found the correct profdata"
[task 2026-01-15T01:34:29.641+00:00]         export PGO_DATA_PATH="$entry"
[task 2026-01-15T01:34:29.641+00:00]         break
[task 2026-01-15T01:34:29.641+00:00]     fi
[task 2026-01-15T01:34:29.641+00:00]   fi
[task 2026-01-15T01:34:29.641+00:00] done
[task 2026-01-15T01:34:29.641+00:00] + for entry in "$PGO_DATA_DIR"/*
[task 2026-01-15T01:34:29.641+00:00] + '[' -f /builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata ']'
[task 2026-01-15T01:34:29.641+00:00] + [[ /builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata == *\c\h\r\o\m\e\-\l\i\n\u\x\-\m\a\i\n* ]]
[task 2026-01-15T01:34:29.641+00:00] + echo 'Found the correct profdata'
[task 2026-01-15T01:34:29.641+00:00] Found the correct profdata
[task 2026-01-15T01:34:29.641+00:00] + export PGO_DATA_PATH=/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata
[task 2026-01-15T01:34:29.641+00:00] + PGO_DATA_PATH=/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata
[task 2026-01-15T01:34:29.641+00:00] + break
[task 2026-01-15T01:34:29.641+00:00] 
[task 2026-01-15T01:34:29.641+00:00] PGO_FILE=$PGO_DATA_PATH
[task 2026-01-15T01:34:29.641+00:00] + PGO_FILE=/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata
[task 2026-01-15T01:34:29.641+00:00] if [[ $(uname -o) == "Msys" ]]; then
[task 2026-01-15T01:34:29.641+00:00]   # Compute a relative path that the build scripts looks for.
[task 2026-01-15T01:34:29.641+00:00]   # This odd pathing seems to only happen on windows
[task 2026-01-15T01:34:29.641+00:00]   PGO_FILE=${PGO_DATA_PATH#*/*/*/*/*/*/*/*/*/}
[task 2026-01-15T01:34:29.641+00:00]   mv $PGO_DATA_PATH build/config/compiler/pgo/
[task 2026-01-15T01:34:29.642+00:00] fi
[task 2026-01-15T01:34:29.642+00:00] ++ uname -o
[task 2026-01-15T01:34:29.643+00:00] + [[ GNU/Linux == \M\s\y\s ]]
[task 2026-01-15T01:34:29.643+00:00] 
[task 2026-01-15T01:34:29.643+00:00] CONFIG=$(echo $CONFIG pgo_data_path='"'$PGO_FILE'"')
[task 2026-01-15T01:34:29.643+00:00] ++ echo blink_symbol_level=0 chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=0 'target_cpu="x64"' use_v8_context_snapshot=false v8_symbol_level=0 'pgo_data_path="/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata"'
[task 2026-01-15T01:34:29.643+00:00] + CONFIG='blink_symbol_level=0 chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=0 target_cpu="x64" use_v8_context_snapshot=false v8_symbol_level=0 pgo_data_path="/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata"'
[task 2026-01-15T01:34:29.643+00:00] 
[task 2026-01-15T01:34:29.643+00:00] # Set up then build chrome
[task 2026-01-15T01:34:29.643+00:00] gn gen out/Default --args="$CONFIG"
[task 2026-01-15T01:34:29.643+00:00] + gn gen out/Default '--args=blink_symbol_level=0 chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=0 target_cpu="x64" use_v8_context_snapshot=false v8_symbol_level=0 pgo_data_path="/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata"'
[task 2026-01-15T01:34:35.507+00:00] WARNING at the command-line "--args":1:76: Build argument has no effect.
[task 2026-01-15T01:34:35.507+00:00] blink_symbol_level=0 chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=0 target_cpu="x64" use_v8_context_snapshot=false v8_symbol_level=0 pgo_data_path="/builds/worker/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-linux-main-1768413122-c3872618368044b51ed3244ddd57298cc0b22624-f3a31fef8ac0bb620a80f9957a5ec9e69d23a1d7.profdata"
[task 2026-01-15T01:34:35.507+00:00]                                                                            ^----
[task 2026-01-15T01:34:35.508+00:00] The variable "enable_nacl" was set as a build argument
[task 2026-01-15T01:34:35.508+00:00] but never appeared in a declare_args() block in any buildfile.
[task 2026-01-15T01:34:35.508+00:00] 
[task 2026-01-15T01:34:35.508+00:00] To view all possible args, run "gn args --list <out_dir>"
[task 2026-01-15T01:34:35.508+00:00] 
[task 2026-01-15T01:34:35.508+00:00] The build continued as if that argument was unspecified.
[task 2026-01-15T01:34:35.508+00:00] 
[task 2026-01-15T01:34:35.508+00:00] Done. Made 29403 targets from 4372 files in 5764ms
[taskcluster 2026-01-15T01:34:40.483Z]                        Exit Code: 2
[taskcluster 2026-01-15T01:34:40.483Z]                        User Time: 29.865ms
[taskcluster 2026-01-15T01:34:40.483Z]                      Kernel Time: 29.865ms
[taskcluster 2026-01-15T01:34:40.483Z]                        Wall Time: 6m31.655835486s
[taskcluster 2026-01-15T01:34:40.483Z]  Average Available System Memory: 231.85 GiB
[taskcluster 2026-01-15T01:34:40.483Z]       Average System Memory Used: 4.08 GiB
[taskcluster 2026-01-15T01:34:40.483Z]          Peak System Memory Used: 14.42 GiB
[taskcluster 2026-01-15T01:34:40.483Z]              Total System Memory: 235.93 GiB
[taskcluster 2026-01-15T01:34:40.483Z]                           Result: FAILED
[taskcluster 2026-01-15T01:34:40.483Z] === Task Finished ===
[taskcluster 2026-01-15T01:34:40.483Z] Task Duration: 6m31.656170121s
[taskcluster:warn 2026-01-15T01:34:40.501Z] [d2g] Artifact "public/build" not found at "/builds/worker/artifacts/": exit status 1
[taskcluster:warn 2026-01-15T01:34:40.501Z] Error response from daemon: Could not find the file /builds/worker/artifacts/ in container taskcontainer_dHpIz2J-Rg-8gEtmjDIXbA
[taskcluster:warn 2026-01-15T01:34:40.501Z] 
[taskcluster 2026-01-15T01:35:15.609Z] [mounts] Preserving cache: Moving "/home/task_176844047858806/cache0" to "/home/generic-worker/caches/fr9i3kO-QUWT006k0S2ePg"
[taskcluster:error] exit status 2
Component: Toolchains → Performance
Flags: needinfo?(mh+mozilla) → needinfo?(kshampur)
Product: Firefox Build System → Testing
You need to log in before you can comment on or make changes to this bug.