1928841 - Perma [taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_173058489773476\\public\\build'", reason "file-missing-on-worker" and expiry 2025-01-31T21:57:41.193Z

Status: RESOLVED FIXED

(Firefox Build System :: Toolchains, defect)

Description

[Treeherder Bug Filer]

Filed by: pstanciu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=480923907&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DnSKE_-ORq2fDiVnVwuUgw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-11-02T22:20:11.561Z] Operation completed over 1 objects/80.3 MiB.                                     
[task 2024-11-02T22:20:14.661Z] ________ running 'python3 src/v8/tools/builtins-pgo/download_profiles.py download --depot-tools src/third_party/depot_tools --check-v8-revision --quiet' in 'D:\task_173058489773476\custom_car\chromium'
[task 2024-11-02T22:20:20.769Z] ________ running 'python3 src/testing/generate_location_tags.py --out src/testing/location_tags.json' in 'D:\task_173058489773476\custom_car\chromium'
[task 2024-11-02T22:20:20.815Z] ________ running 'python3 src/build/del_ninja_deps_cache.py' in 'D:\task_173058489773476\custom_car\chromium'
[task 2024-11-02T22:20:20.878Z] ________ running 'python3 src/buildtools/reclient_cfgs/configure_reclient_cfgs.py --rbe_instance projects/rbe-chrome-untrusted/instances/default_instance --reproxy_cfg_template reproxy.cfg.template --rewrapper_cfg_project  --skip_remoteexec_cfg_fetch --quiet' in 'D:\task_173058489773476\custom_car\chromium'
[task 2024-11-02T22:20:20.941Z] ________ running 'python3 src/build/config/siso/configure_siso.py --rbe_instance projects/rbe-chrome-untrusted/instances/default_instance' in 'D:\task_173058489773476\custom_car\chromium'
[task 2024-11-02T22:20:20.983Z] 
[task 2024-11-02T22:20:20.983Z] # PGO data should be in src/chrome/build/pgo_profiles/ 
[task 2024-11-02T22:20:20.983Z] # with a name like "chrome-{OS}-<some unique identifier>"
[task 2024-11-02T22:20:20.983Z] export PGO_DATA_DIR="$CUSTOM_CAR_DIR/chromium/src/chrome/build/pgo_profiles"
[task 2024-11-02T22:20:20.983Z] + export PGO_DATA_DIR=/d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles
[task 2024-11-02T22:20:20.983Z] + PGO_DATA_DIR=/d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles
[task 2024-11-02T22:20:20.983Z] for entry in "$PGO_DATA_DIR"/*
[task 2024-11-02T22:20:20.983Z] do
[task 2024-11-02T22:20:20.983Z]   if [ -f "$entry" ]; then
[task 2024-11-02T22:20:20.983Z]     if [[ "$entry" == *"$PGO_SUBSTR"* ]]; then
[task 2024-11-02T22:20:20.983Z]         echo "Found the correct profdata"
[task 2024-11-02T22:20:20.983Z]         export PGO_DATA_PATH="$entry"
[task 2024-11-02T22:20:20.983Z]         break
[task 2024-11-02T22:20:20.983Z]     fi
[task 2024-11-02T22:20:20.983Z]   fi
[task 2024-11-02T22:20:20.983Z] done
[task 2024-11-02T22:20:20.989Z] + for entry in "$PGO_DATA_DIR"/*
[task 2024-11-02T22:20:20.989Z] + '[' -f /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win-arm64-main-1730569059-bfc1d28566a6b149c15d6e7dca98e6c3b47863dd-2a359789094ad0d5c9a506597d0bb1edd902f549.profdata ']'
[task 2024-11-02T22:20:20.989Z] + [[ /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win-arm64-main-1730569059-bfc1d28566a6b149c15d6e7dca98e6c3b47863dd-2a359789094ad0d5c9a506597d0bb1edd902f549.profdata == *\c\h\r\o\m\e\-\w\i\n\6\4\-\m\a\i\n* ]]
[task 2024-11-02T22:20:20.989Z] + for entry in "$PGO_DATA_DIR"/*
[task 2024-11-02T22:20:20.989Z] + '[' -f /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win32-main-1730559461-8c1d29c73fde0fa61366ee70c3feb51da9460f0d-0843db5be55ada24f02a556404119abf79905413.profdata ']'
[task 2024-11-02T22:20:20.989Z] + [[ /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win32-main-1730559461-8c1d29c73fde0fa61366ee70c3feb51da9460f0d-0843db5be55ada24f02a556404119abf79905413.profdata == *\c\h\r\o\m\e\-\w\i\n\6\4\-\m\a\i\n* ]]
[task 2024-11-02T22:20:20.989Z] + for entry in "$PGO_DATA_DIR"/*
[task 2024-11-02T22:20:20.989Z] + '[' -f /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata ']'
[task 2024-11-02T22:20:20.989Z] + [[ /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata == *\c\h\r\o\m\e\-\w\i\n\6\4\-\m\a\i\n* ]]
[task 2024-11-02T22:20:20.989Z] + echo 'Found the correct profdata'
[task 2024-11-02T22:20:20.989Z] Found the correct profdata
[task 2024-11-02T22:20:20.989Z] + export PGO_DATA_PATH=/d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata
[task 2024-11-02T22:20:20.989Z] + PGO_DATA_PATH=/d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata
[task 2024-11-02T22:20:20.989Z] + break
[task 2024-11-02T22:20:20.989Z] 
[task 2024-11-02T22:20:20.989Z] PGO_FILE=$PGO_DATA_PATH
[task 2024-11-02T22:20:20.989Z] + PGO_FILE=/d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata
[task 2024-11-02T22:20:20.989Z] if [[ $(uname -o) == "Msys" ]]; then
[task 2024-11-02T22:20:20.989Z]   # Compute a relative path that the build scripts looks for.
[task 2024-11-02T22:20:20.989Z]   # This odd pathing seems to only happen on windows
[task 2024-11-02T22:20:20.989Z]   PGO_FILE=${PGO_DATA_PATH#*/*/*/*/*/*/*/*/*/}
[task 2024-11-02T22:20:20.989Z]   mv $PGO_DATA_PATH build/config/compiler/pgo/
[task 2024-11-02T22:20:20.989Z] fi
[task 2024-11-02T22:20:20.998Z] ++ uname -o
[task 2024-11-02T22:20:21.008Z] + [[ Msys == \M\s\y\s ]]
[task 2024-11-02T22:20:21.008Z] + PGO_FILE=chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata
[task 2024-11-02T22:20:21.008Z] + mv /d/task_173058489773476/custom_car/chromium/src/chrome/build/pgo_profiles/chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata build/config/compiler/pgo/
[task 2024-11-02T22:20:21.067Z] 
[task 2024-11-02T22:20:21.067Z] CONFIG=$(echo $CONFIG pgo_data_path='"'$PGO_FILE'"')
[task 2024-11-02T22:20:21.083Z] ++ echo chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=2 'target_cpu="x64"' use_v8_context_snapshot=false 'pgo_data_path="chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata"'
[task 2024-11-02T22:20:21.083Z] + CONFIG='chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=2 target_cpu="x64" use_v8_context_snapshot=false pgo_data_path="chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata"'
[task 2024-11-02T22:20:21.083Z] 
[task 2024-11-02T22:20:21.083Z] # Set up then build chrome
[task 2024-11-02T22:20:21.083Z] gn gen out/Default --args="$CONFIG"
[task 2024-11-02T22:20:21.084Z] + gn gen out/Default '--args=chrome_pgo_phase=2 dcheck_always_on=false enable_nacl=false enable_resource_allowlist_generation=false is_chrome_branded=false is_clang=true is_component_build=false is_debug=false is_official_build=true symbol_level=2 target_cpu="x64" use_v8_context_snapshot=false pgo_data_path="chrome-win64-main-1730548458-a3fe2f479c9d1eff98e58e4126025cfc8d72b74d-90451dffecf29aa325e02a72489edd978e024c59.profdata"'
[task 2024-11-02T22:20:28.991Z] Done. Made 24277 targets from 3846 files in 7615ms
[task 2024-11-02T22:20:29.351Z] autoninja -C out/Default $FINAL_BIN
[task 2024-11-02T22:20:29.351Z] + autoninja -C out/Default chrome
[task 2024-11-02T22:20:48.455Z] ninja: error: 'D:/task_173058489773476/fetches/VS/Windows Kits/10/bin/10.0.22621.0/x64/dxil.dll', needed by 'dxil.dll', missing and no known rule to make it
[task 2024-11-02T22:20:48.465Z] ninja: Entering directory `out/Default'
[taskcluster 2024-11-02T22:20:48.596Z]    Exit Code: 1
[taskcluster 2024-11-02T22:20:48.596Z]    User Time: 15.625ms
[taskcluster 2024-11-02T22:20:48.596Z]  Kernel Time: 15.625ms
[taskcluster 2024-11-02T22:20:48.596Z]    Wall Time: 18m12.6412168s
[taskcluster 2024-11-02T22:20:48.596Z]       Result: FAILED
[taskcluster 2024-11-02T22:20:48.596Z] === Task Finished ===
[taskcluster 2024-11-02T22:20:48.596Z] Task Duration: 18m12.6558996s
[taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_173058489773476\\public\\build'", reason "file-missing-on-worker" and expiry 2025-01-31T21:57:41.193Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'D:\task_173058489773476\public\build'
[taskcluster 2024-11-02T22:20:48.788Z] Uploading artifact public/logs/certified.log from file D:\task_173058489773476\generic-worker\certified.log with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2025-01-31T21:57:41.193Z
[taskcluster 2024-11-02T22:20:49.098Z] Uploading artifact public/chain-of-trust.json from file D:\task_173058489773476\generic-worker\chain-of-trust.json with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2025-01-31T21:57:41.193Z
[taskcluster 2024-11-02T22:20:49.353Z] Uploading artifact public/chain-of-trust.json.sig from file D:\task_173058489773476\generic-worker\chain-of-trust.json.sig with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-01-31T21:57:41.193Z
[taskcluster 2024-11-02T22:20:49.597Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-01-31T21:57:41.193Z
[taskcluster:error] exit status 1

Comment 1

[Intermittent Failures Robot]

5 failures in 4361 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform and build breakdown:

• toolchains: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1928841&startday=2024-10-28&endday=2024-11-03&tree=all

Comment 2

[Kash Shampur [:kshampur] ⌚EST]

they've reverted the previous sdk update
https://github.com/chromium/chromium/commit/ea1232d83ab12ebfbbb014129bf174a1259e6506

Comment 3

[Kash Shampur [:kshampur] ⌚EST]

Attachment: Bug 1928841 - Temporarily revert to previous SDK for windows CaR builds. r?#perftest

Upstream has temporarily reverted the recent change in the Windows SDK
used for chromium builds. It is not clear when they will bump the
version again, but in the meantime this will resolve current build
failures.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/30133ad19179
Temporarily revert to previous SDK for windows CaR builds. r=aglavic

Comment 5

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/30133ad19179

Comment 6

[Intermittent Failures Robot]

2 failures in 4515 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• toolchains: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1928841&startday=2024-11-04&endday=2024-11-10&tree=all