Closed Bug 1955792 Opened 9 months ago Closed 8 months ago

Perma [tier 2] Windows 10 x64 WebRender Shippable Btime Cannot find Google Chrome at C:\Progra~2\Google\Chrome\Application\chrome.exe

Categories

(Testing :: mozperftest, defect, P5)

Product:
Testing
Component:
mozperftest
Type:
defect

Tracking

(firefox-esr128 unaffected, firefox136 unaffected, firefox137 fixed, firefox138 fixed)

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox-esr128 --- unaffected
firefox136 --- unaffected
firefox137 --- fixed
firefox138 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: jmoss)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Filed by: amarc [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=500474946&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/akW-waCETTShKj48rNnGXA/runs/0/artifacts/public/logs/live_backing.log

[task 2025-03-23T00:09:27.006Z] 00:09:27     INFO -        Successfully uninstalled requests-2.27.1
[task 2025-03-23T00:09:28.043Z] 00:09:28     INFO -  Successfully installed conditioned-profile-0.2 h2-4.1.0 hpack-4.0.0 hyperframe-6.0.0 pywebsocket3-4.0.2 requests-2.32.3 wptserve-4.0.2
[task 2025-03-23T00:09:28.131Z] 00:09:28     INFO - Return code: 0
[task 2025-03-23T00:09:28.137Z] 00:09:28     INFO - Running post-action listener: _resource_record_post_action
[task 2025-03-23T00:09:28.138Z] 00:09:28     INFO - Running post-action listener: _start_resource_monitoring
[task 2025-03-23T00:09:28.139Z] 00:09:28     INFO - Starting resource monitoring.
[task 2025-03-23T00:09:28.150Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.150985Z] Finished create-virtualenv step (success)
[task 2025-03-23T00:09:28.150Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.150985Z] Skipping install-chrome-android step.
[task 2025-03-23T00:09:28.161Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.150985Z] Skipping install-chromium-android step.
[task 2025-03-23T00:09:28.161Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.161609Z] Running install-chromium-distribution step.
[task 2025-03-23T00:09:28.161Z] 00:09:28     INFO - Running pre-action listener: _resource_record_pre_action
[task 2025-03-23T00:09:28.161Z] 00:09:28     INFO - Running main action method: install_chromium_distribution
[task 2025-03-23T00:09:28.161Z] 00:09:28     INFO - Chrome should be preinstalled.
[task 2025-03-23T00:09:28.162Z] 00:09:28    ERROR - Cannot find Google Chrome at C:\Progra~2\Google\Chrome\Application\chrome.exe
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - Running post-action listener: _resource_record_post_action
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.162127Z] Finished install-chromium-distribution step (success)
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.162127Z] Skipping install-safari-technology-preview step.
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - [mozharness: 2025-03-23 00:09:28.162127Z] Running install step.
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - Running pre-action listener: _resource_record_pre_action
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - Running main action method: install
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - Getting output from command: ['C:\\task_174198094745275\\build\\venv\\Scripts\\pip', 'list', '--format', 'freeze', '--no-index']
[task 2025-03-23T00:09:28.162Z] 00:09:28     INFO - Copy/paste: C:\task_174198094745275\build\venv\Scripts\pip list --format freeze --no-index
[task 2025-03-23T00:09:28.955Z] 00:09:28     INFO - Reading from file tmpfile_stdout
[task 2025-03-23T00:09:28.974Z] 00:09:28     INFO - Using _rmtree_windows ...
[task 2025-03-23T00:09:28.974Z] 00:09:28     INFO - Running command: del /F /Q "C:\task_174198094745275\tmpfile_stderr"
[task 2025-03-23T00:09:28.984Z] 00:09:28     INFO - Return code: 0
[task 2025-03-23T00:09:28.985Z] 00:09:28     INFO - Using _rmtree_windows ...
[task 2025-03-23T00:09:28.985Z] 00:09:28     INFO - Running command: del /F /Q "C:\task_174198094745275\tmpfile_stdout"
[task 2025-03-23T00:09:28.990Z] 00:09:28     INFO - Return code: 0
[task 2025-03-23T00:09:28.990Z] 00:09:28     INFO - Return code: 0
[task 2025-03-23T00:09:28.994Z] 00:09:28     INFO - mkdir: C:\task_174198094745275\build\application
[task 2025-03-23T00:09:28.994Z] 00:09:28     INFO - Getting output from command: ['C:\\task_174198094745275\\build\\venv\\Scripts\\mozinstall', 'C:\\task_174198094745275\\build\\target.zip', '--destination', 'C:\\task_174198094745275\\build\\application']
[task 2025-03-23T00:09:28.994Z] 00:09:28     INFO - Copy/paste: C:\task_174198094745275\build\venv\Scripts\mozinstall C:\task_174198094745275\build\target.zip --destination C:\task_174198094745275\build\application
[task 2025-03-23T00:09:31.451Z] 00:09:31     INFO - Reading from file tmpfile_stdout
[task 2025-03-23T00:09:31.467Z] 00:09:31     INFO - Output received:
[task 2025-03-23T00:09:31.467Z] 00:09:31     INFO -  C:\task_174198094745275\build\application\firefox\firefox.exe
[task 2025-03-23T00:09:31.474Z] 00:09:31     INFO - Using _rmtree_windows ...
[task 2025-03-23T00:09:31.475Z] 00:09:31     INFO - Running command: del /F /Q "C:\task_174198094745275\tmpfile_stderr"
[task 2025-03-23T00:09:31.485Z] 00:09:31     INFO - Return code: 0
[task 2025-03-23T00:09:31.485Z] 00:09:31     INFO - Using _rmtree_windows ...
[task 2025-03-23T00:09:31.485Z] 00:09:31     INFO - Running command: del /F /Q "C:\task_174198094745275\tmpfile_stdout"
[task 2025-03-23T00:09:31.494Z] 00:09:31     INFO - Return code: 0
[task 2025-03-23T00:09:31.494Z] 00:09:31     INFO - Return code: 0
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running post-action listener: _resource_record_post_action
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - [mozharness: 2025-03-23 00:09:31.495170Z] Finished install step (success)
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - [mozharness: 2025-03-23 00:09:31.495170Z] Running run-tests step.
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running pre-action listener: _resource_record_pre_action
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running pre-action listener: _set_gcov_prefix
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running pre-action listener: timed_screenshots
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running main action method: run_tests
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running pre test command run mouse & screen adjustment script with 'c:\mozilla-build\python3\python3.exe C:\task_174198094745275\mozharness\external_tools\mouse_and_screen_resolution.py --configuration-file C:\task_174198094745275\mozharness\external_tools\machine-configuration.json --platform win10-hw'
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Running command: ('c:\\mozilla-build\\python3\\python3.exe', 'C:\\task_174198094745275\\mozharness\\external_tools\\mouse_and_screen_resolution.py', '--configuration-file', 'C:\\task_174198094745275\\mozharness\\external_tools\\machine-configuration.json', '--platform', 'win10-hw') in C:\task_174198094745275\build
[task 2025-03-23T00:09:31.495Z] 00:09:31     INFO - Copy/paste: c:\mozilla-build\python3\python3.exe C:\task_174198094745275\mozharness\external_tools\mouse_and_screen_resolution.py --configuration-file C:\task_174198094745275\mozharness\external_tools\machine-configuration.json --platform win10-hw
[task 2025-03-23T00:09:34.778Z] 00:09:34     INFO -  Screen resolution (current): (1024, 768)
[task 2025-03-23T00:09:34.778Z] 00:09:34     INFO -  Changing the screen resolution...
[task 2025-03-23T00:09:34.779Z] 00:09:34     INFO -  Screen resolution (new): (1920, 1080)
[task 2025-03-23T00:09:34.779Z] 00:09:34     INFO -  Mouse position (current): (960, 540)
[task 2025-03-23T00:09:34.780Z] 00:09:34     INFO -  Mouse position (new): (1010, 10)
[task 2025-03-23T00:09:34.791Z] 00:09:34     INFO - Return code: 0
[task 2025-03-23T00:09:34.791Z] 00:09:34     INFO - Running command: ['C:\\task_174198094745275\\build\\venv\\Scripts\\python', '--version']
[task 2025-03-23T00:09:34.791Z] 00:09:34     INFO - Copy/paste: C:\task_174198094745275\build\venv\Scripts\python --version
[task 2025-03-23T00:09:34.804Z] 00:09:34     INFO -  Python 3.11.7
[task 2025-03-23T00:09:34.813Z] 00:09:34     INFO - Return code: 0
[task 2025-03-23T00:09:34.813Z] 00:09:34     INFO - ENV: MOZ_UPLOAD_DIR is now C:\task_174198094745275\build\blobber_upload_dir
[task 2025-03-23T00:09:34.813Z] 00:09:34     INFO - ENV: MINIDUMP_STACKWALK is now C:/task_174198094745275/fetches\minidump-stackwalk\minidump-stackwalk.exe
[task 2025-03-23T00:09:34.814Z] 00:09:34     INFO - ENV: MINIDUMP_SAVE_PATH is now C:\task_174198094745275\build\blobber_upload_dir
[task 2025-03-23T00:09:34.814Z] 00:09:34     INFO - ENV: RUST_BACKTRACE is now full
[task 2025-03-23T00:09:34.815Z] 00:09:34     INFO - Running command: ['C:\\task_174198094745275\\build\\venv\\Scripts\\python', 'C:\\task_174198094745275\\build\\tests\\raptor\\raptor\\raptor.py', '--extra-profiler-run', '--screenshot-on-failure', '--power-test', '--browsertime-node', 'C:/task_174198094745275/fetches/node/node.exe', '--browsertime-browsertimejs', 'C:/task_174198094745275/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', 'C:/task_174198094745275/fetches/{}chromedriver.exe', '--browsertime-ffmpeg', 'C:/task_174198094745275/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe', '--browsertime-geckodriver', 'C:/task_174198094745275/fetches/geckodriver.exe', '--browsertime', '--app', 'chrome', '--binary', 'C:\\Progra~2\\Google\\Chrome\\Application\\chrome.exe', '--test', 'speedometer3', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BVJpm9oNT6KEBNREvrknOw/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=info'] in C:\task_174198094745275\build
[task 2025-03-23T00:09:34.815Z] 00:09:34     INFO - Copy/paste: C:\task_174198094745275\build\venv\Scripts\python C:\task_174198094745275\build\tests\raptor\raptor\raptor.py --extra-profiler-run --screenshot-on-failure --power-test --browsertime-node C:/task_174198094745275/fetches/node/node.exe --browsertime-browsertimejs C:/task_174198094745275/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --browsertime-chromedriver C:/task_174198094745275/fetches/{}chromedriver.exe --browsertime-ffmpeg C:/task_174198094745275/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe --browsertime-geckodriver C:/task_174198094745275/fetches/geckodriver.exe --browsertime --app chrome --binary C:\Progra~2\Google\Chrome\Application\chrome.exe --test speedometer3 --symbolsPath https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BVJpm9oNT6KEBNREvrknOw/artifacts/public/build/target.crashreporter-symbols.zip --host 127.0.0.1 --log-tbpl-level=info
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO - Using env: {'ALLUSERSPROFILE': 'C:\\ProgramData',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'CHOCOLATEYINSTALL': 'C:\\ProgramData\\chocolatey',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'COMMONPROGRAMFILES': 'C:\\Program Files\\Common Files',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'COMMONPROGRAMFILES(X86)': 'C:\\Program Files (x86)\\Common Files',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'COMMONPROGRAMW6432': 'C:\\Program Files\\Common Files',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'COMPUTERNAME': 'T-W1064-MS-171',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'COMSPEC': 'C:\\Windows\\system32\\cmd.exe',
[task 2025-03-23T00:09:34.816Z] 00:09:34     INFO -  'DRIVERDATA': 'C:\\Windows\\System32\\Drivers\\DriverData',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'EXTERNALTOOLSPATH': 'C:\\task_174198094745275\\mozharness\\external_tools',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'EXTRA_MOZHARNESS_CONFIG': '{"installer_url": '
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BVJpm9oNT6KEBNREvrknOw/artifacts/public/build/target.zip", '
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -                             '"test_packages_url": '
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BVJpm9oNT6KEBNREvrknOw/artifacts/public/build/target.test_packages.json"}',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/mozilla-central',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'GECKO_HEAD_REV': '534a13b85214385f5aec0bf0b3429d3fc21bb436',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'HG_CACHE': 'c:\\hg-cache',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'HOMEDRIVE': 'C:',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'HOMEPATH': '\\Users\\task_174198094745275',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'LOCALAPPDATA': 'C:\\Users\\task_174198094745275\\AppData\\Local',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'LOGONSERVER': '\\\\T-W1064-MS-171',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'MINIDUMP_SAVE_PATH': 'C:\\task_174198094745275\\build\\blobber_upload_dir',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'MINIDUMP_STACKWALK': 'C:/task_174198094745275/fetches\\minidump-stackwalk\\minidump-stackwalk.exe',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'MOZILLABUILD': 'C:\\mozilla-build',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'MOZ_AUTOMATION': '1',
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -  'MOZ_FETCHES': '[{"artifact": "public/build/browsertime.tar.zst", "extract": '
[task 2025-03-23T00:09:34.817Z] 00:09:34     INFO -                 'true, "task": "J8eJkwcMS3u3d7P3rq5p4g"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/build/fix-stacks.tar.zst", "extract": true, "task": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"MgW1rCUVSle03s9tRTCsoQ"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/build/geckodriver.zip", "extract": true, "task": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"VID3mWb9T22BowXyj0xQLg"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/build/minidump-stackwalk.tar.zst", "extract": true, '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"task": "S8ft6HQfTnWB8aGhlldr4A"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/build/node.tar.zst", "extract": true, "task": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"LqFRN_KrRriCxQv_Cmg4Aw"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/cft-cd-win64-backup.tar.bz2", "extract": true, '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"task": "OuPQ4AjBTzyvP8VES1-W4A"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/cft-cd-win64.tar.bz2", "extract": true, "task": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"MQFqENIXR92PgeDWow4Ceg"}, {"artifact": '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"public/ffmpeg-4.4.1-full_build.zip", "extract": true, '
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -                 '"task": "CfTBGdWTQWanJFHIAdo31g"}]',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'MOZ_FETCHES_DIR': 'C:/task_174198094745275/fetches',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'MOZ_SCM_LEVEL': '3',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'MOZ_UPLOAD_DIR': 'C:\\task_174198094745275\\build\\blobber_upload_dir',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'NUMBER_OF_PROCESSORS': '8',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'ONEDRIVE': 'C:\\Users\\task_174198094745275\\OneDrive',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'OS': 'Windows_NT',
[task 2025-03-23T00:09:34.818Z] 00:09:34     INFO -  'PATH': 'C:\\task_174198094745275\\build\\venv\\Scripts;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;C:\\Windows\\System32\\OpenSSH\\;C:\\ProgramData\\chocolatey\\bin;C:\\Windows\\system32\\config\\systemprofile\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Program '
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -          'Files\\git\\bin;C:\\Program Files\\Puppet '
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -          'Labs\\Puppet\\bin;C:\\Program Files (x86)\\Windows Kits\\10\\Windows '
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -          'Performance Toolkit\\;C:\\Program Files '
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -          '(x86)\\GNU\\GnuPG\\pub;C:\\Program '
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -          'Files\\Mercurial\\;C:\\mozilla-build\\bin;C:\\mozilla-build\\kdiff3;C:\\mozilla-build\\msys2;C:\\mozilla-build\\python3;C:\\mozilla-build\\msys2\\usr\\bin;C:\\Users\\task_174198094745275\\AppData\\Local\\Microsoft\\WindowsApps',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PATHEXT': '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PIP_DOWNLOAD_CACHE': 'c:\\pip-cache',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROCESSOR_ARCHITECTURE': 'AMD64',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROCESSOR_IDENTIFIER': 'Intel64 Family 6 Model 94 Stepping 3, GenuineIntel',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROCESSOR_LEVEL': '6',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROCESSOR_REVISION': '5e03',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROGRAMDATA': 'C:\\ProgramData',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROGRAMFILES': 'C:\\Program Files',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROGRAMFILES(X86)': 'C:\\Program Files (x86)',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROGRAMW6432': 'C:\\Program Files',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PROMPT': '$P$G',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PSMODULEPATH': '%ProgramFiles%\\WindowsPowerShell\\Modules;C:\\Windows\\system32\\WindowsPowerShell\\v1.0\\Modules',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PUBLIC': 'C:\\Users\\Public',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PYTHON': 'c:\\mozilla-build\\python3\\python3.exe',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'PYTHONPATH': 'C:\\task_174198094745275\\build\\tests\\raptor',
[task 2025-03-23T00:09:34.819Z] 00:09:34     INFO -  'REQUIRE_GPU': '0',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'RUN_ID': '0',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'RUST_BACKTRACE': 'full',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'SCCACHE_DISABLE': '1',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'SCRIPTSPATH': 'C:\\task_174198094745275\\mozharness',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'SYSTEMDRIVE': 'C:',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'SYSTEMROOT': 'C:\\Windows',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASKCLUSTER_PROXY_URL': 'http://localhost:8080',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASKCLUSTER_WORKER_LOCATION': '{"cloud":"standalone","host":"datacenter"}',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASK_GROUP_ID': 'GP7gyXhPRMK0PZioZUK6YQ',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASK_ID': 'akW-waCETTShKj48rNnGXA',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TASK_WORKDIR': 'C:/task_174198094745275',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TEMP': 'C:\\Users\\task_174198094745275\\AppData\\Local\\Temp',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TMP': 'C:\\Users\\task_174198094745275\\AppData\\Local\\Temp',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'TOOLTOOL_CACHE': 'C:\\builds\\tooltool_cache',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'USERDOMAIN': 'T-W1064-MS-171',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'USERNAME': 'task_174198094745275',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'USERPROFILE': 'C:\\Users\\task_174198094745275',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'VIRTUAL_ENV': 'venv',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'WINDIR': 'C:\\Windows',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'XPCSHELL_PATH': 'C:\\task_174198094745275\\build\\application\\firefox\\xpcshell.exe',
[task 2025-03-23T00:09:34.820Z] 00:09:34     INFO -  'ZES_ENABLE_SYSMAN': '1'}
[task 2025-03-23T00:09:34.824Z] 00:09:34     INFO - Calling ['C:\\task_174198094745275\\build\\venv\\Scripts\\python', 'C:\\task_174198094745275\\build\\tests\\raptor\\raptor\\raptor.py', '--extra-profiler-run', '--screenshot-on-failure', '--power-test', '--browsertime-node', 'C:/task_174198094745275/fetches/node/node.exe', '--browsertime-browsertimejs', 'C:/task_174198094745275/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', 'C:/task_174198094745275/fetches/{}chromedriver.exe', '--browsertime-ffmpeg', 'C:/task_174198094745275/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe', '--browsertime-geckodriver', 'C:/task_174198094745275/fetches/geckodriver.exe', '--browsertime', '--app', 'chrome', '--binary', 'C:\\Progra~2\\Google\\Chrome\\Application\\chrome.exe', '--test', 'speedometer3', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BVJpm9oNT6KEBNREvrknOw/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=info'] with output_timeout 3600
[task 2025-03-23T00:09:36.014Z] 00:09:36     INFO -  usage: raptor.py [-h] -t TEST
[task 2025-03-23T00:09:36.018Z] 00:09:36     INFO -                   [--app {firefox,chrome,safari,safari-tp,custom-car,geckoview,refbrow,fenix,chrome-m,cstm-car-m}]
[task 2025-03-23T00:09:36.018Z] 00:09:36     INFO -                   [-b BINARY] [-a ACTIVITY] [-i INTENT] [--host HOST]
[task 2025-03-23T00:09:36.019Z] 00:09:36     INFO -                   [--live-sites] [--chimera] [--is-release-build]
[task 2025-03-23T00:09:36.019Z] 00:09:36     INFO -                   [--gecko-profile]
[task 2025-03-23T00:09:36.019Z] 00:09:36     INFO -                   [--gecko-profile-entries GECKO_PROFILE_ENTRIES]
[task 2025-03-23T00:09:36.020Z] 00:09:36     INFO -                   [--gecko-profile-interval GECKO_PROFILE_INTERVAL]
[task 2025-03-23T00:09:36.020Z] 00:09:36     INFO -                   [--gecko-profile-thread GECKO_PROFILE_EXTRA_THREADS]
[task 2025-03-23T00:09:36.021Z] 00:09:36     INFO -                   [--gecko-profile-threads GECKO_PROFILE_THREADS]
[task 2025-03-23T00:09:36.021Z] 00:09:36     INFO -                   [--gecko-profile-features GECKO_PROFILE_FEATURES]
[task 2025-03-23T00:09:36.021Z] 00:09:36     INFO -                   [--extra-profiler-run] [--symbolsPath SYMBOLS_PATH]
[task 2025-03-23T00:09:36.022Z] 00:09:36     INFO -                   [--page-cycles PAGE_CYCLES] [--page-timeout PAGE_TIMEOUT]
[task 2025-03-23T00:09:36.022Z] 00:09:36     INFO -                   [--post-startup-delay POST_STARTUP_DELAY]
[task 2025-03-23T00:09:36.022Z] 00:09:36     INFO -                   [--browser-cycles BROWSER_CYCLES] [--project PROJECT]
[task 2025-03-23T00:09:36.023Z] 00:09:36     INFO -                   [--test-url-params TEST_URL_PARAMS] [--print-tests]
[task 2025-03-23T00:09:36.024Z] 00:09:36     INFO -                   [--debug-mode] [--disable-e10s] [--device-name DEVICE_NAME]
[task 2025-03-23T00:09:36.024Z] 00:09:36     INFO -                   [--disable-fission] [--enable-fission-mobile]
[task 2025-03-23T00:09:36.024Z] 00:09:36     INFO -                   [--setpref PREF=VALUE] [--setenv NAME=VALUE] [--run-local]
[task 2025-03-23T00:09:36.025Z] 00:09:36     INFO -                   [--obj-path OBJ_PATH] [--mozbuild-path MOZBUILD_PATH]
[task 2025-03-23T00:09:36.025Z] 00:09:36     INFO -                   [--no-install] [--installerpath INSTALLERPATH]
[task 2025-03-23T00:09:36.025Z] 00:09:36     INFO -                   [--disable-perf-tuning]
[task 2025-03-23T00:09:36.026Z] 00:09:36     INFO -                   [--conditioned-profile CONDITIONED_PROFILE]
[task 2025-03-23T00:09:36.026Z] 00:09:36     INFO -                   [--test-bytecode-cache] [--cold] [--browsertime]
[task 2025-03-23T00:09:36.026Z] 00:09:36     INFO -                   [--browsertime-arg OPTION=VALUE]
[task 2025-03-23T00:09:36.026Z] 00:09:36     INFO -                   [--browsertime-node BROWSERTIME_NODE]
[task 2025-03-23T00:09:36.027Z] 00:09:36     INFO -                   [--browsertime-browsertimejs BROWSERTIME_BROWSERTIMEJS]
[task 2025-03-23T00:09:36.027Z] 00:09:36     INFO -                   [--browsertime-vismet-script BROWSERTIME_VISMET_SCRIPT]
[task 2025-03-23T00:09:36.027Z] 00:09:36     INFO -                   [--browsertime-chromedriver BROWSERTIME_CHROMEDRIVER]
[task 2025-03-23T00:09:36.028Z] 00:09:36     INFO -                   [--browsertime-video] [--browsertime-visualmetrics]
[task 2025-03-23T00:09:36.028Z] 00:09:36     INFO -                   [--browsertime-no-ffwindowrecorder]
[task 2025-03-23T00:09:36.028Z] 00:09:36     INFO -                   [--browsertime-ffmpeg BROWSERTIME_FFMPEG]
[task 2025-03-23T00:09:36.029Z] 00:09:36     INFO -                   [--browsertime-geckodriver BROWSERTIME_GECKODRIVER]
[task 2025-03-23T00:09:36.029Z] 00:09:36     INFO -                   [--browsertime-existing-results BROWSERTIME_EXISTING_RESULTS]
[task 2025-03-23T00:09:36.029Z] 00:09:36     INFO -                   [--verbose] [--enable-marionette-trace] [--clean]
[task 2025-03-23T00:09:36.030Z] 00:09:36     INFO -                   [--collect-perfstats] [--extra-summary-methods OPTION]
[task 2025-03-23T00:09:36.030Z] 00:09:36     INFO -                   [--benchmark-repository BENCHMARK_REPOSITORY]
[task 2025-03-23T00:09:36.030Z] 00:09:36     INFO -                   [--benchmark-revision BENCHMARK_REVISION]
[task 2025-03-23T00:09:36.030Z] 00:09:36     INFO -                   [--benchmark-branch BENCHMARK_BRANCH]
[task 2025-03-23T00:09:36.031Z] 00:09:36     INFO -                   [--screenshot-on-failure] [--power-test] [--log-raw LOG_RAW]
[task 2025-03-23T00:09:36.031Z] 00:09:36     INFO -                   [--log-unittest LOG_UNITTEST] [--log-xunit LOG_XUNIT]
[task 2025-03-23T00:09:36.031Z] 00:09:36     INFO -                   [--log-html LOG_HTML] [--log-mach LOG_MACH]
[task 2025-03-23T00:09:36.031Z] 00:09:36     INFO -                   [--log-tbpl LOG_TBPL] [--log-grouped LOG_GROUPED]
[task 2025-03-23T00:09:36.032Z] 00:09:36     INFO -                   [--log-raw-level LOG_RAW_LEVEL] [--log-mach-verbose]
[task 2025-03-23T00:09:36.032Z] 00:09:36     INFO -                   [--log-mach-level LOG_MACH_LEVEL]
[task 2025-03-23T00:09:36.032Z] 00:09:36     INFO -                   [--log-mach-buffer LOG_MACH_BUFFER] [--log-mach-screenshot]
[task 2025-03-23T00:09:36.032Z] 00:09:36     INFO -                   [--log-mach-no-screenshot] [--log-tbpl-compact]
[task 2025-03-23T00:09:36.032Z] 00:09:36     INFO -                   [--log-tbpl-level LOG_TBPL_LEVEL]
[task 2025-03-23T00:09:36.033Z] 00:09:36     INFO -                   [--log-tbpl-buffer LOG_TBPL_BUFFER]
[task 2025-03-23T00:09:36.033Z] 00:09:36     INFO -  raptor.py: error: C:\Progra~2\Google\Chrome\Application\chrome.exe does not exist!
[task 2025-03-23T00:09:36.062Z] 00:09:36     INFO - Return code: 2
[task 2025-03-23T00:09:36.072Z] 00:09:36  WARNING - setting return code to 2
[task 2025-03-23T00:09:36.072Z] 00:09:36     INFO - Copying Raptor results to upload dir:
[task 2025-03-23T00:09:36.072Z] 00:09:36     INFO - C:\task_174198094745275\build\blobber_upload_dir\perfherder-data.json
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - Copying raptor results from C:\task_174198094745275\build\raptor.json to C:\task_174198094745275\build\blobber_upload_dir\perfherder-data.json
[task 2025-03-23T00:09:36.073Z] 00:09:36 CRITICAL - Error copying results C:\task_174198094745275\build\raptor.json to upload dir C:\task_174198094745275\build\blobber_upload_dir\perfherder-data.json
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - [Errno 2] No such file or directory: 'C:\\task_174198094745275\\build\\raptor.json'
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - Running post-action listener: _package_coverage_data
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - Running post-action listener: _resource_record_post_action
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - Running post-action listener: process_java_coverage_data
[task 2025-03-23T00:09:36.073Z] 00:09:36     INFO - Running post-action listener: stop_device
[task 2025-03-23T00:09:36.074Z] 00:09:36     INFO - [mozharness: 2025-03-23 00:09:36.073642Z] Finished run-tests step (success)
[task 2025-03-23T00:09:36.074Z] 00:09:36     INFO - Running post-run listener: _resource_record_post_run
[task 2025-03-23T00:09:37.170Z] 00:09:37     INFO - Total resource usage - Wall time: 8s; CPU: 8%; Read bytes: 25346048; Write bytes: 129777664; Read time: 0; Write time: 0
[task 2025-03-23T00:09:37.170Z] 00:09:37     INFO - TinderboxPrint: CPU usage<br/>7.7%
[task 2025-03-23T00:09:37.170Z] 00:09:37     INFO - TinderboxPrint: I/O read bytes / time<br/>25,346,048 / 0
[task 2025-03-23T00:09:37.185Z] 00:09:37     INFO - TinderboxPrint: I/O write bytes / time<br/>129,777,664 / 0
[task 2025-03-23T00:09:37.185Z] 00:09:37     INFO - TinderboxPrint: CPU idle<br/>46.6 (92.3%)
[task 2025-03-23T00:09:37.185Z] 00:09:37     INFO - TinderboxPrint: CPU system<br/>1.2 (2.4%)
[task 2025-03-23T00:09:37.185Z] 00:09:37     INFO - TinderboxPrint: CPU user<br/>2.6 (5.2%)
[task 2025-03-23T00:09:37.185Z] 00:09:37     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-03-23T00:09:37.186Z] 00:09:37     INFO - install - Wall time: 3s; CPU: 13%; Read bytes: 24313344; Write bytes: 22405120; Read time: 0; Write time: 0
[task 2025-03-23T00:09:37.186Z] 00:09:37     INFO - run-tests - Wall time: 5s; CPU: 5%; Read bytes: 1032704; Write bytes: 107372544; Read time: 0; Write time: 0
[task 2025-03-23T00:09:37.198Z] 00:09:37  WARNING - returning nonzero exit status 2
[taskcluster 2025-03-23T00:09:37.254Z]    Exit Code: 2
[taskcluster 2025-03-23T00:09:37.254Z]    User Time: 15.625ms
[taskcluster 2025-03-23T00:09:37.254Z]  Kernel Time: 46.875ms
[taskcluster 2025-03-23T00:09:37.254Z]    Wall Time: 2m29.9452654s
[taskcluster 2025-03-23T00:09:37.254Z]       Result: FAILED
[taskcluster 2025-03-23T00:09:37.254Z] === Task Finished ===
[taskcluster 2025-03-23T00:09:37.254Z] Task Duration: 2m29.9468562s
[taskcluster 2025-03-23T00:09:37.593Z] Uploading artifact public/logs/localconfig.json from file C:\task_174198094745275\logs\localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2025-06-21T00:06:24.314Z
[taskcluster 2025-03-23T00:09:37.596Z] Uploading artifact public/test_info/resource-usage.json from file C:\task_174198094745275\build\blobber_upload_dir\resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-06-21T00:06:24.314Z
[taskcluster 2025-03-23T00:09:37.599Z] Uploading artifact public/test_info/profile_resource-usage.json from file C:\task_174198094745275\build\blobber_upload_dir\profile_resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-06-21T00:06:24.314Z
[taskcluster 2025-03-23T00:09:37.919Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-06-21T00:06:24.314Z
[taskcluster:error] exit status 2

Hi Greg, seems like this perma failure started from this pushlog but I couldn't quite find the regressor here , could you please take a look or assign this to someone? Thanks.

Flags: needinfo?(gmierz2)

This is likely from bug 1955054. :jmaher/:jmoss, could either of you look into this? It looks like the new pool for win10 is missing the chrome install on them.

Flags: needinfo?(jmoss)
Flags: needinfo?(jmaher)
Flags: needinfo?(gmierz2)
Keywords: regression
Regressed by: 1955054

Set release status flags based on info from the regressing bug 1955054

status-firefox136: --- → unaffected
status-firefox137: --- → affected
status-firefox138: --- → affected
status-firefox-esr128: --- → unaffected

odd this passed on try:
https://treeherder.mozilla.org/jobs?repo=try&tier=1%2C2%2C3&revision=8ae9cf3c3980877c332d5428552063488d476bd0

but what I had avaible was chromium and this is chrome, so something needs to get fixed in taskgraph to allow for finding the correct tasks.

Either way, I see on the old 1803 tasks we set the binary path to: C:\Progra~1\Google\Chrome\Application\chrome.exe

on the new failing tasks, it is set to: C:\Progra~2\Google\Chrome\Application\chrome.exe

I see a couple possibilities;

  1. there are 2 c:\program files (or stuff that matches it, so we got confused)
  2. there is no google chrome installed

I will let jmoss look into this and coordinate with Mark as needed.

Flags: needinfo?(jmaher)

Taking a look at this now. Will report back once resolved.

Flags: needinfo?(jmoss)

Ah, so chromium is from a fetch/toolchain task, but chrome release needs to be pre-installed on the machines - we don't have a fetch/toolchain task for them.

I've updated the worker pools with google chrome. :jmaher or :sparky feel free to try once more on this pool.

Flags: needinfo?(jmaher)
Flags: needinfo?(gmierz2)

jmoss, curious if the chocolatey/puppet work done before would help again here for this and for future chrome updates e.g. https://bugzilla.mozilla.org/show_bug.cgi?id=1876822#c14 - could only find the bugzilla comment, not the github PR that either you or :mcornmesser implemented, but AFAIK the other windows machines are all using it still

Flags: needinfo?(jmoss)

Yes that’s what was implemented here. It was missed in the initial configuration.

Flags: needinfo?(jmoss)

retriggered failing tasks on m-c and they are green. All is well!

Flags: needinfo?(jmaher)
Flags: needinfo?(gmierz2)
Status: NEW → RESOLVED
Closed: 9 months ago
Resolution: --- → FIXED
Flags: needinfo?(jmaher)

(In reply to amarc from comment #13)

Issue popped up again :https://treeherder.mozilla.org/jobs?repo=mozilla-central&duplicate_jobs=visible&group_state=expanded&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception%2Crunnable&searchStr=windows%2C10%2Cx64%2Cwebrender%2Cshippable%2Copt%2Cbrowsertime%2Cperformance%2Ctests%2Con%2Cgoogle%2Cchrome%2Crelease%2Ctest-windows10-64-shippable-qr%2Fopt-browsertime-benchmark-chrome-speedometer3%2Csp3&revision=c38ff1eed18b0b35e46ed77b61d2155e55f08eb1,
Joel, could you please take a look? Thanks.

This is now resolved. We hit a rate limit in downloading Google Chrome from chocolatey. We will be working on making this more resistant to rate limits and other solutions to prevent this in the future.

Assignee: nobody → jmoss
Status: REOPENED → RESOLVED
Closed: 9 months ago → 8 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.