1890465 - Perma [tier 2] Btime-CaR raptor-browsertime Critical: [custom-car] No data to collect | after raptor-browsertime Error: [custom-car] Browsertime failed to run

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=453999892&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FHQdMGY3QkmPKPPEAtG8qQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-04-09T03:51:00.568Z] 03:51:00     INFO - Running command: ['C:\\Users\\task_1712625558\\build\\venv\\Scripts\\python', '--version']
[task 2024-04-09T03:51:00.569Z] 03:51:00     INFO - Copy/paste: C:\Users\task_1712625558\build\venv\Scripts\python --version
[task 2024-04-09T03:51:00.578Z] 03:51:00     INFO -  Python 3.9.5
[task 2024-04-09T03:51:00.580Z] 03:51:00     INFO - Return code: 0
[task 2024-04-09T03:51:00.581Z] 03:51:00     INFO - ENV: MOZ_UPLOAD_DIR is now C:\Users\task_1712625558\build\blobber_upload_dir
[task 2024-04-09T03:51:00.581Z] 03:51:00     INFO - ENV: MINIDUMP_STACKWALK is now C:/Users/task_1712625558/fetches\minidump-stackwalk\minidump-stackwalk.exe
[task 2024-04-09T03:51:00.581Z] 03:51:00     INFO - ENV: MINIDUMP_SAVE_PATH is now C:\Users\task_1712625558\build\blobber_upload_dir
[task 2024-04-09T03:51:00.581Z] 03:51:00     INFO - ENV: RUST_BACKTRACE is now full
[task 2024-04-09T03:51:00.581Z] 03:51:00     INFO - Running command: ['C:\\Users\\task_1712625558\\build\\venv\\Scripts\\python', 'C:\\Users\\task_1712625558\\build\\tests\\raptor\\raptor\\raptor.py', '--extra-profiler-run', '--screenshot-on-failure', '--browsertime-node', 'C:/Users/task_1712625558/fetches/node/node.exe', '--browsertime-browsertimejs', 'C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', 'C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe', '--browsertime-ffmpeg', 'C:/Users/task_1712625558/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe', '--browsertime-geckodriver', 'C:/Users/task_1712625558/fetches/geckodriver.exe', '--browsertime', '--app', 'custom-car', '--binary', 'C:\\Users\\task_1712625558\\fetches\\chromium\\Default\\chrome.exe', '--test', 'motionmark-1-3', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=info'] in C:\Users\task_1712625558\build
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO - Copy/paste: C:\Users\task_1712625558\build\venv\Scripts\python C:\Users\task_1712625558\build\tests\raptor\raptor\raptor.py --extra-profiler-run --screenshot-on-failure --browsertime-node C:/Users/task_1712625558/fetches/node/node.exe --browsertime-browsertimejs C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --browsertime-chromedriver C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe --browsertime-ffmpeg C:/Users/task_1712625558/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe --browsertime-geckodriver C:/Users/task_1712625558/fetches/geckodriver.exe --browsertime --app custom-car --binary C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe --test motionmark-1-3 --symbolsPath https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.crashreporter-symbols.zip --host 127.0.0.1 --log-tbpl-level=info
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO - Using env: {'ALLUSERSPROFILE': 'C:\\ProgramData',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'APPDATA': 'C:\\Users\\task_1712625558\\AppData\\Roaming',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'COMMONPROGRAMFILES': 'C:\\Program Files\\Common Files',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'COMMONPROGRAMFILES(X86)': 'C:\\Program Files (x86)\\Common Files',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'COMMONPROGRAMW6432': 'C:\\Program Files\\Common Files',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'COMPUTERNAME': 'T-W1064-MS-287',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'COMSPEC': 'C:\\windows\\system32\\cmd.exe',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'DRIVERDATA': 'C:\\Windows\\System32\\Drivers\\DriverData',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'EXTERNALTOOLSPATH': 'C:\\Users\\task_1712625558\\mozharness\\external_tools',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'EXTRA_MOZHARNESS_CONFIG': '{"installer_url": '
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.tar.bz2", '
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -                             '"test_packages_url": '
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.test_packages.json"}',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/mozilla-central',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'GECKO_HEAD_REV': '79551503d77c8353439905d86ec3033546f0c874',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'HG_CACHE': 'C:\\tooltool-cache',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'HOMEDRIVE': 'C:',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'HOMEPATH': '\\Users\\task_1712625558',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'LOCALAPPDATA': 'C:\\Users\\task_1712625558\\AppData\\Local',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'LOGONSERVER': '\\\\T-W1064-MS-287',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'MINIDUMP_SAVE_PATH': 'C:\\Users\\task_1712625558\\build\\blobber_upload_dir',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'MINIDUMP_STACKWALK': 'C:/Users/task_1712625558/fetches\\minidump-stackwalk\\minidump-stackwalk.exe',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'MOZILLABUILD': 'C:\\mozilla-build',
[task 2024-04-09T03:51:00.582Z] 03:51:00     INFO -  'MOZ_AUTOMATION': '1',
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -  'MOZ_FETCHES': '[{"artifact": "public/build/browsertime.tar.zst", "extract": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 'true, "task": "IvfU-XkYQq2RqCsZizVpiQ"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/build/car_win64.tar.zst", "extract": true, "task": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"d8Wgua9rS0mn9pg0drejNg"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/build/fix-stacks.tar.zst", "extract": true, "task": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"Nd2tajGIQsis6hV4-ujgCw"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/build/geckodriver.zip", "extract": true, "task": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"anQJcSU6T8e_pO2042yQuQ"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/build/minidump-stackwalk.tar.zst", "extract": true, '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"task": "VxM2o-CCQn6P4SjUsoT5kQ"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/build/node.tar.zst", "extract": true, "task": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"MpCh1RaQSoeAGXSFTnK-TQ"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/chromium-win64.tar.bz2", "extract": true, "task": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"B2ghauoXQNykAUq10YzPUA"}, {"artifact": '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"public/ffmpeg-4.4.1-full_build.zip", "extract": true, '
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -                 '"task": "RzoOp_nhStudFy1SBp0txA"}]',
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -  'MOZ_FETCHES_DIR': 'C:/Users/task_1712625558/fetches',
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -  'MOZ_SCM_LEVEL': '3',
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -  'MOZ_UPLOAD_DIR': 'C:\\Users\\task_1712625558\\build\\blobber_upload_dir',
[task 2024-04-09T03:51:00.583Z] 03:51:00     INFO -  'NUMBER_OF_PROCESSORS': '8',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'ONEDRIVE': 'C:\\Users\\task_1712625558\\OneDrive',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'OS': 'Windows_NT',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PATH': 'C:\\Users\\task_1712625558\\build\\venv\\Scripts;C:\\windows\\system32;C:\\windows;C:\\windows\\System32\\Wbem;C:\\windows\\System32\\WindowsPowerShell\\v1.0\\;C:\\windows\\System32\\OpenSSH\\;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files\\Puppet Labs\\Puppet\\bin;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files\\Mellanox\\MLNX_VPI\\IB\\Tools;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files\\Mellanox\\MLNX_CIMProvider\\lib\\mft;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files\\Git\\cmd;C:\\Program Files (x86)\\GNU\\GnuPG\\pub;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files (x86)\\Windows Kits\\10\\Windows Performance '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Toolkit\\;C:\\Program Files\\Mercurial\\;C:\\Program '
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -          'Files\\Mercurial;C:\\mozilla-build\\bin;C:\\mozilla-build\\kdiff;C:\\mozilla-build\\moztools-x64\\bin;C:\\mozilla-build\\mozmake;C:\\mozilla-build\\nsis-3.01;C:\\mozilla-build\\python;C:\\mozilla-build\\python\\Scripts;C:\\mozilla-build\\python3;C:\\mozilla-build\\msys\\bin;C:\\mozilla-build\\msys\\local\\bin;C:\\Users\\task_1712625558\\AppData\\Local\\Microsoft\\WindowsApps',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PATHEXT': '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PIP_DOWNLOAD_CACHE': 'C:\\pip-cache',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROCESSOR_ARCHITECTURE': 'AMD64',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROCESSOR_IDENTIFIER': 'Intel64 Family 6 Model 94 Stepping 3, GenuineIntel',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROCESSOR_LEVEL': '6',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROCESSOR_REVISION': '5e03',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROGRAMDATA': 'C:\\ProgramData',
[task 2024-04-09T03:51:00.584Z] 03:51:00     INFO -  'PROGRAMFILES': 'C:\\Program Files',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PROGRAMFILES(X86)': 'C:\\Program Files (x86)',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PROGRAMW6432': 'C:\\Program Files',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PROMPT': '$P$G',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PSMODULEPATH': '%ProgramFiles%\\WindowsPowerShell\\Modules;C:\\windows\\system32\\WindowsPowerShell\\v1.0\\Modules;C:\\Program '
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -                  'Files\\Mellanox\\MLNX_VPI\\Tools\\WMI\\Modules;C:\\Program '
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -                  'Files\\Mellanox\\MLNX_CIMProvider\\WMI\\Modules',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PUBLIC': 'C:\\Users\\Public',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PYTHON': 'c:\\mozilla-build\\python3\\python3.exe',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'PYTHONPATH': 'C:\\Users\\task_1712625558\\build\\tests\\raptor',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'REQUIRE_GPU': '0',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'RUST_BACKTRACE': 'full',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'SCCACHE_DISABLE': '1',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'SCRIPTSPATH': 'C:\\Users\\task_1712625558\\mozharness',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'SYSTEMDRIVE': 'C:',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'SYSTEMROOT': 'C:\\windows',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'TASKCLUSTER_PROXY_URL': 'http://localhost:80',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com',
[task 2024-04-09T03:51:00.585Z] 03:51:00     INFO -  'TASK_ID': 'FHQdMGY3QkmPKPPEAtG8qQ',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'TASK_STOP_TIME': '1712628444',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'TEMP': 'C:\\Users\\task_1712625558\\AppData\\Local\\Temp',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'TMP': 'C:\\Users\\task_1712625558\\AppData\\Local\\Temp',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'TOOLTOOL_CACHE': 'C:\\builds\\tooltool_cache',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'USERDOMAIN': 'T-W1064-MS-287',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'USERDOMAIN_ROAMINGPROFILE': 'T-W1064-MS-287',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'USERNAME': 'task_1712625558',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'USERPROFILE': 'C:\\Users\\task_1712625558',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'VIRTUAL_ENV': 'venv',
[task 2024-04-09T03:51:00.586Z] 03:51:00     INFO -  'WINDIR': 'C:\\windows'}
[task 2024-04-09T03:51:00.588Z] 03:51:00     INFO - Calling ['C:\\Users\\task_1712625558\\build\\venv\\Scripts\\python', 'C:\\Users\\task_1712625558\\build\\tests\\raptor\\raptor\\raptor.py', '--extra-profiler-run', '--screenshot-on-failure', '--browsertime-node', 'C:/Users/task_1712625558/fetches/node/node.exe', '--browsertime-browsertimejs', 'C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', 'C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe', '--browsertime-ffmpeg', 'C:/Users/task_1712625558/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe', '--browsertime-geckodriver', 'C:/Users/task_1712625558/fetches/geckodriver.exe', '--browsertime', '--app', 'custom-car', '--binary', 'C:\\Users\\task_1712625558\\fetches\\chromium\\Default\\chrome.exe', '--test', 'motionmark-1-3', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=info'] with output_timeout 3600
[task 2024-04-09T03:51:01.010Z] 03:51:01     INFO -  Fission enabled through browser preferences
[task 2024-04-09T03:51:01.011Z] 03:51:01     INFO -  raptor-main Info: Python version: 3.9.5 (tags/v3.9.5:0a7dcbd, May  3 2021, 17:27:52) [MSC v.1928 64 bit (AMD64)]
[task 2024-04-09T03:51:01.011Z] 03:51:01     INFO -  raptor-main Info: raptor-start
[task 2024-04-09T03:51:01.014Z] 03:51:01     INFO -  raptor-main Info: received command line arguments: Namespace(test='motionmark-1-3', app='custom-car', binary='C:\\Users\\task_1712625558\\fetches\\chromium\\Default\\chrome.exe', activity=None, intent=None, host='127.0.0.1', live_sites=False, chimera=False, is_release_build=False, gecko_profile=False, gecko_profile_interval=None, gecko_profile_entries=None, gecko_profile_extra_threads=[], gecko_profile_threads=None, gecko_profile_features=None, extra_profiler_run=True, symbols_path='https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.crashreporter-symbols.zip', page_cycles=None, page_timeout=None, post_startup_delay=None, browser_cycles=None, project='mozilla-central', test_url_params=None, debug_mode=False, e10s=True, device_name=None, fission=True, fission_mobile=False, extra_prefs={'fission.autostart': True}, environment={}, run_local=False, obj_path=None, mozbuild_path=None, noinstall=False, installerpath=None, disable_perf_tuning=False, conditioned_profile=None, test_bytecode_cache=False, cold=False, browsertime=True, browsertime_user_args=[], browsertime_node='C:/Users/task_1712625558/fetches/node/node.exe', browsertime_browsertimejs='C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', browsertime_vismet_script=None, browsertime_chromedriver='C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe', browsertime_video=False, browsertime_visualmetrics=False, browsertime_no_ffwindowrecorder=False, browsertime_ffmpeg='C:/Users/task_1712625558/fetches/ffmpeg-4.4.1-full_build/bin/ffmpeg.exe', browsertime_geckodriver='C:/Users/task_1712625558/fetches/geckodriver.exe', browsertime_existing_results=None, verbose=False, enable_marionette_trace=False, clean=False, collect_perfstats=False, extra_summary_methods=[], benchmark_repository=None, benchmark_revision=None, benchmark_branch=None, screenshot_on_failure=True, log_raw=None, log_unittest=None, log_xunit=None, log_html=None, log_mach=None, log_tbpl=None, log_grouped=None, log_errorsummary=None, log_raw_level=None, log_mach_verbose=None, log_mach_level=None, log_mach_buffer=None, log_mach_screenshot=None, log_tbpl_compact=None, log_tbpl_level='info', log_tbpl_buffer=None)
[task 2024-04-09T03:51:01.015Z] 03:51:01     INFO -  raptor-manifest Info: C:\Users\task_1712625558\build\tests\raptor\raptor\raptor.toml
[task 2024-04-09T03:51:01.054Z] 03:51:01     INFO -  raptor-manifest Info: configuring settings for test motionmark-1-3
[task 2024-04-09T03:51:01.055Z] 03:51:01     INFO -  raptor-manifest Info: extra-profiler-run enabled
[task 2024-04-09T03:51:01.057Z] 03:51:01     INFO -  raptor-main Info: raptor tests scheduled to run:
[task 2024-04-09T03:51:01.057Z] 03:51:01     INFO -  raptor-main Info: motionmark-1-3
[task 2024-04-09T03:51:01.057Z] 03:51:01     INFO -  raptor-perftest Info: Using an empty profile.
[task 2024-04-09T03:51:01.058Z] 03:51:01     INFO -  raptor-perftest Warning: [custom-car] Failed to get browser meta data through mozversion: LocalAppNotFoundError-Application not found at: C:\Users\task_1712625558\fetches\chromium\Default
[task 2024-04-09T03:51:01.058Z] 03:51:01     INFO -  raptor-perftest Info: Attempting to get version through fallback method...
[task 2024-04-09T03:51:01.174Z] 03:51:01     INFO -  raptor-perftest Info: Browser name: custom-car
[task 2024-04-09T03:51:01.175Z] 03:51:01     INFO -  raptor-perftest Info: Browser version: 125.0.6408.0
[task 2024-04-09T03:51:01.175Z] 03:51:01     INFO -  raptor-perftest Warning: [custom-car] Failed to get browser meta data through mozversion: LocalAppNotFoundError-Application not found at: C:\Users\task_1712625558\fetches\chromium\Default
[task 2024-04-09T03:51:01.176Z] 03:51:01     INFO -  raptor-perftest Info: Attempting to get version through fallback method...
[task 2024-04-09T03:51:01.231Z] 03:51:01     INFO -  raptor-perftest Info: Browser name: custom-car
[task 2024-04-09T03:51:01.231Z] 03:51:01     INFO -  raptor-perftest Info: Browser version: 125.0.6408.0
[task 2024-04-09T03:51:01.232Z] 03:51:01     INFO -  raptor-perftest Info: Post startup delay set to 30000 ms
[task 2024-04-09T03:51:01.234Z] 03:51:01     INFO -  raptor-perftest Info: main raptor init, config is: {'app': 'custom-car', 'binary': 'C:\\Users\\task_1712625558\\fetches\\chromium\\Default\\chrome.exe', 'platform': 'win', 'processor': 'x86_64', 'run_local': False, 'obj_path': None, 'gecko_profile': False, 'gecko_profile_interval': None, 'gecko_profile_entries': None, 'gecko_profile_extra_threads': [], 'gecko_profile_threads': None, 'gecko_profile_features': None, 'extra_profiler_run': True, 'symbols_path': 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AN1yoQ4hR8GjQEmNj2wiCg/artifacts/public/build/target.crashreporter-symbols.zip', 'host': '127.0.0.1', 'cold': False, 'live_sites': False, 'is_release_build': False, 'e10s': True, 'device_name': None, 'fission': True, 'disable_perf_tuning': False, 'conditioned_profile': None, 'test_bytecode_cache': False, 'chimera': False, 'extra_prefs': {'fission.autostart': True}, 'environment': {}, 'project': 'mozilla-central', 'verbose': False, 'extra_summary_methods': [], 'benchmark_repository': None, 'benchmark_revision': None, 'benchmark_branch': None, 'clean': False, 'screenshot_on_failure': True}
[task 2024-04-09T03:51:01.235Z] 03:51:01     INFO -  raptor-browsertime Info: cwd: 'C:\Users\task_1712625558\build'
[task 2024-04-09T03:51:01.235Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_node: C:/Users/task_1712625558/fetches/node/node.exe
[task 2024-04-09T03:51:01.236Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_node: os.stat_result(st_mode=33279, st_ino=30117822508200363, st_dev=4138544531, st_nlink=1, st_uid=0, st_gid=0, st_size=70768280, st_atime=1701264722, st_mtime=1701264722, st_ctime=1712634407)
[task 2024-04-09T03:51:01.236Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_browsertimejs: C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js
[task 2024-04-09T03:51:01.237Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_browsertimejs: os.stat_result(st_mode=33206, st_ino=67272519434012867, st_dev=4138544531, st_nlink=1, st_uid=0, st_gid=0, st_size=7301, st_atime=1712603674, st_mtime=1712603674, st_ctime=1712634414)
[task 2024-04-09T03:51:01.237Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_geckodriver: C:/Users/task_1712625558/fetches/geckodriver.exe
[task 2024-04-09T03:51:01.238Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_geckodriver: os.stat_result(st_mode=33279, st_ino=30117822508200360, st_dev=4138544531, st_nlink=1, st_uid=0, st_gid=0, st_size=4365312, st_atime=1712202697, st_mtime=1712202697, st_ctime=1712634407)
[task 2024-04-09T03:51:01.239Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_chromedriver: C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe
[task 2024-04-09T03:51:01.239Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_chromedriver: os.stat_result(st_mode=33279, st_ino=32369622321893123, st_dev=4138544531, st_nlink=1, st_uid=0, st_gid=0, st_size=13986816, st_atime=1704969270, st_mtime=1704969270, st_ctime=1712634430)
[task 2024-04-09T03:51:01.240Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_user_args: []
[task 2024-04-09T03:51:01.240Z] 03:51:01     INFO -  raptor-browsertime Info: browsertime_user_args: stat: path should be string, bytes, os.PathLike or integer, not list
[task 2024-04-09T03:51:01.240Z] 03:51:01     INFO -  raptor-perftest Info: starting test: motionmark-1-3
[task 2024-04-09T03:51:01.257Z] 03:51:01     INFO -  raptor-benchmark Info: Cloning the benchmarks to C:\Users\task_1712625558\AppData\Local\Temp\tmpg3ckw6r4\performance-tests\motionmark
[task 2024-04-09T03:51:01.295Z] 03:51:01     INFO -  Cloning into 'C:\Users\task_1712625558\AppData\Local\Temp\tmpg3ckw6r4\performance-tests\motionmark'...
[task 2024-04-09T03:51:02.387Z] 03:51:02     INFO -  5d9c88136d59c11daf78d539c73e4e3e88c091ab
[task 2024-04-09T03:51:02.393Z] 03:51:02     INFO -  raptor-benchmark Info: Given benchmark repository revision verified
[task 2024-04-09T03:51:02.437Z] 03:51:02     INFO -  Note: switching to '5d9c88136d59c11daf78d539c73e4e3e88c091ab'.
[task 2024-04-09T03:51:02.437Z] 03:51:02     INFO -  You are in 'detached HEAD' state. You can look around, make experimental
[task 2024-04-09T03:51:02.438Z] 03:51:02     INFO -  changes and commit them, and you can discard any commits you make in this
[task 2024-04-09T03:51:02.438Z] 03:51:02     INFO -  state without impacting any branches by switching back to a branch.
[task 2024-04-09T03:51:02.438Z] 03:51:02     INFO -  If you want to create a new branch to retain commits you create, you may
[task 2024-04-09T03:51:02.438Z] 03:51:02     INFO -  do so (now or later) by using -c with the switch command. Example:
[task 2024-04-09T03:51:02.439Z] 03:51:02     INFO -    git switch -c <new-branch-name>
[task 2024-04-09T03:51:02.439Z] 03:51:02     INFO -  Or undo this operation with:
[task 2024-04-09T03:51:02.439Z] 03:51:02     INFO -    git switch -
[task 2024-04-09T03:51:02.440Z] 03:51:02     INFO -  Turn off this advice by setting config variable advice.detachedHead to false
[task 2024-04-09T03:51:02.440Z] 03:51:02     INFO -  HEAD is now at 5d9c881 Add more changes to the 1.3 change list in the about page
[task 2024-04-09T03:51:02.525Z] 03:51:02     INFO -  raptor-benchmark Info: bench_dir: C:\Users\task_1712625558\build\tests\raptor\raptor\tests\webkit\PerformanceTests\motionmark-1-3\motionmark
[task 2024-04-09T03:51:02.525Z] 03:51:02     INFO -  raptor-benchmark Info: bench_dir contains:
[task 2024-04-09T03:51:02.526Z] 03:51:02     INFO -  raptor-benchmark Info: [WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/.git'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/.gitignore'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/Governance.md'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/index.html'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/LICENSE'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/MotionMark'), WindowsPath('C:/Users/task_1712625558/build/tests/raptor/raptor/tests/webkit/PerformanceTests/motionmark-1-3/motionmark/README.md')]
[task 2024-04-09T03:51:02.527Z] 03:51:02     INFO -  raptor-benchmark Info: starting webserver on '127.0.0.1:49890'
[task 2024-04-09T03:51:02.527Z] 03:51:02     INFO -  raptor-benchmark Info: serving benchmarks from here: C:\Users\task_1712625558\build\tests\raptor\raptor\tests\webkit\PerformanceTests\motionmark-1-3\motionmark
[task 2024-04-09T03:51:02.532Z] 03:51:02     INFO -  raptor-browsertime Info: test: {'here': 'C:\\Users\\task_1712625558\\build\\tests\\raptor\\raptor\\tests\\benchmarks', 'alert_threshold': '2.0', 'apps': 'firefox, chrome, safari, custom-car', 'gecko_profile_interval': '1', 'gecko_profile_features': 'stackwalk,js,cpu,java,processcpu', 'gecko_profile_threads': 'GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate', 'expose_browser_profiler': True, 'expose_chrome_trace': 'true', 'lower_is_better': False, 'page_cycles': 1, 'page_timeout': '600000', 'support_class': <motionmark-1-3.py.MotionMarkSupport object at 0x0000016D2BC23400>, 'test_script': 'motionmark-1-3.js', 'owner': 'Graphics Team', 'type': 'benchmark', 'unit': 'score', 'repository': 'https://github.com/webkit/motionmark', 'repository_revision': '5d9c88136d59c11daf78d539c73e4e3e88c091ab', 'test_url': 'http://127.0.0.1:49890/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance', 'cold': True, 'browser_cycles': '1', 'host_from_parent': False, 'suite_name': 'MotionMark', 'name': 'motionmark-1-3', 'manifest': 'C:\\Users\\task_1712625558\\build\\tests\\raptor\\raptor\\tests\\benchmarks\\motionmark-1-3-desktop.toml', 'manifest_relpath': 'tests\\benchmarks\\motionmark-1-3-desktop.toml', 'path': 'C:\\Users\\task_1712625558\\build\\tests\\raptor\\raptor\\tests\\benchmarks\\motionmark-1-3', 'relpath': 'tests\\benchmarks\\motionmark-1-3', 'ancestor_manifest': 'raptor.toml', 'expected': 'pass', 'extra_profiler_run': True, 'extra_profiler_run_browser_cycles': 1, 'extra_profiler_run_page_cycles': 1, 'expected_browser_cycles': 1, 'browser_cycle': 1}
[task 2024-04-09T03:51:02.532Z] 03:51:02     INFO -  raptor-browsertime-desktop Info: binary_path: C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe
[task 2024-04-09T03:51:02.533Z] 03:51:02     INFO -  raptor-browsertime Info: Test support class is modifying the command...
[task 2024-04-09T03:51:02.533Z] 03:51:02     INFO -  raptor-browsertime Info: timeout (s): 600000
[task 2024-04-09T03:51:02.533Z] 03:51:02     INFO -  raptor-browsertime Info: browsertime cwd: C:\Users\task_1712625558\build
[task 2024-04-09T03:51:02.536Z] 03:51:02     INFO -  raptor-browsertime Info: browsertime cmd: C:/Users/task_1712625558/fetches/node/node.exe C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --firefox.geckodriverPath C:/Users/task_1712625558/fetches/geckodriver.exe --chrome.chromedriverPath C:/Users/task_1712625558/fetches/chrome-win/chromedriver.exe C:\Users\task_1712625558\build\tests\raptor\raptor\browsertime\..\..\browsertime\motionmark-1-3.js --firefox.noDefaultPrefs --browsertime.page_cycle_delay 1000 --skipHar --pageLoadStrategy none --webdriverPageload true --firefox.disableBrowsertimeExtension true --pageCompleteCheckStartWait 5000 --pageCompleteCheckPollTimeout 1000 --beforePageCompleteWaitTime 2000 --timeouts.pageLoad 600000 --timeouts.script 600000 --browsertime.page_cycles 1 --pageCompleteWaitTime 5000 --browsertime.url http://127.0.0.1:49890/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance --browsertime.post_startup_delay 30000 --iterations 1 --browsertime.chimera false --browsertime.test_bytecode_cache false --firefox.perfStats false --browsertime.moz_fetch_dir C:/Users/task_1712625558/fetches --browsertime.expose_profiler false --browsertime.commands  --viewPort 1280x1024 --browser chrome --chrome.binaryPath C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe --chrome.args=--use-mock-keychain --chrome.args=--no-default-browser-check --chrome.args=--no-first-run --chrome.args=--no-experiments --chrome.args=--disable-site-isolation-trials --chrome.args=--enable-benchmarking --resultDir C:\Users\task_1712625558\build\blobber_upload_dir\browsertime-results\motionmark-1-3 --video false --visualMetrics false --browsertime.suite_name MotionMark
[task 2024-04-09T03:51:02.538Z] 03:51:02     INFO -  raptor-browsertime Info: PATH: C:\Users\task_1712625558\build\venv\Scripts;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\windows\System32\OpenSSH\;C:\Program Files\Puppet Labs\Puppet\bin;C:\Program Files\Mellanox\MLNX_VPI\IB\Tools;C:\Program Files\Mellanox\MLNX_CIMProvider\lib\mft;C:\Program Files\Git\cmd;C:\Program Files (x86)\GNU\GnuPG\pub;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\;C:\Program Files\Mercurial\;C:\Program Files\Mercurial;C:\mozilla-build\bin;C:\mozilla-build\kdiff;C:\mozilla-build\moztools-x64\bin;C:\mozilla-build\mozmake;C:\mozilla-build\nsis-3.01;C:\mozilla-build\python;C:\mozilla-build\python\Scripts;C:\mozilla-build\python3;C:\mozilla-build\msys\bin;C:\mozilla-build\msys\local\bin;C:\Users\task_1712625558\AppData\Local\Microsoft\WindowsApps
[task 2024-04-09T03:51:02.539Z] 03:51:02     INFO -  raptor-browsertime Info: Calling browsertime with proc_timeout=650, and output_timeout=None
[task 2024-04-09T03:51:03.303Z] 03:51:03     INFO -  raptor-browsertime Info: Running tests using Chrome - 1 iteration(s)
[task 2024-04-09T03:51:04.757Z] 03:51:04     INFO -  raptor-browsertime Info: chrome failed to start, trying 2 more time(s): session not created: Chrome failed to start: was killed.
[task 2024-04-09T03:51:04.757Z] 03:51:04     INFO -  raptor-browsertime Info:   (chrome not reachable)
[task 2024-04-09T03:51:04.757Z] 03:51:04     INFO -  raptor-browsertime Info:   (The process started from chrome location C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
[task 2024-04-09T03:51:06.438Z] 03:51:06     INFO -  raptor-browsertime Info: chrome failed to start, trying 1 more time(s): session not created: Chrome failed to start: was killed.
[task 2024-04-09T03:51:06.439Z] 03:51:06     INFO -  raptor-browsertime Info:   (chrome not reachable)
[task 2024-04-09T03:51:06.439Z] 03:51:06     INFO -  raptor-browsertime Info:   (The process started from chrome location C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
[task 2024-04-09T03:51:08.127Z] 03:51:08     INFO -  raptor-browsertime Info: chrome failed to start, trying 0 more time(s): session not created: Chrome failed to start: was killed.
[task 2024-04-09T03:51:08.127Z] 03:51:08     INFO -  raptor-browsertime Info:   (chrome not reachable)
[task 2024-04-09T03:51:08.128Z] 03:51:08     INFO -  raptor-browsertime Info:   (The process started from chrome location C:\Users\task_1712625558\fetches\chromium\Default\chrome.exe is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
[task 2024-04-09T03:51:08.128Z] 03:51:08    ERROR -  raptor-browsertime Error: [custom-car] Browsertime failed to run
[task 2024-04-09T03:51:08.129Z] 03:51:08     INFO -  raptor-browsertime Info:     at SeleniumRunner.start (file:///C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/lib/core/seleniumRunner.js:101:13)
[task 2024-04-09T03:51:08.129Z] 03:51:08     INFO -  raptor-browsertime Info:     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[task 2024-04-09T03:51:08.130Z] 03:51:08     INFO -  raptor-browsertime Info:     at async Iteration.run (file:///C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/lib/core/engine/iteration.js:94:7)
[task 2024-04-09T03:51:08.130Z] 03:51:08     INFO -  raptor-browsertime Info:     at async Engine.runByScript (file:///C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/lib/core/engine/index.js:308:20)
[task 2024-04-09T03:51:08.131Z] 03:51:08     INFO -  raptor-browsertime Info:     at async run (file:///C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js:104:22)
[task 2024-04-09T03:51:08.131Z] 03:51:08     INFO -  raptor-browsertime Info:     at async file:///C:/Users/task_1712625558/fetches/browsertime/node_modules/browsertime/bin/browsertime.js:223:1
[task 2024-04-09T03:51:08.132Z] 03:51:08    ERROR -  raptor-browsertime Error: [custom-car] Browsertime failed to run
[task 2024-04-09T03:51:08.132Z] 03:51:08 CRITICAL -  raptor-browsertime Critical: [custom-car] No data to collect
[task 2024-04-09T03:51:08.536Z] 03:51:08    ERROR -  Traceback (most recent call last):
[task 2024-04-09T03:51:08.537Z] 03:51:08     INFO -    File "C:\Users\task_1712625558\build\tests\raptor\raptor\raptor.py", line 188, in <module>
[task 2024-04-09T03:51:08.537Z] 03:51:08     INFO -      main()
[task 2024-04-09T03:51:08.537Z] 03:51:08     INFO -    File "C:\Users\task_1712625558\build\tests\raptor\raptor\raptor.py", line 137, in main
[task 2024-04-09T03:51:08.538Z] 03:51:08     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2024-04-09T03:51:08.538Z] 03:51:08     INFO -    File "C:\Users\task_1712625558\build\tests\raptor\raptor\perftest.py", line 499, in run_tests
[task 2024-04-09T03:51:08.539Z] 03:51:08     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2024-04-09T03:51:08.539Z] 03:51:08     INFO -    File "C:\Users\task_1712625558\build\tests\raptor\raptor\browsertime\base.py", line 1051, in run_test
[task 2024-04-09T03:51:08.540Z] 03:51:08     INFO -      raise Exception(self.browsertime_failure)
[task 2024-04-09T03:51:08.540Z] 03:51:08     INFO -  Exception: No data to collect
[task 2024-04-09T03:51:08.574Z] 03:51:08     INFO - Return code: 1
[task 2024-04-09T03:51:08.575Z] 03:51:08  WARNING - setting return code to 1
[task 2024-04-09T03:51:08.575Z] 03:51:08     INFO - Copying Raptor results to upload dir:
[task 2024-04-09T03:51:08.575Z] 03:51:08     INFO - C:\Users\task_1712625558\build\blobber_upload_dir\perfherder-data.json
[task 2024-04-09T03:51:08.575Z] 03:51:08     INFO - Copying raptor results from C:\Users\task_1712625558\build\raptor.json to C:\Users\task_1712625558\build\blobber_upload_dir\perfherder-data.json
[task 2024-04-09T03:51:08.575Z] 03:51:08 CRITICAL - Error copying results C:\Users\task_1712625558\build\raptor.json to upload dir C:\Users\task_1712625558\build\blobber_upload_dir\perfherder-data.json
[task 2024-04-09T03:51:08.575Z] 03:51:08     INFO - [Errno 2] No such file or directory: 'C:\\Users\\task_1712625558\\build\\raptor.json'
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - Running post-action listener: _package_coverage_data
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - Running post-action listener: _resource_record_post_action
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - Running post-action listener: process_java_coverage_data
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - Running post-action listener: stop_device
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - [mozharness: 2024-04-09 03:51:08.576430Z] Finished run-tests step (success)
[task 2024-04-09T03:51:08.576Z] 03:51:08     INFO - Running post-run listener: _resource_record_post_run
[task 2024-04-09T03:51:08.656Z] 03:51:08     INFO - Total resource usage - Wall time: 11s; CPU: 8%; Read bytes: 9662976; Write bytes: 27545600; Read time: 0; Write time: 2
[task 2024-04-09T03:51:08.656Z] 03:51:08     INFO - TinderboxPrint: CPU usage<br/>7.7%
[task 2024-04-09T03:51:08.656Z] 03:51:08     INFO - TinderboxPrint: I/O read bytes / time<br/>9,662,976 / 0
[task 2024-04-09T03:51:08.657Z] 03:51:08     INFO - TinderboxPrint: I/O write bytes / time<br/>27,545,600 / 2
[task 2024-04-09T03:51:08.657Z] 03:51:08     INFO - TinderboxPrint: CPU idle<br/>79.2 (92.3%)
[task 2024-04-09T03:51:08.657Z] 03:51:08     INFO - TinderboxPrint: CPU system<br/>3.3 (3.9%)
[task 2024-04-09T03:51:08.657Z] 03:51:08     INFO - TinderboxPrint: CPU user<br/>3.2 (3.8%)
[task 2024-04-09T03:51:08.657Z] 03:51:08     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-09T03:51:08.658Z] 03:51:08     INFO - run-tests - Wall time: 11s; CPU: 8%; Read bytes: 9662976; Write bytes: 27545600; Read time: 0; Write time: 2
[task 2024-04-09T03:51:08.694Z] 03:51:08  WARNING - returning nonzero exit status 1
[taskcluster 2024-04-09T03:51:08.731Z]    Exit Code: 1
[taskcluster 2024-04-09T03:51:08.731Z]    User Time: 0s
[taskcluster 2024-04-09T03:51:08.731Z]  Kernel Time: 31.25ms
[taskcluster 2024-04-09T03:51:08.731Z]    Wall Time: 4m21.5810141s
[taskcluster 2024-04-09T03:51:08.731Z]       Result: FAILED
[taskcluster 2024-04-09T03:51:08.731Z] === Task Finished ===
[taskcluster 2024-04-09T03:51:08.731Z] Task Duration: 4m21.5810141s
[taskcluster 2024-04-09T03:51:08.829Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-07-08T01:02:58.104Z
[taskcluster 2024-04-09T03:51:09.158Z] Uploading artifact public/test_info/profile_resource-usage.json from file build\blobber_upload_dir\profile_resource-usage.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-07-08T01:02:58.104Z
[taskcluster 2024-04-09T03:51:09.434Z] Uploading artifact public/test_info/resource-usage.json from file build\blobber_upload_dir\resource-usage.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-07-08T01:02:58.104Z
[taskcluster 2024-04-09T03:51:09.711Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FHQdMGY3QkmPKPPEAtG8qQ/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2024-07-08T01:02:58.104Z
[taskcluster:error] exit status 1

Comment 1

[Intermittent Failures Robot]

16 failures in 678 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 16

Platform and build breakdown:

• windows10-64-shippable-qr: 10
  • opt: 10
• linux1804-64-shippable-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-04-08&endday=2024-04-08&tree=all

Comment 2

[Kash Shampur [:kshampur] ⌚EST]

looking into it

Comment 3

[Kash Shampur [:kshampur] ⌚EST]

I think i found the issue. I checked the osx-arm one and it seems to be fetching an old chromium fetch.

From this task :https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=m-car&revision=79551503d77c8353439905d86ec3033546f0c874&selectedTaskRun=Mzi_-ssoTdWlIC_fHkB9qA.0

i checked the fetches used
https://firefox-ci-tc.services.mozilla.com/tasks/Mzi_-ssoTdWlIC_fHkB9qA
seems to be fetching a chromium from january 11th?
https://firefox-ci-tc.services.mozilla.com/tasks/KMsceKVPSV-NJS4zhbOwHQ/runs/0/logs/public/logs/live.log
(however the chromium app in that fetch is version 125)
(edit: it was 125 because of auto update i think, i realize during extraction it is also 122 like the chrome driver)

I downloaded the car-arm build and the associated chromedriver. CaR is version 125.xxx and the chromedriver is apparently 122.xxx?

Comment 4

[Kash Shampur [:kshampur] ⌚EST]

nevermind, I tried using a chromedriver with matching version (125) but that did not seem to help.

Comment 5

[Kash Shampur [:kshampur] ⌚EST]

I tried this older revision which was running https://treeherder.mozilla.org/jobs?repo=mozilla-central&selectedTaskRun=F3G0BIeRQPqazaAf0CnnWQ.0&tier=1%2C2%2C3&searchStr=m-car&revision=c59be65c8118a8e4c60719162c4426e511ee042c

That also has a mismatch of an old chromium

However this chromium (125) works with a chromedriver of 122.
No idea, but maybe chromedriver can work with chromium within a range of the sem.ver?

Anyway I've tried using a up to date 125 chromedriver with the failing CaR builds but it is failing for me locally. Eitherway, this out of sync chromium fetch is still an issue that needs to be fixed

Comment 6

[Kash Shampur [:kshampur] ⌚EST]

also worth mentioning this seems to have happened between this revision https://chromium.googlesource.com/chromium/src/+/08a3395b275d33b8b3aa46630748c0e5172829c9 and https://chromium.googlesource.com/chromium/src/+/7d3ac31406761ec9632a0f848f8f15f01eb71b71

that is a fairly large gap

Comment 7

[Kash Shampur [:kshampur] ⌚EST]

tasks seem to be passing https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=m-car&revision=34fef7e7706b912024aa3ba8826647e5ddc0a0ab

but sp3 seems to be failing as mentioned https://bugzilla.mozilla.org/show_bug.cgi?id=1890465#a110127_573381

Comment 8

[Kash Shampur [:kshampur] ⌚EST]

(In reply to Kash Shampur [:kshampur] ⌚EST from comment #7)

tasks seem to be passing https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=m-car&revision=34fef7e7706b912024aa3ba8826647e5ddc0a0ab

but sp3 seems to be failing as mentioned https://bugzilla.mozilla.org/show_bug.cgi?id=1890465#a110127_573381

https://bugzilla.mozilla.org/show_bug.cgi?id=1890740#c3

Comment 9

[Intermittent Failures Robot]

53 failures in 3235 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 53

Platform and build breakdown:

• windows10-64-shippable-qr: 14
  • opt: 14
• linux1804-64-shippable-qr: 15
  • opt: 15
• macosx1015-64-shippable-qr: 13
  • opt: 13
• macosx1400-64-shippable-qr: 11
  • opt: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-04-08&endday=2024-04-14&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 4252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• macosx1400-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-04-15&endday=2024-04-21&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 3649 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-05-06&endday=2024-05-12&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 4547 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-05-13&endday=2024-05-19&tree=all

Comment 13

[Intermittent Failures Robot]

28 failures in 4202 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 28

Platform and build breakdown:

• macosx1400-64-shippable-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 24
  • opt: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 14

[Kash Shampur [:kshampur] ⌚EST]

This time, there seems to be an issue with the chrome driver on intel mac

e.g.

[task 2024-06-03T16:10:25.156Z] 16:10:25     INFO -  raptor-browsertime Info: chrome failed to start, trying 2 more time(s): Failed to start chrome in 60 seconds.
[task 2024-06-03T16:11:25.270Z] 16:11:25     INFO -  raptor-browsertime Info: chrome failed to start, trying 1 more time(s): Failed to start chrome in 60 seconds.
[task 2024-06-03T16:12:25.347Z] 16:12:25     INFO -  raptor-browsertime Info: chrome failed to start, trying 0 more time(s): Failed to start chrome in 60 seconds.

This will likely resolve itself in a couple days
Potentially Bug 1900408 could be a long term solution

Comment 15

[Intermittent Failures Robot]

25 failures in 3649 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 25

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 24
  • opt: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-06-03&endday=2024-06-09&tree=all

Comment 16

[Intermittent Failures Robot]

3 failures in 4625 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• macosx1400-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-06-10&endday=2024-06-16&tree=all

Comment 17

[Intermittent Failures Robot]

3 failures in 3199 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• macosx1400-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-07-01&endday=2024-07-07&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 3780 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-07-08&endday=2024-07-14&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures in 3799 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-07-15&endday=2024-07-21&tree=all

Comment 20

[Kash Shampur [:kshampur] ⌚EST]

Might be perma failing on OSX
https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=m-car%2C10.15&revision=439d6b4d683a58fd52fc40427f2980ddfdf99b27&selectedTaskRun=ELnuzFYCQ6OFOCzpzehFKQ.0

Comment 21

[Kash Shampur [:kshampur] ⌚EST]

(In reply to Kash Shampur [:kshampur] ⌚EST from comment #20)

Might be perma failing on OSX
https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=m-car%2C10.15&revision=439d6b4d683a58fd52fc40427f2980ddfdf99b27&selectedTaskRun=ELnuzFYCQ6OFOCzpzehFKQ.0

looks like a mismatch of chromedriver version. CaR version was update to 129, but at the time the CfTdriver was fetched, it was behind 1 version.
I will keep ni? to see why it was mismatched e.g. perhaps did CfT dashboard not update in time? Were there 404 links previously? or was the toolchain stale (but shouldn't be since it is not cached)?

Either way this perma should be resolved by today by itself as the correct driver version should be fetched going forward

Comment 22

[Kash Shampur [:kshampur] ⌚EST]

further thoughts - maybe it is not an issue with the mismatched version, because of this https://github.com/sitespeedio/browsertime/blob/315dde3c8d1453863e3061fe1943dfc1d7378b43/lib/chrome/webdriver/builder.js#L26 / https://bugzilla.mozilla.org/show_bug.cgi?id=1891149

and I see from the same push other platforms didn't have an issue. so I take back my comment about this resolving itself - will keep looking into it.

One thing I am thinking is, maybe the canary build chromedrivers are just less stable even if the links show in green. We could consider using the dev channel, even though the version is a bit behind, thanks to the flag in browsertime it shouldn't be an issue...

Comment 23

[Intermittent Failures Robot]

14 failures in 4124 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14

Platform and build breakdown:

• macosx1015-64-shippable-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-07-22&endday=2024-07-28&tree=all

Comment 24

[Kash Shampur [:kshampur] ⌚EST]

Based on this https://bugzilla.mozilla.org/show_bug.cgi?id=1858740#c15
It seems the chromedriver issue is no longer a problem. Will clear ni? after the changes are deployed to the L3 pool and this is back running on CI

Comment 25

[Kash Shampur [:kshampur] ⌚EST]

Good now after Bug 1858740

Comment 26

[Intermittent Failures Robot]

2 failures in 2154 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• macosx1400-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-08-12&endday=2024-08-18&tree=all

Comment 27

[Intermittent Failures Robot]

5 failures in 3879 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform and build breakdown:

• windows11-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1890465&startday=2024-08-26&endday=2024-09-01&tree=all

Comment 28

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.