Closed Bug 1915455 Opened 1 year ago Closed 1 year ago

Perma [tier 2] results.MissingResultsError: Browsertime cycle missing ['largestContentfulPaint', 'renderTime'] measurement

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Type:
defect

Tracking

(firefox-esr115 unaffected, firefox-esr128 unaffected, firefox129 unaffected, firefox130 unaffected, firefox131 fixed)

Status:
RESOLVED FIXED
Milestone:
131 Branch
Tracking Flags:
Tracking Status
firefox-esr115 --- unaffected
firefox-esr128 --- unaffected
firefox129 --- unaffected
firefox130 --- unaffected
firefox131 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: sparky)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Bug 1915455 - Don't use pageload support script for constant-regression test. r?#perftest,kshampur
48 bytes, text/x-phabricator-request
Details | Review

Filed by: tszentpeteri [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=472114956&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KpV3YJnhTVKUO__QjayxvQ/runs/0/artifacts/public/logs/live_backing.log

[task 2024-08-28T17:54:48.870Z] 17:54:48     INFO - Calling ['/home/cltbld/tasks/task_172486760589151/build/venv/bin/python', '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/raptor.py', '--screenshot-on-failure', '--browsertime-node', '/home/cltbld/tasks/task_172486760589151/fetches/node/bin/node', '--browsertime-browsertimejs', '/home/cltbld/tasks/task_172486760589151/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', '/home/cltbld/tasks/task_172486760589151/fetches/{}chromedriver', '--browsertime-ffmpeg', '/home/cltbld/tasks/task_172486760589151/fetches/ffmpeg-4.4.1-i686-static/ffmpeg', '--browsertime-geckodriver', '/home/cltbld/tasks/task_172486760589151/fetches/geckodriver', '--browsertime', '--app', 'firefox', '--binary', '/home/cltbld/tasks/task_172486760589151/build/application/firefox/firefox', '--test', 'constant-regression', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NwGgzEG1Qj2UPcgTDSbU7Q/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=info'] with output_timeout 3600
[task 2024-08-28T17:54:49.431Z] 17:54:49     INFO -  Fission enabled through browser preferences
[task 2024-08-28T17:54:49.431Z] 17:54:49     INFO -  raptor-main Info: Python version: 3.9.15 (main, Oct 12 2022, 19:15:11)
[task 2024-08-28T17:54:49.431Z] 17:54:49     INFO -  [GCC 7.5.0]
[task 2024-08-28T17:54:49.431Z] 17:54:49     INFO -  raptor-main Info: raptor-start
[task 2024-08-28T17:54:49.435Z] 17:54:49     INFO -  raptor-main Info: received command line arguments: Namespace(test='constant-regression', app='firefox', binary='/home/cltbld/tasks/task_172486760589151/build/application/firefox/firefox', activity=None, intent=None, host='127.0.0.1', live_sites=False, chimera=False, is_release_build=False, gecko_profile=False, gecko_profile_interval=None, gecko_profile_entries=None, gecko_profile_extra_threads=[], gecko_profile_threads=None, gecko_profile_features=None, extra_profiler_run=False, symbols_path='https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NwGgzEG1Qj2UPcgTDSbU7Q/artifacts/public/build/target.crashreporter-symbols.zip', page_cycles=None, page_timeout=None, post_startup_delay=None, browser_cycles=None, project='mozilla-central', test_url_params=None, debug_mode=False, e10s=True, device_name=None, fission=True, fission_mobile=False, extra_prefs={'fission.autostart': True}, environment={}, run_local=False, obj_path=None, mozbuild_path=None, no_install=False, installerpath=None, disable_perf_tuning=False, conditioned_profile=None, test_bytecode_cache=False, cold=False, browsertime=True, browsertime_user_args=[], browsertime_node='/home/cltbld/tasks/task_172486760589151/fetches/node/bin/node', browsertime_browsertimejs='/home/cltbld/tasks/task_172486760589151/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', browsertime_vismet_script=None, browsertime_chromedriver='/home/cltbld/tasks/task_172486760589151/fetches/{}chromedriver', browsertime_video=False, browsertime_visualmetrics=False, browsertime_no_ffwindowrecorder=False, browsertime_ffmpeg='/home/cltbld/tasks/task_172486760589151/fetches/ffmpeg-4.4.1-i686-static/ffmpeg', browsertime_geckodriver='/home/cltbld/tasks/task_172486760589151/fetches/geckodriver', browsertime_existing_results=None, verbose=False, enable_marionette_trace=False, clean=False, collect_perfstats=False, extra_summary_methods=[], benchmark_repository=None, benchmark_revision=None, benchmark_branch=None, screenshot_on_failure=True, power_test=False, log_raw=None, log_unittest=None, log_xunit=None, log_html=None, log_mach=None, log_tbpl=None, log_grouped=None, log_errorsummary=None, log_raw_level=None, log_mach_verbose=None, log_mach_level=None, log_mach_buffer=None, log_mach_screenshot=None, log_tbpl_compact=None, log_tbpl_level='info', log_tbpl_buffer=None)
[task 2024-08-28T17:54:49.435Z] 17:54:49     INFO -  raptor-manifest Info: /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/raptor.toml
[task 2024-08-28T17:54:49.527Z] 17:54:49     INFO -  raptor-manifest Info: configuring settings for test constant-regression
[task 2024-08-28T17:54:49.527Z] 17:54:49     INFO -  raptor-manifest Info: using live sites so turning playback off!
[task 2024-08-28T17:54:49.527Z] 17:54:49     INFO -  raptor-manifest Info: using live sites so using page timeout of 2160000ms
[task 2024-08-28T17:54:49.529Z] 17:54:49     INFO -  raptor-main Info: raptor tests scheduled to run:
[task 2024-08-28T17:54:49.530Z] 17:54:49     INFO -  raptor-main Info: constant-regression
[task 2024-08-28T17:54:49.530Z] 17:54:49     INFO -  raptor-perftest Info: Using an empty profile.
[task 2024-08-28T17:54:49.531Z] 17:54:49     INFO -  mozversion application_buildid: 20240828170113
[task 2024-08-28T17:54:49.531Z] 17:54:49     INFO -  mozversion application_changeset: a0862a16be6bc785a2baccebfa4627be2016bd0f
[task 2024-08-28T17:54:49.531Z] 17:54:49     INFO -  mozversion application_display_name: Firefox Nightly
[task 2024-08-28T17:54:49.532Z] 17:54:49     INFO -  mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
[task 2024-08-28T17:54:49.532Z] 17:54:49     INFO -  mozversion application_name: Firefox
[task 2024-08-28T17:54:49.532Z] 17:54:49     INFO -  mozversion application_remotingname: firefox-default
[task 2024-08-28T17:54:49.532Z] 17:54:49     INFO -  mozversion application_repository: https://hg.mozilla.org/integration/autoland
[task 2024-08-28T17:54:49.533Z] 17:54:49     INFO -  mozversion application_vendor: Mozilla
[task 2024-08-28T17:54:49.533Z] 17:54:49     INFO -  mozversion application_version: 131.0a1
[task 2024-08-28T17:54:49.533Z] 17:54:49     INFO -  mozversion platform_buildid: 20240828170113
[task 2024-08-28T17:54:49.533Z] 17:54:49     INFO -  mozversion platform_changeset: a0862a16be6bc785a2baccebfa4627be2016bd0f
[task 2024-08-28T17:54:49.533Z] 17:54:49     INFO -  mozversion platform_repository: https://hg.mozilla.org/integration/autoland
[task 2024-08-28T17:54:49.534Z] 17:54:49     INFO -  mozversion platform_version: 131.0a1
[task 2024-08-28T17:54:49.534Z] 17:54:49     INFO -  raptor-perftest Info: Browser name: Firefox
[task 2024-08-28T17:54:49.534Z] 17:54:49     INFO -  raptor-perftest Info: Browser version: 131.0a1
[task 2024-08-28T17:54:49.534Z] 17:54:49     INFO -  mozversion application_buildid: 20240828170113
[task 2024-08-28T17:54:49.534Z] 17:54:49     INFO -  mozversion application_changeset: a0862a16be6bc785a2baccebfa4627be2016bd0f
[task 2024-08-28T17:54:49.535Z] 17:54:49     INFO -  mozversion application_display_name: Firefox Nightly
[task 2024-08-28T17:54:49.535Z] 17:54:49     INFO -  mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
[task 2024-08-28T17:54:49.535Z] 17:54:49     INFO -  mozversion application_name: Firefox
[task 2024-08-28T17:54:49.535Z] 17:54:49     INFO -  mozversion application_remotingname: firefox-default
[task 2024-08-28T17:54:49.535Z] 17:54:49     INFO -  mozversion application_repository: https://hg.mozilla.org/integration/autoland
[task 2024-08-28T17:54:49.536Z] 17:54:49     INFO -  mozversion application_vendor: Mozilla
[task 2024-08-28T17:54:49.536Z] 17:54:49     INFO -  mozversion application_version: 131.0a1
[task 2024-08-28T17:54:49.536Z] 17:54:49     INFO -  mozversion platform_buildid: 20240828170113
[task 2024-08-28T17:54:49.536Z] 17:54:49     INFO -  mozversion platform_changeset: a0862a16be6bc785a2baccebfa4627be2016bd0f
[task 2024-08-28T17:54:49.536Z] 17:54:49     INFO -  mozversion platform_repository: https://hg.mozilla.org/integration/autoland
[task 2024-08-28T17:54:49.537Z] 17:54:49     INFO -  mozversion platform_version: 131.0a1
[task 2024-08-28T17:54:49.537Z] 17:54:49     INFO -  raptor-perftest Info: Browser name: Firefox
[task 2024-08-28T17:54:49.537Z] 17:54:49     INFO -  raptor-perftest Info: Browser version: 131.0a1
[task 2024-08-28T17:54:49.537Z] 17:54:49     INFO -  raptor-perftest Info: Post startup delay set to 30000 ms
[task 2024-08-28T17:54:49.539Z] 17:54:49     INFO -  raptor-perftest Info: main raptor init, config is: {'app': 'firefox', 'binary': '/home/cltbld/tasks/task_172486760589151/build/application/firefox/firefox', 'platform': 'linux', 'processor': 'x86_64', 'run_local': False, 'obj_path': None, 'gecko_profile': False, 'gecko_profile_interval': None, 'gecko_profile_entries': None, 'gecko_profile_extra_threads': [], 'gecko_profile_threads': None, 'gecko_profile_features': None, 'extra_profiler_run': False, 'symbols_path': 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NwGgzEG1Qj2UPcgTDSbU7Q/artifacts/public/build/target.crashreporter-symbols.zip', 'host': '127.0.0.1', 'cold': False, 'live_sites': False, 'is_release_build': False, 'e10s': True, 'device_name': None, 'fission': True, 'disable_perf_tuning': False, 'conditioned_profile': None, 'test_bytecode_cache': False, 'chimera': False, 'extra_prefs': {'fission.autostart': True}, 'environment': {}, 'project': 'mozilla-central', 'verbose': False, 'extra_summary_methods': [], 'benchmark_repository': None, 'benchmark_revision': None, 'benchmark_branch': None, 'clean': False, 'screenshot_on_failure': True, 'power_test': False}
[task 2024-08-28T17:54:49.539Z] 17:54:49     INFO -  raptor-perftest Info: Merging profile: /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/profile_data/base
[task 2024-08-28T17:54:49.541Z] 17:54:49     INFO -  raptor-perftest Info: Merging profile: /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/profile_data/common
[task 2024-08-28T17:54:49.547Z] 17:54:49     INFO -  raptor-perftest Info: Merging profile: /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/profile_data/perf
[task 2024-08-28T17:54:49.555Z] 17:54:49     INFO -  raptor-perftest Info: Merging profile: /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/profile_data/raptor
[task 2024-08-28T17:54:49.557Z] 17:54:49     INFO -  raptor-perftest Info: Browser preferences: {'fission.autostart': True}
[task 2024-08-28T17:54:49.557Z] 17:54:49     INFO -  raptor-perftest Info: Local browser profile: /tmp/tmpzvvozqu6.mozrunner
[task 2024-08-28T17:54:49.558Z] 17:54:49     INFO -  raptor-browsertime Info: Removing mozprofile delimiters from browser profile
[task 2024-08-28T17:54:49.558Z] 17:54:49     INFO -  raptor-browsertime Info: cwd: '/home/cltbld/tasks/task_172486760589151/build'
[task 2024-08-28T17:54:49.558Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_node: /home/cltbld/tasks/task_172486760589151/fetches/node/bin/node
[task 2024-08-28T17:54:49.559Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_node: os.stat_result(st_mode=33261, st_ino=5007009, st_dev=64768, st_nlink=1, st_uid=1006, st_gid=1007, st_size=92930512, st_atime=1724867609, st_mtime=1723573669, st_ctime=1724867609)
[task 2024-08-28T17:54:49.559Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_browsertimejs: /home/cltbld/tasks/task_172486760589151/fetches/browsertime/node_modules/browsertime/bin/browsertime.js
[task 2024-08-28T17:54:49.560Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_browsertimejs: os.stat_result(st_mode=33261, st_ino=5007507, st_dev=64768, st_nlink=1, st_uid=1006, st_gid=1007, st_size=7301, st_atime=1724867609, st_mtime=1718858379, st_ctime=1724867609)
[task 2024-08-28T17:54:49.560Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_geckodriver: /home/cltbld/tasks/task_172486760589151/fetches/geckodriver
[task 2024-08-28T17:54:49.561Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_geckodriver: os.stat_result(st_mode=33261, st_ino=4999631, st_dev=64768, st_nlink=1, st_uid=1006, st_gid=1007, st_size=6052008, st_atime=1724867608, st_mtime=1723742800, st_ctime=1724867608)
[task 2024-08-28T17:54:49.561Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_chromedriver: /home/cltbld/tasks/task_172486760589151/fetches/{}chromedriver
[task 2024-08-28T17:54:49.562Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_chromedriver: [Errno 2] No such file or directory: '/home/cltbld/tasks/task_172486760589151/fetches/{}chromedriver'
[task 2024-08-28T17:54:49.562Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_user_args: []
[task 2024-08-28T17:54:49.562Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime_user_args: stat: path should be string, bytes, os.PathLike or integer, not list
[task 2024-08-28T17:54:49.562Z] 17:54:49     INFO -  raptor-perftest Info: starting test: constant-regression
[task 2024-08-28T17:54:49.565Z] 17:54:49     INFO -  raptor-browsertime Info: test: {'here': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom', 'apps': 'firefox, chrome, safari, geckoview, fenix', 'alert_threshold': '2.0', 'browser_cycles': 1, 'fore_window': '1', 'lower_is_better': True, 'min_back_window': '2', 'max_back_window': '3', 'owner': 'PerfTest Team', 'page_cycles': '1', 'page_timeout': 2160000.0, 'output_timeout': '2000000', 'subtest_unit': 'ms', 'type': 'pageload', 'unit': 'score', 'use_live_sites': 'true', 'support_class': <browsertime_pageload.py.PageloadSupport object at 0x7fee3cfaa190>, 'browsertime_args': '--browsertime.constant_value=1500', 'custom_data': 'true', 'test_script': 'constant_regression_test.js', 'test_summary': 'flatten', 'test_url': 'None', 'name': 'constant-regression', 'manifest': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom/browsertime-regression-test.toml', 'manifest_relpath': 'tests/custom/browsertime-regression-test.toml', 'path': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom/constant-regression', 'relpath': 'tests/custom/constant-regression', 'ancestor_manifest': 'raptor.toml', 'expected': 'pass', 'cold': False, 'expected_browser_cycles': 1, 'browser_cycle': 1, 'playback': None, 'measure': ['fnbpaint', 'fcp', 'loadtime', 'ContentfulSpeedIndex', 'PerceptualSpeedIndex', 'SpeedIndex', 'FirstVisualChange', 'LastVisualChange', 'largestContentfulPaint']}
[task 2024-08-28T17:54:49.565Z] 17:54:49     INFO -  raptor-browsertime-desktop Info: binary_path: /home/cltbld/tasks/task_172486760589151/build/application/firefox/firefox
[task 2024-08-28T17:54:49.565Z] 17:54:49     INFO -  raptor-browsertime Info: Test support class is modifying the command...
[task 2024-08-28T17:54:49.566Z] 17:54:49     INFO -  raptor-browsertime Info: timeout (s): 2160000
[task 2024-08-28T17:54:49.566Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime cwd: /home/cltbld/tasks/task_172486760589151/build
[task 2024-08-28T17:54:49.568Z] 17:54:49     INFO -  raptor-browsertime Info: browsertime cmd: /home/cltbld/tasks/task_172486760589151/fetches/node/bin/node /home/cltbld/tasks/task_172486760589151/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --firefox.geckodriverPath /home/cltbld/tasks/task_172486760589151/fetches/geckodriver /home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/browsertime/../../browsertime/constant_regression_test.js --firefox.noDefaultPrefs --browsertime.page_cycle_delay 1000 --skipHar --pageLoadStrategy none --webdriverPageload true --firefox.disableBrowsertimeExtension true --pageCompleteCheckStartWait 5000 --pageCompleteCheckPollTimeout 1000 --beforePageCompleteWaitTime 2000 --timeouts.pageLoad 2160000 --timeouts.script 2160000 --browsertime.page_cycles 1 --pageCompleteWaitTime 5000 --browsertime.url None --browsertime.post_startup_delay 30000 --iterations 1 --browsertime.chimera false --browsertime.test_bytecode_cache false --firefox.perfStats false --browsertime.moz_fetch_dir /home/cltbld/tasks/task_172486760589151/fetches --browsertime.expose_profiler false --browsertime.constant_value 1500 --browsertime.commands  --viewPort 1280x1024 --browser firefox --firefox.binaryPath /home/cltbld/tasks/task_172486760589151/build/application/firefox/firefox --resultDir /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/browsertime-results/constant-regression --firefox.profileTemplate /tmp/tmpzvvozqu6.mozrunner --video false --visualMetrics false --browsertime.testName constant-regression --browsertime.liveSite False --browsertime.loginRequired False
[task 2024-08-28T17:54:49.569Z] 17:54:49     INFO -  raptor-browsertime Info: PATH: /home/cltbld/tasks/task_172486760589151/build/venv/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin
[task 2024-08-28T17:54:49.569Z] 17:54:49     INFO -  raptor-browsertime Info: Calling browsertime with proc_timeout=2000000, and output_timeout=2000000
[task 2024-08-28T17:54:50.149Z] 17:54:50     INFO -  raptor-browsertime Info: Running tests using Firefox - 1 iteration(s)
[task 2024-08-28T17:54:50.174Z] 17:54:50     INFO -  raptor-browsertime Info: Skip setting default preferences for Firefox
[task 2024-08-28T17:54:53.349Z] 17:54:53     INFO -  raptor-browsertime Info: Starting constant value regression test
[task 2024-08-28T17:54:53.350Z] 17:54:53     INFO -  raptor-browsertime Info: Start to measure regression-test
[task 2024-08-28T17:54:53.437Z] 17:54:53     INFO -  raptor-browsertime Info: CPU / Power usage: 37
[task 2024-08-28T17:54:56.495Z] 17:54:56     INFO -  raptor-browsertime Info: data:text/html;charset=utf-8,<html><body></body></html> TTFB: 0ms, firstPaint: 20ms, DOMContentLoaded: 18ms, CPUBenchmark: 65ms, Load: 19ms
[task 2024-08-28T17:54:56.497Z] 17:54:56     INFO -  raptor-browsertime Info: Wrote data to blobber_upload_dir/browsertime-results/constant-regression
[task 2024-08-28T17:54:56.501Z] 17:54:56     INFO -  raptor-browsertime Info: Test support class is cleaning up...
[task 2024-08-28T17:54:56.501Z] 17:54:56     INFO -  perftest-results-handler Info: retrieving browsertime test results
[task 2024-08-28T17:54:56.502Z] 17:54:56     INFO -  perftest-results-handler Info: found browsertime results at /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/browsertime-results/constant-regression/browsertime.json
[task 2024-08-28T17:54:56.504Z] 17:54:56     INFO -  perftest-results-handler Info: {'here': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom', 'apps': 'firefox, chrome, safari, geckoview, fenix', 'alert_threshold': '2.0', 'browser_cycles': 1, 'fore_window': '1', 'lower_is_better': True, 'min_back_window': '2', 'max_back_window': '3', 'owner': 'PerfTest Team', 'page_cycles': '1', 'page_timeout': 2160000.0, 'output_timeout': '2000000', 'subtest_unit': 'ms', 'type': 'pageload', 'unit': 'score', 'use_live_sites': 'true', 'support_class': <browsertime_pageload.py.PageloadSupport object at 0x7fee3cfaa190>, 'browsertime_args': '--browsertime.constant_value=1500', 'custom_data': 'true', 'test_script': 'constant_regression_test.js', 'test_summary': 'flatten', 'test_url': 'None', 'name': 'constant-regression', 'manifest': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom/browsertime-regression-test.toml', 'manifest_relpath': 'tests/custom/browsertime-regression-test.toml', 'path': '/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/tests/custom/constant-regression', 'relpath': 'tests/custom/constant-regression', 'ancestor_manifest': 'raptor.toml', 'expected': 'pass', 'cold': False, 'expected_browser_cycles': 1, 'browser_cycle': 1, 'playback': None, 'measure': ['fnbpaint', 'fcp', 'loadtime', 'ContentfulSpeedIndex', 'PerceptualSpeedIndex', 'SpeedIndex', 'FirstVisualChange', 'LastVisualChange', 'largestContentfulPaint']}
[task 2024-08-28T17:54:56.505Z] 17:54:56     INFO -  perftest-results-handler Info: parsing results from browsertime json
[task 2024-08-28T17:54:56.505Z] 17:54:56    ERROR -  Traceback (most recent call last):
[task 2024-08-28T17:54:56.505Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/raptor.py", line 189, in <module>
[task 2024-08-28T17:54:56.505Z] 17:54:56     INFO -      main()
[task 2024-08-28T17:54:56.506Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/raptor.py", line 138, in main
[task 2024-08-28T17:54:56.506Z] 17:54:56     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2024-08-28T17:54:56.506Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/perftest.py", line 510, in run_tests
[task 2024-08-28T17:54:56.506Z] 17:54:56     INFO -      return self.process_results(tests, test_names)
[task 2024-08-28T17:54:56.507Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/perftest.py", line 532, in process_results
[task 2024-08-28T17:54:56.507Z] 17:54:56     INFO -      res = self.results_handler.summarize_and_output(self.config, tests, test_names)
[task 2024-08-28T17:54:56.507Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/results.py", line 1035, in summarize_and_output
[task 2024-08-28T17:54:56.508Z] 17:54:56     INFO -      for new_result in self.parse_browsertime_json(
[task 2024-08-28T17:54:56.508Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/raptor/results.py", line 771, in parse_browsertime_json
[task 2024-08-28T17:54:56.508Z] 17:54:56     INFO -      support_class.handle_result(
[task 2024-08-28T17:54:56.509Z] 17:54:56     INFO -    File "/home/cltbld/tasks/task_172486760589151/build/tests/raptor/browsertime/support-scripts/browsertime_pageload.py", line 108, in handle_result
[task 2024-08-28T17:54:56.509Z] 17:54:56     INFO -      raise MissingResultsError(
[task 2024-08-28T17:54:56.509Z] 17:54:56     INFO -  results.MissingResultsError: Browsertime cycle missing ['largestContentfulPaint', 'renderTime'] measurement
[task 2024-08-28T17:54:56.564Z] 17:54:56     INFO - Return code: 1
[task 2024-08-28T17:54:56.564Z] 17:54:56  WARNING - setting return code to 1
[task 2024-08-28T17:54:56.564Z] 17:54:56     INFO - Copying Raptor results to upload dir:
[task 2024-08-28T17:54:56.564Z] 17:54:56     INFO - /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/perfherder-data.json
[task 2024-08-28T17:54:56.564Z] 17:54:56     INFO - Copying raptor results from /home/cltbld/tasks/task_172486760589151/build/raptor.json to /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/perfherder-data.json
[task 2024-08-28T17:54:56.564Z] 17:54:56 CRITICAL - Error copying results /home/cltbld/tasks/task_172486760589151/build/raptor.json to upload dir /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/perfherder-data.json
[task 2024-08-28T17:54:56.564Z] 17:54:56     INFO - [Errno 2] No such file or directory: '/home/cltbld/tasks/task_172486760589151/build/raptor.json'
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - Running post-action listener: _package_coverage_data
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - Running post-action listener: _resource_record_post_action
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - Running post-action listener: process_java_coverage_data
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - Running post-action listener: stop_device
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - [mozharness: 2024-08-28 17:54:56.565774Z] Finished run-tests step (success)
[task 2024-08-28T17:54:56.565Z] 17:54:56     INFO - Running post-run listener: _resource_record_post_run
[task 2024-08-28T17:54:56.651Z] 17:54:56     INFO - Total resource usage - Wall time: 19s; CPU: 12%; Read bytes: 17211392; Write bytes: 451497984; Read time: 360; Write time: 71536
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: CPU usage<br/>12.5%
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: I/O read bytes / time<br/>17,211,392 / 360
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: I/O write bytes / time<br/>451,497,984 / 71,536
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: CPU idle<br/>127.8 (85.9%)
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: CPU iowait<br/>2.2 (1.5%)
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: CPU user<br/>17.1 (11.5%)
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2024-08-28T17:54:56.652Z] 17:54:56     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-08-28T17:54:56.656Z] 17:54:56     INFO - install - Wall time: 11s; CPU: 13%; Read bytes: 0; Write bytes: 404262912; Read time: 0; Write time: 69720
[task 2024-08-28T17:54:56.659Z] 17:54:56     INFO - run-tests - Wall time: 8s; CPU: 12%; Read bytes: 17211392; Write bytes: 47235072; Read time: 360; Write time: 1816
[task 2024-08-28T17:54:56.789Z] 17:54:56  WARNING - returning nonzero exit status 1
[taskcluster 2024-08-28T17:54:56.827Z]    Exit Code: 1
[taskcluster 2024-08-28T17:54:56.827Z]    User Time: 1m13.096983s
[taskcluster 2024-08-28T17:54:56.827Z]  Kernel Time: 5.921746s
[taskcluster 2024-08-28T17:54:56.827Z]    Wall Time: 1m28.63708412s
[taskcluster 2024-08-28T17:54:56.827Z]       Result: FAILED
[taskcluster 2024-08-28T17:54:56.827Z] === Task Finished ===
[taskcluster 2024-08-28T17:54:56.827Z] Task Duration: 1m28.64047312s
[taskcluster 2024-08-28T17:54:56.915Z] Uploading artifact public/logs/localconfig.json from file /home/cltbld/tasks/task_172486760589151/logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2025-08-28T17:46:29.834Z
[taskcluster 2024-08-28T17:54:57.253Z] Uploading artifact public/test_info/browsertime-results/constant-regression/browsertime.json from file /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/browsertime-results/constant-regression/browsertime.json with content encoding "gzip", mime type "application/json" and expiry 2025-08-28T17:46:29.834Z
[taskcluster 2024-08-28T17:54:57.509Z] Uploading artifact public/test_info/profile_resource-usage.json from file /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/profile_resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-08-28T17:46:29.834Z
[taskcluster 2024-08-28T17:54:57.756Z] Uploading artifact public/test_info/resource-usage.json from file /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-08-28T17:46:29.834Z
[taskcluster 2024-08-28T17:54:58.059Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-08-28T17:46:29.834Z
[taskcluster:error] exit status 1
Summary: Perma [tier 2] Error copying results /home/cltbld/tasks/task_172486760589151/build/raptor.json to upload dir /home/cltbld/tasks/task_172486760589151/build/blobber_upload_dir/perfherder-data.json → Perma [tier 2] results.MissingResultsError: Browsertime cycle missing ['largestContentfulPaint', 'renderTime'] measurement
Assignee: nobody → gmierz2
Status: NEW → ASSIGNED
Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/2276287ab797 Don't use pageload support script for constant-regression test. r=kshampur,perftest-reviewers
Regressions: 1915463

https://hg.mozilla.org/mozilla-central/rev/2276287ab797

Status: ASSIGNED → RESOLVED
Closed: 1 year ago
status-firefox131: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 131 Branch

Set release status flags based on info from the regressing bug 1914370

status-firefox129: --- → unaffected
status-firefox130: --- → unaffected
status-firefox-esr115: --- → unaffected
status-firefox-esr128: --- → unaffected
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: