Closed Bug 1795068 Opened 2 years ago Closed 2 years ago

Intermittent results.MissingResultsError: Browsertime cycle missing timeToDomContentFlushed measurement

Categories

(Testing :: Raptor, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=393072534&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/E3Fve_mgR3-f14iVFoFfYQ/runs/0/artifacts/public/logs/live_backing.log


[task 2022-10-13T14:22:56.581Z] 14:22:56     INFO -  raptor-mitmproxy Info: Turning off the browser proxy
[task 2022-10-13T14:22:56.582Z] 14:22:56     INFO -  raptor-mitmproxy Info: writing: C:\Users\task_1665666896\build\application\firefox\distribution\policies.json
[task 2022-10-13T14:22:56.582Z] 14:22:56     INFO -  perftest-results-handler Info: retrieving browsertime test results
[task 2022-10-13T14:22:56.583Z] 14:22:56     INFO -  perftest-results-handler Info: found browsertime results at C:\Users\task_1665666896\build\blobber_upload_dir\browsertime-results\fandom\browsertime.json
[task 2022-10-13T14:22:56.644Z] 14:22:56     INFO -  perftest-results-handler Info: {'here': 'C:\\Users\\task_1665666896\\build\\tests\\raptor\\raptor\\tests\\tp6\\desktop', 'alert_on': ['ContentfulSpeedIndex', 'FirstVisualChange', 'LastVisualChange', 'PerceptualSpeedIndex', 'SpeedIndex', 'fcp', 'loadtime'], 'alert_threshold': '2.0', 'apps': 'firefox, chrome, chromium', 'browser_cycles': '25', 'lower_is_better': True, 'owner': 'PerfTest Team', 'page_cycles': 2, 'page_timeout': '60000', 'playback': 'mitmproxy', 'playback_pageset_manifest': 'mitm5-linux-firefox-fandom.manifest', 'playback_version': '5.1.1', 'type': 'pageload', 'unit': 'ms', 'use_live_sites': 'false', 'test_url': 'https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase', 'name': 'fandom', 'manifest': 'C:\\Users\\task_1665666896\\build\\tests\\raptor\\raptor\\tests\\tp6\\desktop\\browsertime-tp6.ini', 'manifest_relpath': 'tests\\tp6\\desktop\\browsertime-tp6.ini', 'path': 'C:\\Users\\task_1665666896\\build\\tests\\raptor\\raptor\\tests\\tp6\\desktop\\fandom', 'relpath': 'tests\\tp6\\desktop\\fandom', 'ancestor_manifest': 'raptor.ini', 'expected': 'pass', 'perfstats': 'true', 'extra_profiler_run': True, 'extra_profiler_run_browser_cycles': 1, 'extra_profiler_run_page_cycles': 2, 'cold': True, 'expected_browser_cycles': 25, 'browser_cycle': 1, 'measure': ['fnbpaint', 'fcp', 'dcf', 'loadtime', 'ContentfulSpeedIndex', 'PerceptualSpeedIndex', 'SpeedIndex', 'FirstVisualChange', 'LastVisualChange']}
[task 2022-10-13T14:22:56.644Z] 14:22:56     INFO -  perftest-results-handler Info: parsing results from browsertime json
[task 2022-10-13T14:22:56.645Z] 14:22:56     INFO -  raptor-perftest Info: Removing temporary directory: C:\Users\task_1665666896\AppData\Local\Temp\tmpz1p1c4uj
[task 2022-10-13T14:22:56.741Z] 14:22:56    ERROR -  Traceback (most recent call last):
[task 2022-10-13T14:22:56.741Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\raptor.py", line 206, in <module>
[task 2022-10-13T14:22:56.741Z] 14:22:56     INFO -      main()
[task 2022-10-13T14:22:56.742Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\raptor.py", line 152, in main
[task 2022-10-13T14:22:56.742Z] 14:22:56     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2022-10-13T14:22:56.742Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\perftest.py", line 476, in run_tests
[task 2022-10-13T14:22:56.743Z] 14:22:56     INFO -      return self.process_results(tests, test_names)
[task 2022-10-13T14:22:56.743Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\perftest.py", line 498, in process_results
[task 2022-10-13T14:22:56.743Z] 14:22:56     INFO -      res = self.results_handler.summarize_and_output(self.config, tests, test_names)
[task 2022-10-13T14:22:56.744Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\results.py", line 871, in summarize_and_output
[task 2022-10-13T14:22:56.744Z] 14:22:56     INFO -      for new_result in self.parse_browsertime_json(
[task 2022-10-13T14:22:56.744Z] 14:22:56     INFO -    File "C:\Users\task_1665666896\build\tests\raptor\raptor\results.py", line 654, in parse_browsertime_json
[task 2022-10-13T14:22:56.744Z] 14:22:56     INFO -      raise MissingResultsError(
[task 2022-10-13T14:22:56.745Z] 14:22:56     INFO -  results.MissingResultsError: Browsertime cycle missing timeToDomContentFlushed measurement
[task 2022-10-13T14:22:56.798Z] 14:22:56    ERROR - Return code: 1
[task 2022-10-13T14:22:56.798Z] 14:22:56  WARNING - setting return code to 1
[task 2022-10-13T14:22:56.798Z] 14:22:56     INFO - Copying Raptor results to upload dir:
[task 2022-10-13T14:22:56.798Z] 14:22:56     INFO - C:\Users\task_1665666896\build\blobber_upload_dir\perfherder-data.json
[task 2022-10-13T14:22:56.798Z] 14:22:56     INFO - Copying raptor results from C:\Users\task_1665666896\build\raptor.json to C:\Users\task_1665666896\build\blobber_upload_dir\perfherder-data.json
[task 2022-10-13T14:22:56.798Z] 14:22:56 CRITICAL - Error copying results C:\Users\task_1665666896\build\raptor.json to upload dir C:\Users\task_1665666896\build\blobber_upload_dir\perfherder-data.json
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - [Errno 2] No such file or directory: 'C:\\Users\\task_1665666896\\build\\raptor.json'
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - Running post-action listener: _package_coverage_data
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - Running post-action listener: _resource_record_post_action
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - Running post-action listener: process_java_coverage_data
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - Running post-action listener: stop_device
[task 2022-10-13T14:22:56.799Z] 14:22:56     INFO - [mozharness: 2022-10-13 14:22:56.799603Z] Finished run-tests step (success)
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.