2009421 - Perma Btime-fenix AttributeError: 'list' object has no attribute 'items'

Status: NEW

(Testing :: Performance, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: chorotan [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=542887355&repo=mozilla-central&task=F7dSJJB1Tkuxv_3V4b5epA.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/F7dSJJB1Tkuxv_3V4b5epA/runs/0/artifacts/public/fetch/perfherder-data-fetch-content.json

---

[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  raptor-browsertime Info: Wrote data to blobber_upload_dir/browsertime-results/jetstream2
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  raptor-browsertime-android Info: removing reverse socket connections
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  perftest-results-handler Info: retrieving browsertime test results
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  perftest-results-handler Info: found browsertime results at /builds/task_176796746750593/workspace/build/blobber_upload_dir/browsertime-results/jetstream2/browsertime.json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  perftest-results-handler Info: {'here': '/builds/task_176796746750593/workspace/build/tests/raptor/raptor/tests/benchmarks', 'alert_threshold': '2.0', 'apps': 'fenix, geckoview, chrome-m, cstm-car-m', 'expose_browser_profiler': True, 'lower_is_better': False, 'owner': ':jandem and SpiderMonkey Team', 'page_cycles': '4', 'page_timeout': '2000000', 'subtest_lower_is_better': False, 'subtest_unit': 'score', 'test_url': 'http://127.0.0.1:34389/JetStream2/index.html?raptor', 'type': 'benchmark', 'unit': 'score', 'sparse_checkout': True, 'repository': 'https://github.com/mozilla/perf-automation', 'repository_revision': '61332db584026b73e37066d717a162825408c36b', 'repository_path': 'benchmarks/JetStream2', 'name': 'jetstream2', 'manifest': '/builds/task_176796746750593/workspace/build/tests/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml', 'manifest_relpath': 'tests/benchmarks/jetstream2-mobile.toml', 'path': '/builds/task_176796746750593/workspace/build/tests/raptor/raptor/tests/benchmarks/jetstream2', 'relpath': 'tests/benchmarks/jetstream2', 'ancestor_manifest': 'raptor.toml', 'expected': 'pass', 'browser_cycles': 1, 'cold': False, 'expected_browser_cycles': 1, 'browser_cycle': 1}
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  perftest-results-handler Info: parsing results from browsertime json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  raptor-perftest Info: Removing temporary directory: /tmp/tmprywys7va
[task 2026-01-09T14:19:27.056+00:00] 14:19:25    ERROR -  Traceback (most recent call last):
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/raptor.py", line 187, in <module>
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      main()
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/raptor.py", line 136, in main
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/browsertime/android.py", line 244, in run_tests
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      return super().run_tests(tests, test_names)
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/perftest.py", line 503, in run_tests
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      return self.process_results(tests, test_names)
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/perftest.py", line 525, in process_results
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      res = self.results_handler.summarize_and_output(self.config, tests, test_names)
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/results.py", line 1030, in summarize_and_output
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      for new_result in self.parse_browsertime_json(
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -    File "/builds/task_176796746750593/workspace/build/tests/raptor/raptor/results.py", line 808, in parse_browsertime_json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -      for k, v in data.items():
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO -  AttributeError: 'list' object has no attribute 'items'
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Return code: 1
[task 2026-01-09T14:19:27.056+00:00] 14:19:25  WARNING - setting return code to 1
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Killing logcat pid 877.
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Copying Raptor results to upload dir:
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - /builds/task_176796746750593/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Copying raptor results from /builds/task_176796746750593/workspace/build/raptor.json to /builds/task_176796746750593/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25 CRITICAL - Error copying results /builds/task_176796746750593/workspace/build/raptor.json to upload dir /builds/task_176796746750593/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - [Errno 2] No such file or directory: '/builds/task_176796746750593/workspace/build/raptor.json'
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Running post-action listener: _package_coverage_data
[task 2026-01-09T14:19:27.056+00:00] 14:19:25     INFO - Running post-action listener: _resource_record_post_action

Comment 1

[Greg Mierzwinski [:sparky]]

It's very likely that this was "regressed" by bug 2007582. We were never running the jetstream2 test on Pixel 6 devices before this push which contains that patch: https://hg-edge.mozilla.org/mozilla-central/pushloghtml?changeset=9d92a25bfb8f450e7a3970cbeb1c5a10bc9133da

The issue is specifically this line: https://searchfox.org/firefox-main/source/taskcluster/test_configs/test-platforms.yml#434

Which added many other unrelated tests: https://searchfox.org/firefox-main/source/taskcluster/test_configs/test-sets.yml#558-572

:acreskey, could you take a look at this? We would probably need to make a new test set for the tests that you'd like to add to the pixel 6 device.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 2007582

Comment 3

[Cristina Horotan [:chorotan]]

The regressor was backed out here: https://bugzilla.mozilla.org/show_bug.cgi?id=2007582#c5
https://hg.mozilla.org/integration/autoland/rev/d1b43db23be5806184088924cc900df88a8f4c6e

Comment 4

[Intermittent Failures Robot]

15 failures were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 15

Table

	no_variant	nofis
android-aarch64/opt	12	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2009421&startday=2026-01-09&endday=2026-01-09&tree=all