Closed Bug 1866050 Opened 11 months ago Closed 11 months ago

Permafailing [tier 2] browsertime KeyError: 'mac-aarch64'

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Type:
defect

Tracking

(firefox122 fixed)

Status:
RESOLVED FIXED
Milestone:
122 Branch
Tracking Flags:
Tracking Status
firefox122 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: jmaher)

Details

(Keywords: intermittent-failure, Whiteboard: [retriggered])

Attachments

(1 file)

Bug 1866050 - fix browsertime s/mac-arm/mac-aarch64/. r=sparky!
48 bytes, text/x-phabricator-request
Details | Review

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=437258265&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OSOEIURlRu2L9Ce41u27aA/runs/0/artifacts/public/logs/live_backing.log

[task 2023-11-22T12:54:11.765Z] 12:54:11     INFO -  raptor-benchmark Info: starting webserver on '127.0.0.1:49344'
[task 2023-11-22T12:54:11.765Z] 12:54:11     INFO -  raptor-benchmark Info: serving benchmarks from here: /opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/tests/webkit/PerformanceTests
[task 2023-11-22T12:54:12.266Z] 12:54:12    ERROR -  Traceback (most recent call last):
[task 2023-11-22T12:54:12.267Z] 12:54:12     INFO -    File "/opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/raptor.py", line 186, in <module>
[task 2023-11-22T12:54:12.268Z] 12:54:12     INFO -      main()
[task 2023-11-22T12:54:12.268Z] 12:54:12     INFO -    File "/opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/raptor.py", line 135, in main
[task 2023-11-22T12:54:12.268Z] 12:54:12     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2023-11-22T12:54:12.269Z] 12:54:12     INFO -    File "/opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/perftest.py", line 479, in run_tests
[task 2023-11-22T12:54:12.269Z] 12:54:12     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2023-11-22T12:54:12.269Z] 12:54:12     INFO -    File "/opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/browsertime/base.py", line 871, in run_test
[task 2023-11-22T12:54:12.270Z] 12:54:12     INFO -      self.run_test_setup(test)
[task 2023-11-22T12:54:12.270Z] 12:54:12     INFO -    File "/opt/worker/tasks/task_170065753736453/build/tests/raptor/raptor/browsertime/base.py", line 184, in run_test_setup
[task 2023-11-22T12:54:12.270Z] 12:54:12     INFO -      cd_extracted_names_115[
[task 2023-11-22T12:54:12.270Z] 12:54:12     INFO -  KeyError: 'mac-aarch64'
[task 2023-11-22T12:54:12.316Z] 12:54:12     INFO - Return code: 1
[task 2023-11-22T12:54:12.316Z] 12:54:12  WARNING - setting return code to 1

Thanks for the bug! :jmaher, do you think this might be from the mozinfo changes in bug 1864755?

Flags: needinfo?(jmaher)

it appears we have mac-arm: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/browsertime/base.py#171, and now with my change it is looking for mac-aarch64.

I would prefer to change browsertime base.py to be mac-aarch64, either copy it so both mac-arm and mac-aarch64 exists, or edit it.

:sparky, what do you recommend?

Flags: needinfo?(jmaher) → needinfo?(gmierz2)

+1 to changing it to mac-aarch64, and removing the mac-arm one

Flags: needinfo?(gmierz2)
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/84d22a46a333 fix browsertime s/mac-arm/mac-aarch64/. r=sparky,perftest-reviewers

https://hg.mozilla.org/mozilla-central/rev/84d22a46a333

Status: ASSIGNED → RESOLVED
Closed: 11 months ago
status-firefox122: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 122 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: