Closed Bug 1768558 Opened 2 years ago Closed 2 years ago

Run new "Fenix-Fission" and "GeckoView-Fission" perf tests on AWFY

Categories

(Testing :: Raptor, task, P2)

Default
Unspecified
Android
task

Tracking

(firefox105 fixed)

RESOLVED FIXED
105 Branch
Tracking Status
firefox105 --- fixed

People

(Reporter: cpeterson, Assigned: afinder)

References

Details

(Whiteboard: [fission:android:m2][fxp])

Attachments

(1 file)

To compare the performance of Fission vs non-Fission on Android, the Android Fission team would like:

  1. New "Fenix-Fission" and "GeckoView-Fission" performance test configurations.
  2. They should run the following performance tests run:
    • Cold Page Load (Recorded)
    • Cold Page Load (Live)
    • Warm Page Load (Recorded)
    • Warm Page Load (Live)
    • Speedometer
  3. And their test results displayed on the arewefastyet.com dashboard on the same graphs as the current non-Fission "Fenix" and "GeckoView" tests results like https://arewefastyet.com/androidPixel2/cold-page-load/overview?numDays=30.

We will only need these Fission tests until we ship Android Fission, which will probably be in 2022 Q4. Once Fission is enabled by default on Android, then the default "Fenix" and "GeckoView" tests will be testing Fission. Then we can retire these new "Fenix-Fission" and "GeckoView-Fission" tests.

We don't care which device is used (Pixel 2, Samsung A51, or whatever), as long as the same tests are run for non-Fission Fenix and GeckoView.

Severity: -- → S2
Component: Performance → Raptor
Priority: -- → P2
Assignee: nobody → afinder
Status: NEW → ASSIGNED
Pushed by afinder@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/54826976712c
Run new "Fenix-Fission" and "GeckoView-Fission" perf tests on AWFY r=perftest-reviewers,sparky,jmaher
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 105 Branch
Regressions: 1786405
Whiteboard: [fission:android:m2] → [fission:android:m2][fxp]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: