Closed Bug 1935126 Opened 2 months ago Closed 2 months ago

58.65 - 2.67% speedometer3 TodoMVC-React-Complex-DOM/DeletingAllItems/Async / speedometer3 TodoMVC-React-Complex-DOM/Adding100Items/total + 78 more (Windows) regression on Fri November 29 2024

Categories

(Core :: Layout: Scrolling and Overflow, defect)

defect

Tracking

()

RESOLVED WONTFIX
Tracking Status
firefox-esr128 --- unaffected
firefox133 --- unaffected
firefox134 --- affected
firefox135 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: perf, perf-alert, regression)

Perfherder has detected a browsertime performance regression from push 6f0c8239c94d1d285b08727f4c642046f04db740. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
59% speedometer3 TodoMVC-React-Complex-DOM/DeletingAllItems/Async windows11-64-nightlyasrelease-qr fission webrender 1.38 -> 2.19 Before/After
53% speedometer3 TodoMVC-JavaScript-ES6-Webpack-Complex-DOM/DeletingAllItems/Async windows11-64-shippable-qr fission webrender 1.35 -> 2.07 Before/After
50% speedometer3 TodoMVC-Angular-Complex-DOM/DeletingAllItems/Async windows11-64-nightlyasrelease-qr fission webrender 1.58 -> 2.37 Before/After
50% speedometer3 TodoMVC-Angular-Complex-DOM/DeletingAllItems/Async windows11-64-shippable-qr fission webrender 1.58 -> 2.36 Before/After
49% speedometer3 TodoMVC-React-Complex-DOM/DeletingAllItems/Async windows11-64-shippable-qr fission webrender 1.46 -> 2.17 Before/After
42% speedometer3 TodoMVC-JavaScript-ES6-Webpack-Complex-DOM/DeletingAllItems/Async windows11-64-nightlyasrelease-qr fission webrender 1.39 -> 1.97 Before/After
35% speedometer3 TodoMVC-Svelte-Complex-DOM/DeletingAllItems/Async windows11-64-nightlyasrelease-qr fission webrender 2.53 -> 3.41 Before/After
33% speedometer3 TodoMVC-Preact-Complex-DOM/DeletingAllItems/Async windows11-64-nightlyasrelease-qr fission webrender 2.41 -> 3.19 Before/After
30% speedometer3 TodoMVC-Preact-Complex-DOM/DeletingAllItems/Async windows11-64-shippable-qr fission webrender 2.53 -> 3.29 Before/After
28% speedometer3 TodoMVC-React-Complex-DOM/CompletingAllItems/Async windows11-64-shippable-qr fission webrender 2.97 -> 3.81 Before/After
... ... ... ... ... ...
4% speedometer3 TodoMVC-React-Complex-DOM/Adding100Items/total windows11-64-nightlyasrelease-qr fission webrender 20.18 -> 21.02 Before/After
3% speedometer3 TodoMVC-Angular-Complex-DOM/Adding100Items/total windows11-64-nightlyasrelease-qr fission webrender 29.40 -> 30.32 Before/After
3% speedometer3 score windows11-64-nightlyasrelease-qr fission webrender 22.25 -> 21.59 Before/After
3% speedometer3 windows11-64-nightlyasrelease-qr fission webrender 22.25 -> 21.59 Before/After
3% speedometer3 TodoMVC-React-Complex-DOM/Adding100Items/total windows11-64-shippable-qr fission webrender 20.71 -> 21.27 Before/After

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the patch(es) may be backed out in accordance with our regression policy.

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask a sheriff to do that for you.

You can run all of these tests on try with ./mach try perf --alert 42873

The following documentation link provides more information about this command.

For more information on performance sheriffing please see our FAQ.

If you have any questions, please do not hesitate to reach out to bacasandrei@mozilla.com.

Flags: needinfo?(dshin)

Set release status flags based on info from the regressing bug 1932840

This is kind-of expected - given Bug 1768921 Comment 22 was a result of a bug (Down at Bug 1768921 Comment 31), and that bug 1932840 fixes it, we're basically paying back the false gains.
The regressed performance seems a bit worse, though, so I will investigate.

As far as overall speedometer 3 score goes, I see the bump up on Nov 13 when Bug 1768921 landed, then about-equal bump down when bug 1932840 landed.
For issues that have a higher regression ratio than improvement (e.g. TodoMVC-JavaScript-ES6-Webpack-Complex-DOM/DeletingAllItems/Async), I see the bump down on Nov 13, then back up on 29, to about the same level.

As unfortunate it is to not be able to keep this, given that it was the result of a bug, this regression is expected.

Status: NEW → RESOLVED
Closed: 2 months ago
Flags: needinfo?(dshin)
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.