73.17 - 12.38% welcome ContentfulSpeedIndex / welcome ContentfulSpeedIndex + 4 more (Linux, OSX, Windows) regression on Fri April 1 2022
Categories
(Firefox :: Messaging System, defect, P1)
Tracking
()
| Tracking | Status | |
|---|---|---|
| firefox-esr91 | --- | unaffected |
| firefox99 | --- | unaffected |
| firefox100 | --- | wontfix |
| firefox101 | --- | fixed |
People
(Reporter: afinder, Assigned: Mardak)
References
(Blocks 1 open bug, Regression)
Details
(Keywords: perf, perf-alert, regression)
Attachments
(1 file)
Perfherder has detected a browsertime performance regression from push 53e6fbe77dff1c74b11e1903ccf3084a39f90cd0. As author of one of the patches included in that push, we need your help to address this regression.
Regressions:
| Ratio | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|
| 73% | welcome ContentfulSpeedIndex | windows10-64-shippable-qr | fission warm webrender | 324.83 -> 562.50 |
| 52% | welcome ContentfulSpeedIndex | windows10-64-shippable-qr | fission warm webrender | 354.92 -> 538.33 |
| 24% | welcome ContentfulSpeedIndex | macosx1015-64-shippable-qr | fission warm webrender | 1,366.33 -> 1,693.25 |
| 20% | welcome ContentfulSpeedIndex | linux1804-64-shippable-qr | fission warm webrender | 1,338.17 -> 1,601.42 |
| 12% | welcome ContentfulSpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 1,594.42 -> 1,793.08 |
| 12% | welcome ContentfulSpeedIndex | linux1804-64-shippable-qr | cold fission webrender | 1,500.92 -> 1,686.67 |
Improvements:
| Ratio | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|
| 28% | welcome PerceptualSpeedIndex | windows10-64-shippable-qr | fission warm webrender | 281.58 -> 204.00 |
| 26% | welcome PerceptualSpeedIndex | windows10-64-shippable-qr | cold fission webrender | 380.25 -> 281.83 |
| 20% | welcome SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 272.83 -> 217.17 |
| 15% | welcome fcp | macosx1015-64-shippable-qr | cold fission webrender | 108.92 -> 92.29 |
| 8% | welcome PerceptualSpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 1,503.96 -> 1,380.17 |
| ... | ... | ... | ... | ... |
| 5% | welcome PerceptualSpeedIndex | macosx1015-64-shippable-qr | fission warm webrender | 1,388.00 -> 1,314.25 |
Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.
For more information on performance sheriffing please see our FAQ.
|
||
Comment 1•3 years ago
|
||
Set release status flags based on info from the regressing bug 1762289
|
Assignee | |
Comment 2•3 years ago
|
||
The main background image for about:welcome changed from an .avif to .svg. We'll revert back to the avif in 101.
There's also regressions for FirstVisualChange ContentfulSpeedIndex and improvements for SpeedIndex ContentfulSpeedIndex fcp noted in bug 1763705. Overall interesting to see what changes although the background images are quite different from each other in content as well.
|
|
||
Updated•3 years ago
|
|
|
Assignee | |
Comment 5•3 years ago
|
||
|
|
Assignee | |
Updated•3 years ago
|
|
||
Comment 7•3 years ago
|
||
| bugherder | ||
|
||
Comment 8•3 years ago
|
||
(In reply to Pulsebot from comment #6)
Pushed by elee@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/f905975979c2
Revert various changes back to before Fx100 onboarding r=pdahiya
== Change summary for alert #33996 (as of Tue, 03 May 2022 05:33:24 GMT) ==
Regressions:
| Ratio | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|
| 39% | welcome PerceptualSpeedIndex | windows10-64-shippable-qr | fission warm webrender | 202.67 -> 281.67 |
| 30% | welcome PerceptualSpeedIndex | linux1804-64-shippable-qr | cold fission webrender | 295.42 -> 385.42 |
| 29% | welcome PerceptualSpeedIndex | linux1804-64-shippable-qr | fission warm webrender | 237.58 -> 306.08 |
| 24% | welcome SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 230.38 -> 284.58 |
| 14% | welcome fcp | windows10-64-shippable-qr | cold fission webrender | 94.52 -> 107.96 |
| 8% | welcome fcp | linux1804-64-shippable-qr | cold fission webrender | 109.44 -> 118.58 |
| 6% | welcome PerceptualSpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 1,428.92 -> 1,508.67 |
| 5% | welcome PerceptualSpeedIndex | macosx1015-64-shippable-qr | fission warm webrender | 1,320.71 -> 1,387.25 |
Improvements:
| Ratio | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|
| 31% | welcome FirstVisualChange | windows10-64-shippable-qr | cold fission webrender | 173.33 -> 120.00 |
| 28% | welcome FirstVisualChange | linux1804-64-shippable-qr | cold fission webrender | 180.00 -> 130.00 |
| 27% | welcome ContentfulSpeedIndex | windows10-64-shippable-qr | fission warm webrender | 532.08 -> 387.67 |
| 25% | welcome ContentfulSpeedIndex | linux1804-64-shippable-qr | fission warm webrender | 535.46 -> 400.58 |
| 22% | welcome ContentfulSpeedIndex | macosx1015-64-shippable-qr | fission warm webrender | 1,688.79 -> 1,324.00 |
| ... | ... | ... | ... | ... |
| 5% | welcome FirstVisualChange | macosx1015-64-shippable-qr | cold fission webrender | 1,296.67 -> 1,230.00 |
For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33996
Description
•