Closed Bug 1677972 Opened 5 years ago Closed 5 years ago

16.22 - 58.49% google LastVisualChange / instagram *SpeedIndex (android-hw-g5-7-0-arm7-api-16-shippable, android-hw-p2-8-0-android-aarch64-shippable) regression on push f488d4345f75ec8a97b029a7dd929fa38a1a4434 (Sat November 14 2020)

Categories

(Core :: Layout, defect)

Product:
Core
Component:
Layout
Version:
Firefox 85
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
85 Branch
Tracking Flags:
Tracking Status
firefox-esr78 --- unaffected
firefox83 --- unaffected
firefox84 --- fixed
firefox85 --- fixed

People

(Reporter: alexandrui, Assigned: smaug)

References

(Regression)

Details

(Keywords: perf, perf-alert, regression)

Perfherder has detected a browsertime performance regression from push f488d4345f75ec8a97b029a7dd929fa38a1a4434. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio Suite Test Platform Options Absolute values (old vs new)
58% reddit loadtime android-hw-p2-8-0-android-aarch64-shippable cold webrender 1,451.56 -> 2,300.54
58% reddit loadtime android-hw-p2-8-0-android-aarch64-shippable cold webrender 1,447.79 -> 2,291.08
36% google LastVisualChange android-hw-p2-8-0-android-aarch64-shippable cold webrender 507.42 -> 691.50
26% instagram ContentfulSpeedIndex android-hw-g5-7-0-arm7-api-16-shippable warm webrender 791.42 -> 1,000.08
16% instagram SpeedIndex android-hw-p2-8-0-android-aarch64-shippable cold webrender 1,322.54 -> 1,537.08

Improvements:

Ratio Suite Test Platform Options Absolute values (old vs new)
11% ebay-kleinanzeigen-search ContentfulSpeedIndex android-hw-p2-8-0-android-aarch64-shippable warm webrender 601.62 -> 536.75
8% web-de LastVisualChange android-hw-g5-7-0-arm7-api-16-shippable cold webrender 2,810.50 -> 2,586.00

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Flags: needinfo?(bugs)
Component: Performance → Layout
Product: Testing → Core

Hmm, that is unfortunate.

Assignee: nobody → bugs
Flags: needinfo?(bugs)

The alert below is raptor
== Change summary for alert #27736 (as of Thu, 19 Nov 2020 04:43:26 GMT) ==

Improvements:

Ratio Suite Test Platform Options Absolute values (old vs new)
6% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable 1,813.46 -> 1,710.33
4% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable 1,798.92 -> 1,719.92

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=27736

Backout regression:
== Change summary for alert #27856 (as of Wed, 25 Nov 2020 08:06:36 GMT) ==

Regressions:

Ratio Suite Test Platform Options Absolute values (old vs new)
104% raptor-tp6-slides-firefox-cold loadtime windows10-64-shippable 2,281.54 -> 4,665.58
4% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable-qr webrender 1,708.83 -> 1,773.50
3% raptor-tp6-office-firefox-cold loadtime windows10-64-shippable 2,237.12 -> 2,304.33
2% raptor-tp6-office-firefox-cold loadtime windows10-64-shippable 2,249.46 -> 2,300.08

Improvements:

Ratio Suite Test Platform Options Absolute values (old vs new)
4% raptor-tp6-docs-firefox-cold windows10-64-shippable-qr webrender 782.99 -> 754.96

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=27856

== Change summary for alert #27784 (as of Fri, 20 Nov 2020 12:51:09 GMT) ==

Regressions:

Ratio Suite Test Platform Options Absolute values (old vs new)
4% twitter ContentfulSpeedIndex linux64-shippable-qr nocondprof warm webrender 739.41 -> 769.83
3% linkedin ContentfulSpeedIndex linux64-shippable cold nocondprof 1,553.44 -> 1,598.25

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=27784

Backout regression:
== Change summary for alert #27912 (as of Wed, 02 Dec 2020 07:58:02 GMT) ==

Regressions:

Ratio Suite Test Platform Options Absolute values (old vs new)
3% raptor-tp6-youtube-firefox-cold windows10-64-shippable-qr webrender 891.80 -> 914.78
2% raptor-tp6-youtube-firefox-cold windows10-64-shippable-qr webrender 895.50 -> 915.80

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=27912

This should be fixed by backout.

Status: NEW → RESOLVED
Closed: 5 years ago
status-firefox83: --- → unaffected
status-firefox84: --- → fixed
status-firefox85: affected → fixed
status-firefox-esr78: --- → unaffected
Resolution: --- → FIXED
Target Milestone: --- → 85 Branch
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.