1539727 - 16.34 - 30.4% raptor-tp6m (android-hw-g5-7-0-arm7-api-16-pgo, android-hw-p2-8-0-android-aarch64) regression on push 6bfa4f84a0307f0ac205834600e5dcf57b097577 (Tue Mar 26 2019)

Status: RESOLVED WONTFIX

(Core :: Layout, defect, P3)

Description

[Ionuț Goldan [:igoldan]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?changeset=6bfa4f84a0307f0ac205834600e5dcf57b097577

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

30% raptor-tp6m-bing-restaurants-geckoview loadtime android-hw-p2-8-0-android-aarch64 opt 123.44 -> 160.96
20% raptor-tp6m-amazon-geckoview loadtime android-hw-g5-7-0-arm7-api-16-pgo opt 510.19 -> 612.38
16% raptor-tp6m-google-geckoview loadtime android-hw-g5-7-0-arm7-api-16-pgo opt 140.00 -> 162.88

Improvements:

74% raptor-tp6m-instagram-geckoview fcp android-hw-p2-8-0-android-aarch64 opt 647.58 -> 167.38
49% raptor-tp6m-ebay-kleinanzeigen-geckoview fcp android-hw-p2-8-0-android-aarch64 opt 573.25 -> 291.71
43% raptor-tp6m-ebay-kleinanzeigen-search-geckoview fcp android-hw-p2-8-0-android-aarch64 opt 612.06 -> 347.62
37% raptor-tp6m-facebook-geckoview fcp android-hw-g5-7-0-arm7-api-16-pgo opt 1,205.21 -> 760.21
35% raptor-tp6m-instagram-geckoview android-hw-p2-8-0-android-aarch64 opt 684.37 -> 444.19
29% raptor-tp6m-ebay-kleinanzeigen-search-geckoview android-hw-p2-8-0-android-aarch64 opt 1,106.91 -> 788.88
18% raptor-tp6m-youtube-geckoview android-hw-g5-7-0-arm7-api-16-pgo opt 511.90 -> 420.54
10% raptor-tp6m-google-geckoview fcp android-hw-g5-7-0-arm7-api-16-pgo opt 258.35 -> 232.04

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=20123

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/Performance_sheriffing/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Comment 1

[Olli Pettay [:smaug][[e-mail]]]

Please don't back out because fcp improvements.

Also, I want to see whether bug 1538517 stabilizes the numbers a bit.

Comment 2

[Olli Pettay [:smaug][[e-mail]]]

I think overall there has been more improvements, even for page load.
https://health.graphics/android/tp6m?test=loadtime&platform=android-hw-p2-8-0-android-aarch64

Comment 3

[Florin Strugariu [:Bebe]]

As there are no plans to fix the android regressions can we mark this as won't fix?

Comment 4

[Olli Pettay [:smaug][[e-mail]]]

Per comment 2, no plans to change anything here.