1562644 - 23.16 - 67.07% raptor-tp6m-google-geckoview-cold (android-hw-g5-7-0-arm7-api-16, android-hw-p2-8-0-android-aarch64, android-hw-p2-8-0-arm7-api-16) regression on push f1e18585f322927a27f43b4d402fa991cd5340a4 (Wed June 26 2019)

Status: RESOLVED FIXED

(Testing :: General, defect, P3)

Description

[Florin Strugariu [:Bebe]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=f1e18585f322927a27f43b4d402fa991cd5340a4

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

67% raptor-tp6m-google-geckoview-cold loadtime android-hw-p2-8-0-android-aarch64 pgo 527.42 -> 881.17
65% raptor-tp6m-google-geckoview-cold loadtime android-hw-p2-8-0-android-aarch64 opt 540.42 -> 892.00
65% raptor-tp6m-google-geckoview-cold loadtime android-hw-p2-8-0-arm7-api-16 opt 545.38 -> 898.42
64% raptor-tp6m-google-geckoview-cold loadtime android-hw-p2-8-0-arm7-api-16 opt 549.33 -> 902.42
58% raptor-tp6m-google-geckoview-cold android-hw-p2-8-0-android-aarch64 pgo 284.89 -> 450.60
57% raptor-tp6m-google-geckoview-cold android-hw-p2-8-0-android-aarch64 opt 293.71 -> 460.91
56% raptor-tp6m-google-geckoview-cold android-hw-p2-8-0-arm7-api-16 opt 297.53 -> 463.04
46% raptor-tp6m-google-geckoview-cold fcp android-hw-p2-8-0-android-aarch64 pgo 273.83 -> 399.83
44% raptor-tp6m-google-geckoview-cold fcp android-hw-p2-8-0-android-aarch64 opt 283.67 -> 409.67
44% raptor-tp6m-google-geckoview-cold fcp android-hw-p2-8-0-arm7-api-16 opt 285.25 -> 410.50
43% raptor-tp6m-google-geckoview-cold loadtime android-hw-g5-7-0-arm7-api-16 pgo 948.67 -> 1,357.92
40% raptor-tp6m-google-geckoview-cold loadtime android-hw-g5-7-0-arm7-api-16 opt 995.12 -> 1,389.25
36% raptor-tp6m-google-geckoview-cold android-hw-g5-7-0-arm7-api-16 pgo 530.48 -> 722.71
32% raptor-tp6m-google-geckoview-cold android-hw-g5-7-0-arm7-api-16 opt 555.09 -> 730.10
26% raptor-tp6m-google-geckoview-cold fcp android-hw-g5-7-0-arm7-api-16 pgo 534.92 -> 674.58
23% raptor-tp6m-google-geckoview-cold fcp android-hw-g5-7-0-arm7-api-16 opt 554.58 -> 683.00

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=21655

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/Performance_sheriffing/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Comment 1

[Florin Strugariu [:Bebe]]

Alex can you fix this?

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

bebe, I think he code was already cleaned up. What do you want me to do?

Comment 3

[Florin Strugariu [:Bebe]]

you updated raptor-tp6m-cold-2.ini to mitm 4.0.4 we need to revert that cchange

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

The priority flag is not set for this bug.
:gbrown, could you have a look please?

For more information, please visit auto_nag documentation.

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

:bebe has this been resolved via your work on the re-recordings?

Comment 6

[Florin Strugariu [:Bebe]]

Yes this was fixed in Bug 1563660 - Fix tp6m-google updated with tp6m-youtube