1611190 - 5.15% tp5n nonmain_startup_fileio (windows7-32-shippable) regression on push 50c371b37a9fcd994a5866db73bd0d078e19f95d (Wed January 22 2020)

Status: RESOLVED WONTFIX

(Toolkit :: Telemetry, defect)

Description

[Marian Raiciof [:marauder]]

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=50c371b37a9fcd994a5866db73bd0d078e19f95d

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

5% tp5n nonmain_startup_fileio windows7-32-shippable opt e10s stylo 3,232,769.88 -> 3,399,120.42

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=24777

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/TestEngineering/Performance/Talos

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/TestEngineering/Performance/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/TestEngineering/Performance/Talos/RegressionBugsHandling

Comment 1

[Jan-Erik Rediger [:janerik]]

I don't see how that one patch can make a difference here, it's merely using a different (temp) directory now.
Could this just be the same as in 1611101?

Comment 2

[Marian Raiciof [:marauder]]

Ok , i will mark this as won't fix. Thanks!

And looking at the graph, after ~ 2 days there is an improvement from another patch
https://treeherder.mozilla.org/perf.html#/graphs?highlightAlerts=1&series=autoland,1922255,1,1&series=mozilla-inbound,1946449,1,1&timerange=2592000&zoom=1579668778701,1579976586526,2805729.3772975625,3819197.8737775213