1420364 - 2.34 - 9.41% damp (linux64, windows10-64, windows7-32) regression on push f15c8bf67a902e68b0edc508da4da2b65a85c588 (Thu Nov 23 2017)

Status: RESOLVED WONTFIX

(DevTools :: General, defect)

Description

[Ionuț Goldan [:igoldan]]

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=f15c8bf67a902e68b0edc508da4da2b65a85c588

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

  9%  damp summary windows7-32 opt e10s     297.99 -> 326.02
  9%  damp summary windows10-64 opt e10s    281.77 -> 306.35
  5%  damp summary linux64 opt e10s         291.16 -> 306.00
  5%  damp summary linux64 pgo e10s         263.60 -> 276.01
  2%  damp summary windows10-64 pgo e10s    242.18 -> 247.84

Improvements:

  3%  damp summary osx-10-10 opt e10s     339.76 -> 330.65
  0%  damp summary windows7-32 pgo e10s   243.89 -> 243.22


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=10717

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling

Comment 1

[Ionuț Goldan [:igoldan]]

:ochameau I see you added 3 new DAMP subtests, which explain the regression. I guess we can accept this, like we did with bug 1419766?

Comment 2

[Alexandre Poirot [:ochameau]]

Yes, bug 1415532 added multiple tests that are quite slow to run.
Expect same reports for all the similar bugs:
bug 1419326, bug 1419327, bug 1419328.