Closed Bug 1401886 Opened 7 years ago Closed 7 years ago

2.03 - 5.05% damp (linux64, osx-10-10, windows10-64, windows7-32) regression on push 2fb9198e5a1d (Wed Sep 20 2017)

Categories

(DevTools :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: igoldan, Unassigned)

References

Details

(Keywords: perf, regression, talos-regression)

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=1bd12fd8c15ec2cf6959967be015f5eb080e4ecd&tochange=2fb9198e5a1dd2f007d342386f049f584650bc28

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

  5%  damp summary osx-10-10 opt e10s     280.51 -> 294.68
  5%  damp summary windows7-32 pgo e10s   219.38 -> 230.34
  3%  damp summary windows10-64 opt e10s  263.41 -> 270.25
  2%  damp summary linux64 opt e10s       252.12 -> 258.20
  2%  damp summary windows7-32 opt e10s   281.45 -> 287.16


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=9576

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling
Component: Untriaged → Developer Tools
Alexandre, should these be the new baselines for the DAMP test? If there's nothing fishing with these results, I would resolve this as WONTFIX.
Flags: needinfo?(poirot.alex)
Thanks for the report.

Yes this is the new baselines.
There is nothing wrong if you look at subtests:
  https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=autoland&originalRevision=905ddac6491cca547135660ad0abdc75380002b4&newProject=autoland&newRevision=969ff8612b148e51b3cafaa369859ca2ffbb8425&originalSignature=1f8aed46624975327d00a6b936cee2c09768ef5d&newSignature=1f8aed46624975327d00a6b936cee2c09768ef5d&framework=1

But I introduced a new subtest "damp cold.inspector.open.DAMP" which bumps the summary number.

FYI, you may see more activity around DAMP results as a consequence of bug 1397751.
Do not hesitate to ping me if that introduces any issue for you.
Flags: needinfo?(poirot.alex)
(In reply to Alexandre Poirot [:ochameau] from comment #2)
> FYI, you may see more activity around DAMP results as a consequence of bug
> 1397751.
> Do not hesitate to ping me if that introduces any issue for you.
Thanks for the heads up.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
Product: Firefox → DevTools
You need to log in before you can comment on or make changes to this bug.