1395115 - 5.02% tsvg_static (windows7-32) regression on push f0d5588153e4 (Mon Aug 28 2017)

Status: RESOLVED INVALID

(Firefox :: New Tab Page, defect)

Description

[Ionuț Goldan [:igoldan]]

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=156c3f4e0b16462e1d86f2e9b6587e6ed861be59&tochange=f0d5588153e4981f61601ada9d61e7ebab7cb58f

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

  5%  tsvg_static summary windows7-32 pgo e10s     51.73 -> 54.32


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=9049

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling

Comment 1

[Ionuț Goldan [:igoldan]]

Ed, this Windows7 PGO regression may be just a temporary one and it will probably return to normal by itself. This happens regularly on Windows. I say this because the equivalent OPT build actually notifies a perf improvement.

Either way, if you can find a reason for this happening, please mention it.
I mostly filed this bug purely for tracking reasons and it probably end up as a WONTFIX or WORKSFORME.

Comment 2

[Jim Mathies [:jimm]]

9049 appears to be a regression filed against an intermittent talos issue - 

https://treeherder.mozilla.org/perf.html#/graphs?timerange=2592000&series=autoland,1455491,1,1&series=mozilla-inbound,1455996,0,1&zoom=1503667539601.2163,1504158967609.9045,45.842696629213485,58.42696629213483&selected=%5Bautoland,18cf40355e5b20164ab9307f83dd6d6eb6184aa8,245727,321195626,1%5D