Closed Bug 1259919 Opened 9 years ago Closed 9 years ago

2% tcanvasmark pgo (windows7-32, windows8-64, windowsxp) regression on push 8d59e338a5bd (Thu Mar 24 2016)

Categories

(Core :: General, defect)

defect
Not set
normal

Tracking

()

RESOLVED DUPLICATE of bug 1259923

People

(Reporter: jmaher, Unassigned)

References

Details

(Keywords: perf, Whiteboard: [talos_regression])

Talos has detected a Firefox performance regression from push 8d59e338a5bd. As author of one of the patches included in that push, we need your help to address this regression. This is a list of all known regressions and improvements related to the push: https://treeherder.mozilla.org/perf.html#/alerts?id=612 On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format. To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests#CanvasMark Reproducing and debugging the regression: If you would like to re-run this Talos test on a potential fix, use try with the following syntax: try: -b o -p win32,win64 -u none -t chromez[Windows XP,Windows 7,Windows 8],chromez-e10s[Windows XP,Windows 7,Windows 8] --rebuild 5 # add "mozharness: --spsProfile" to generate profile data (we suggest --rebuild 5 to be more confident in the results) To run the test locally and do a more in-depth investigation, first set up a local Talos environment: https://wiki.mozilla.lorg/Buildbot/Talos/Running#Running_locally_-_Source_Code Then run the following command from the directory where you set up Talos: talos --develop -e [path]/firefox -a tcanvasmark (add --e10s to run tests in e10s mode) Making a decision: As the patch author we need your feedback to help us handle this regression. Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling
:gps, I thought this was related to the vs2015 compiler change, but it looks to be on the push prior. In fact all the performance changes are on pgo for vs2015 except for tcanvasmark opt which has slight wins. Maybe this is something to do with a clobber or something else? It would be nice to figure this out.
Flags: needinfo?(gps)
Component: Untriaged → General
Product: Firefox → Core
I don't see how this could possibly be related to bug 1256027. Since it is a PGO regression, my guess is it is a regression between this commit (https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=8d59e338a5bd) and the last PGO builds on inbound from before. That would be https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=b74d0709e0a5. But it looks like you triggered extra Talos jobs on that and I don't see how the commits in between could possibly cause a performance change. WTF.
Flags: needinfo?(gps)
I have done some try pushes, before/after: https://treeherder.mozilla.org/#/jobs?repo=try&author=jmaher@mozilla.com&fromchange=2d29268052e7&tochange=8613b844e390 lets see if this reproduces or not.
here is the compare: https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=8613b844e390&newProject=try&newRevision=2d29268052e7&framework=1&showOnlyImportant=0 the regression isn't showing, this must be related to the actual vs2015 change- odd that it showed up in the push prior. In this case, maybe this is one of those issues with per build differences. :wlach, as I will be on pto next week, can you handle sorting out the alerts in perfherder so we have this catalogued properly- my recommendation is to duplicate this bug to bug 1259923.
Flags: needinfo?(wlachance)
Yeah, let's mark this one as a duplicate.
Status: NEW → RESOLVED
Closed: 9 years ago
Flags: needinfo?(wlachance)
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.