1361573 - tp5n nonmain_startup_fileio opt (with or without e10s) on windows7-32 has very different numbers between Try and m-c

Status: RESOLVED DUPLICATE of bug 1274018

(Testing :: Talos, defect)

Description

[Matthew N. [:MattN]]

This test seems to consistently report a higher result for mozilla-central compared to Try even for an identical revision. In other words, if you are comparing Try and Mozilla-Central you may see a false-positive regression on perfherder.

This makes comparisons between Try and mozilla-central report false-positive regressions.

Example graphs:
Non-e10s: https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=%5Bmozilla-central,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D&series=%5Btry,e5f5eaa174ef22fdd6b6e150e8c450aa827c2ff6,1,1%5D

E10s: https://treeherder.mozilla.org/perf.html#/graphs?series=%5B%22mozilla-central%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&series=%5B%22try%22,%222f3af3833d55ff371ecf01c41aeee1939ef3a782%22,1,1%5D&timerange=604800

Comment 1

[Matthew N. [:MattN]]

I guess this is a dupe of bug 1274018