1255852 - tscrollx non-e10s generates bimodal results for XP

Status: RESOLVED WONTFIX

(Testing :: Talos, defect)

Description

[Jim Mathies [:jimm]]

https://treeherder.mozilla.org/perf.html#/graphs?series=%5Bmozilla-inbound,e53c1976b87e14717c55e2fef497df67c65e7a6b,1&series=%5Bmozilla-inbound,4ead7c1e86c43b4b5f62b0aebb386c9b963353b5,1%5D

Would be nice if we could dig into why this is happening and try to fix it.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

in fact win7 and win8 are bi-modal as well:
https://treeherder.mozilla.org/perf.html#/graphs?series=%5Bmozilla-inbound,e53c1976b87e14717c55e2fef497df67c65e7a6b,1%5D&series=%5Bmozilla-inbound,9b3b3cd2244b08a3e1debe805d09ad7f13f8410f,1%5D&series=%5Bmozilla-inbound,33e3188118eab9e8c9a19a3050fed4fe392a316d,1%5D

linux64 is stable :)

I don't see any change in this trend over the last few months- so this seems to not be affected by weekends/load.  WinXP has the largest difference between the low and high modes, probably worth spending a small amount of time looking into- there could be an easy win there.

One thought to look into it is spsProfiling.  If we collect profiling info on a low value vs a high value we could end up seeing the difference easily.


here is some raw data from a high point on inbound (http://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-inbound-win32/1457714176/mozilla-inbound_xp-ix_test-svgr-bm119-tests1-windows-build2628.txt.gz):
{"lowerIsBetter": true, "subtests": [{"lowerIsBetter": true, "replicates": [2.065233918128655, 2.0857602339181285, 2.0340350877192988, 1.9275730994152052, 1.9683333333333335, 1.9579532163742688, 2.022690058479532, 2.0202631578947368, 1.9811988304093566, 1.9344152046783627, 1.9475438596491226, 2.407251461988304, 2.000321637426901, 1.9598538011695905, 2.064561403508772, 2.0629239766081873, 1.9944152046783623, 1.9973391812865502, 1.95046783625731, 1.957982456140351, 1.9406432748538016, 1.9662280701754384, 2.0049415204678365, 1.9579532163742688, 1.9029532163742693], "unit": "ms", "name": "tiled.html", "value": 1.9737134502923976}, {"lowerIsBetter": true, "replicates": [3.9845614035087715, 3.953654970760234, 3.974883040935673, 3.9492982456140346, 3.9846783625730993, 3.9749415204678358, 3.972046783625731, 3.9553801169590646, 3.9763157894736847, 3.9817251461988303, 3.950263157894737, 4.044269005847953, 3.976257309941521, 3.9560233918128658, 3.9834795321637424, 3.9540350877192982, 3.9817836257309933, 3.962105263157895, 3.978333333333334, 3.9501169590643275, 3.963421052631579, 4.01187134502924, 3.955672514619883, 3.9919883040935678, 3.9786549707602346], "unit": "ms", "name": "tiled-fixed.html", "value": 3.9755994152046785}, {"lowerIsBetter": true, "replicates": [2.1694736842105264, 2.033333333333333, 2.108830409356725, 2.1689766081871342, 2.0741812865497073, 2.061666666666667, 2.0279824561403506, 2.080701754385965, 2.027543859649123, 2.063099415204678, 2.0656725146198833, 2.0344152046783623, 2.034473684210526, 2.13046783625731, 2.14780701754386, 2.090380116959065, 2.0534502923976605, 2.0521637426900585, 2.0557017543859653, 2.0973391812865496, 2.035146198830409, 2.1381286549707608, 2.145614035087719, 2.152251461988304, 2.094649122807018], "unit": "ms", "name": "tiled-downscale.html", "value": 2.0643859649122804}, {"lowerIsBetter": true, "replicates": [4.145760233918129, 4.185204678362573, 4.146461988304093, 4.172923976608187, 4.152134502923977, 4.207076023391813, 4.144970760233918, 4.173684210526315, 4.168596491228071, 4.182309941520468, 4.153157894736842, 4.306929824561403, 4.1687134502923975, 4.18546783625731, 4.2457894736842094, 4.1696783625731, 4.1548830409356725, 4.180497076023393, 4.163070175438596, 4.187690058479532, 4.158947368421052, 4.1804385964912285, 4.163040935672515, 4.156578947368422, 4.163625730994153], "unit": "ms", "name": "tiled-fixed-downscale.html", "value": 4.169195906432749}, {"lowerIsBetter": true, "replicates": [3.0120348837209296, 3.194825581395349, 3.212209302325582, 3.0332558139534878, 2.9045348837209297, 2.8967441860465124, 3.1230813953488368, 3.01813953488372, 2.980755813953488, 3.0158139534883723, 3.20639534883721, 2.9838372093023255, 2.968372093023256, 2.9656395348837212, 2.9331976744186052, 2.9372674418604654, 3.209127906976745, 2.9912209302325574, 2.9769186046511624, 2.9694767441860463, 2.9649999999999994, 2.9525581395348834, 2.961046511627907, 3.027848837209302, 2.974883720930233], "unit": "ms", "name": "iframe.svg", "value": 2.9759011627906977}, {"lowerIsBetter": true, "replicates": [4.131184971098266, 4.1666473988439305, 4.153728323699421, 4.176618497109827, 4.132312138728325, 4.2008670520231215, 4.128554913294797, 4.145491329479769, 4.122398843930636, 4.152369942196531, 4.129508670520231, 4.161531791907515, 4.1321387283237, 4.155404624277456, 4.128930635838151, 4.12471098265896, 4.1297398843930635, 4.129335260115607, 4.146069364161851, 4.122427745664741, 4.16364161849711, 4.1292485549132945, 4.125635838150289, 4.124884393063583, 4.140231213872832], "unit": "ms", "name": "reader.htm", "value": 4.129624277456648}], "name": "tscrollx", "value": 3.1042961122435573}


and here is some data from a low point on inbound (http://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-inbound-win32/1457715614/mozilla-inbound_xp-ix_test-svgr-bm126-tests1-windows-build738.txt.gz):
{"lowerIsBetter": true, "subtests": [{"lowerIsBetter": true, "replicates": [1.974327485380117, 1.9195614035087722, 1.9655555555555557, 1.9298538011695903, 1.9402923976608188, 1.9373976608187136, 1.9259356725146202, 1.954122807017544, 2.007690058479532, 1.9528654970760233, 1.9301461988304094, 1.9500000000000002, 1.972514619883041, 1.9659941520467834, 1.983567251461988, 1.9435964912280703, 1.9476900584795318, 1.952426900584795, 1.9537426900584798, 1.9811695906432751, 1.9555263157894736, 1.9667543859649124, 1.96593567251462, 1.921637426900585, 1.9549707602339186], "unit": "ms", "name": "tiled.html", "value": 1.953932748538012}, {"lowerIsBetter": true, "replicates": [2.9662573099415206, 2.9635087719298245, 2.967456140350877, 2.9687719298245616, 2.9657017543859654, 2.968157894736842, 2.9648245614035087, 2.9925730994152047, 2.965263157894737, 2.9735964912280703, 2.9684210526315793, 3.011140350877193, 2.967222222222222, 3.6240350877192986, 2.9875146198830413, 2.9656140350877194, 2.968421052631579, 2.9672222222222224, 2.9684210526315793, 2.9665497076023395, 2.96719298245614, 2.9626900584795326, 2.967105263157895, 2.9640643274853797, 2.965877192982456], "unit": "ms", "name": "tiled-fixed.html", "value": 2.9672222222222224}, {"lowerIsBetter": true, "replicates": [2.1839181286549705, 2.0625438596491232, 2.0853508771929823, 2.016959064327485, 2.052953216374269, 2.0668713450292397, 2.041666666666667, 2.0395614035087717, 2.0330701754385965, 2.001900584795322, 2.0688011695906434, 2.0738011695906438, 2.000730994152047, 2.0469883040935675, 2.031374269005848, 2.066666666666667, 2.033391812865497, 2.0439766081871347, 2.1216666666666666, 2.022543859649123, 2.0815789473684214, 2.0411988304093565, 2.0482456140350873, 2.0366374269005845, 2.0933333333333337], "unit": "ms", "name": "tiled-downscale.html", "value": 2.0428216374269006}, {"lowerIsBetter": true, "replicates": [3.1673099415204677, 3.1675730994152054, 3.169239766081872, 3.1961988304093563, 3.168830409356725, 3.167397660818713, 3.168070175438596, 3.1649122807017545, 3.1646491228070173, 3.2218421052631583, 3.1953216374269005, 3.1630409356725147, 3.1708479532163745, 3.168362573099415, 3.1634502923976613, 3.1677777777777782, 3.1681578947368423, 3.1840058479532165, 3.1685672514619885, 3.1679239766081873, 3.1674561403508776, 3.1691228070175437, 3.1675438596491228, 3.168011695906433, 3.1912573099415202], "unit": "ms", "name": "tiled-fixed-downscale.html", "value": 3.168040935672514}, {"lowerIsBetter": true, "replicates": [2.865581395348838, 2.8506976744186048, 2.902441860465117, 2.8539534883720936, 2.864244186046511, 2.8670930232558147, 2.877441860465116, 2.833313953488372, 2.874651162790698, 2.8892441860465117, 2.974418604651163, 2.866162790697675, 3.070930232558139, 2.868197674418605, 2.860930232558139, 2.861744186046512, 2.8582558139534884, 2.823779069767442, 2.8846511627906977, 2.8831976744186045, 2.8899418604651164, 2.8586046511627905, 2.887267441860465, 2.809127906976744, 2.8624418604651156], "unit": "ms", "name": "iframe.svg", "value": 2.86764534883721}, {"lowerIsBetter": true, "replicates": [3.2435260115606934, 3.226763005780347, 3.2229479768786122, 3.2278034682080925, 3.228034682080925, 3.231387283236994, 3.2262716763005788, 3.227456647398844, 3.2275722543352603, 3.2233236994219654, 3.227254335260116, 3.2252890173410407, 3.2361849710982664, 3.226647398843931, 3.2285260115606933, 3.2397687861271676, 3.2228323699421964, 3.254306358381503, 3.2259826589595377, 3.254421965317919, 3.2256936416184976, 3.226936416184971, 3.22528901734104, 3.2217341040462424, 3.2519364161849706], "unit": "ms", "name": "reader.htm", "value": 3.2270953757225436}], "name": "tscrollx", "value": 2.666604346769408}


maybe analyzing per page and trends on that could help shed light.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

we don't run on winxp anymore