All users were logged out of Bugzilla on October 13th, 2018
We have had 10 N810s running on test harnesses and flash cards for about 5 days now. We should compare the tests to see if there is a noticeable difference in performance numbers.
maemo-n810-01, 11, 13, 15, 17, 20, 30, 35, 37 have been running on sd cards and test harness, maemo-n810-26 has been running only on test harness and maemo-n810-22 was running only on sd card
Created attachment 401898 [details] performance comparison Here is a comparison. I can't guarantee that i have the same mobile-browser change set. For the flash runs there were 3 options and i picked the latest one for the matching flash run. It looks like there is a larger difference than i had found before.
It seems that TS was one area where we didn't have enough data points to check variance. Here are the links we can compare with. Only look at runs after 4:30PM Pacific on Sept 21 SD Card TS runs: http://graphs-stage-old.mozilla.org/#show=469960,734948,737207,869266,865130,951859,946626,946515,945985 Flash Card TS runs: http://graphs-stage-old.mozilla.org/#show=463605,463614,463617,469949,469951,469956,469958,469962,495593,495595,735197,736058,866588,867690,945871,945885,945893,945937,945939,945967,945997,946050,946054,946186,946259,946404,946497,946535,946551,947154,948183
Flash Card Tdhtml runs: http://graphs-stage-old.mozilla.org/#show=470093,470095,470139,470165,470273,470341,495630,495632,735366,736200,866751,867919,945877,945891,945925,945929,945959,945973,945995,946077,946099,946107,946131,946184,946244,946284,946406,946495,946528,946611,946937,949846 SD Card Tdhtml Runs: http://graphs-stage-old.mozilla.org/#show=470252,735091,737329,945929,946484,946655,946845
Flash Card Tgfx runs: http://graphs-stage-old.mozilla.org/#show=735313,946081,946635 SD Card Tgfx runs: http://graphs-stage-old.mozilla.org/#show=735376,470236,865230,869458,945955,946670,946855
We are changing numbers here and changing the amount of variance -- sometimes for the better, sometimes for the worse. Since I don't see anything that screams "markedly worse" and the sd cards will allow us to roll out new images faster, shipit.
Ok. Txul -- 3700-3900 -> 3700-3900 about the same Tgfx -- 515-527 -> 485-500 (drop ~30) Tsvg -- 16200-17300 -> 16000-17600. 04 is an outlier, we should keep an eye on it. Slight variance increase, though we're talking about more devices. Tdhtml -- 3675-3760 -> 3550-3900 increase in variance Ts -- 8200-8760 -> 8000-8800 slight increase in variance Tp3 -- 6950-7200 -> 6850-7200 slight increase in variance We're comparing the results of 10 sd card devices against 3 non-sd card devices against the same build over ~18 hours. Again, nothing that screams markedly worse to me.
Status: NEW → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.