990101 - 15% tprovider android 2.2 regression on fx-team when bug 986114 landed

Status: RESOLVED WONTFIX

(Firefox for Android Graveyard :: Data Providers, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

we have a regression in the tprovider test and it appears that it is related to bug 986114.  This appears to be on android 2.2 as a regression, but a little improvement on android 4.0.

here is a graph showing the regression:
http://graphs.mozilla.org/graph.html#tests=[[200,64,20]]&sel=none&displayrange=7&datatype=running

for android 4.0, here is the graph:
http://graphs.mozilla.org/graph.html#tests=[[200,64,29]]&sel=none&displayrange=30&datatype=running

Comment 1

[Richard Newman [:rnewman]]

The test sucks, even after I made it suck less. Most likely the 5-second wait to allow the UI to finish querying* isn't enough on our slow 2.2 devices.

The test isn't giving us useful absolute data, so we should simply ignore this, and only pay attention to relative changes in the future.



* Yes, for a DB perf test we have a UI showing, displaying data from a *different profile*, and acting on update change notifications for the wrong profile. See what I mean by "sucks"?

I'll be filing a bug re that later today.