Closed Bug 869694 Opened 10 years ago Closed 10 years ago

enable layout/reftests/bugs on android


(Core :: Layout, defect)

Not set





(Reporter: tnikkel, Assigned: jmaher)




(1 file, 2 obsolete files)

I think this is an important omission.

It's enabled on b2g.
Here is a try run with about 60 failures
A good chunk are unexpected passes, I think most of the failures are annotated as skip or fails on b2g already, and there are some after that to look at still.
this might be a quick fix.  Our bar for turning on new android tests is to run each test suite (chunk in this case) 10 times and have consistent results.
this is my second attempt to fix this.  My first attempt missed a couple instances.  This patch is up on try server right now:

If this looks good we can review and turn on hundreds of additional reftests for android.
Looking good on try server:
Assignee: tnikkel → jmaher
Attachment #746960 - Attachment is obsolete: true
Attachment #747199 - Flags: review?(tnikkel)
Comment on attachment 747199 [details] [diff] [review]
fix the bugs/reftest.list manifest to support android (2.0)

Yay! Thanks Joel for picking this up so quickly that I didn't even have a chance to get to it.

It's great that we'll have coverage for one of the most important reftest directories on android.

Any particular reason that the first few annotations are skip-if(Android) and the rest are fails-if(Android)? I think fails-if is better, but that's a nit.

I'm going to try to go through the tests that fail and see if any of them point out any major problems that we should have bugs filed on.
Attachment #747199 - Flags: review?(tnikkel) → review+
Updated to change most of the skip-if to fails-if and tested on try!  In all my testing I have seen a couple random failures crop up from this, we are looking at those being really random orange, not some 20%+ of the time thing.
Attachment #747199 - Attachment is obsolete: true
Attachment #747432 - Flags: review+
Depends on: 870620
I marked two fails-if as random-if because they were passing sometimes.
Closed: 10 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla23
753329-1.html also likes to pass from time to time.
Depends on: 870764
You need to log in before you can comment on or make changes to this bug.