Last Comment Bug 807970 - B2G Reftests should replace shell.xul with reftest.xul
: B2G Reftests should replace shell.xul with reftest.xul
Status: NEW
Product: Testing
Classification: Components
Component: Reftest (show other bugs)
: unspecified
: All All
-- normal (vote)
: ---
Assigned To: Nobody; OK to take it and work on it
Depends on:
Blocks: b2g-reftest
  Show dependency treegraph
Reported: 2012-11-02 06:33 PDT by Andrew Halberstadt [:ahal]
Modified: 2013-08-22 07:32 PDT (History)
3 users (show)
See Also:
Crash Signature:
QA Whiteboard:
Iteration: ---
Points: ---

first attempt (13.80 KB, patch)
2013-01-16 14:01 PST, Andrew Halberstadt [:ahal]
no flags Details | Diff | Splinter Review
second attempt (16.41 KB, patch)
2013-01-24 13:08 PST, Andrew Halberstadt [:ahal]
no flags Details | Diff | Splinter Review

Description User image Andrew Halberstadt [:ahal] 2012-11-02 06:33:37 PDT
In bug 798580 and bug 805829 we discovered that we were setting the dom.browser_frames.oop_by_default pref to "true" in our B2G mochitests which causes an exception in shell.js (since it was written under the assumption that the browserFrame iframe is in process).

Reftests do the same thing. I'm not sure if it's responsible for any of the issues/failing tests but it can't hurt to fix. Ideally the reftests would be run within the test-container app's iframe (bug 805829) as this is closer to how a webapp is actually run.
Comment 1 User image Andrew Halberstadt [:ahal] 2012-11-06 17:39:44 PST
I talked to cjones and apparently this is not what we want at all. Ideally we want to replace shell.xul with reftest.xul and run the tests from there.
Comment 2 User image Andrew Halberstadt [:ahal] 2013-01-16 14:01:32 PST
Created attachment 703023 [details] [diff] [review]
first attempt

I was able to get it working by modifying the files one step at a time in the test-package-stage dir and making sure I don't break things along the way. Unfortunately every time I then go to make a patch, change the Makefiles and rebuild, it stops working.

I get REFTEST TEST-UNEXPECTED-FAIL | | EXCEPTION: TypeError: invalid 'in' operand args
Comment 3 User image Andrew Halberstadt [:ahal] 2013-01-24 13:08:56 PST
Created attachment 706029 [details] [diff] [review]
second attempt

This patch gets tests running (though xul tests still fail since allowXULXBL isn't getting set). But there are still a lot of odd things happening and I'm not quite sure how to proceed (intermittent timeouts, marionette can't connect, additional test failures etc). Since this seems to make reftests less stable, I'm going to put this work on hold indefinitely until/if there is a definite need for it.
Comment 4 User image Andrew Halberstadt [:ahal] 2013-08-22 07:32:10 PDT
Not actively working on this. Though marionette/b2g tests in general have stabilized a lot since January. Might be worth revisiting this at some point.

Note You need to log in before you can comment on or make changes to this bug.