1208057 - Luciddream should be able to run devtools tests in js directly

Status: RESOLVED INCOMPLETE

(Testing :: General, defect)

Description

[Alexandre Poirot [:ochameau]]

In relation to bug 1208050, it would be great to reference existing devtools tests directly in luciddream.ini.
These existing tests are devtools mochitests. The goal of luciddream is to be able to run them against remote targets like simulator/b2g-desktop/mulet or devices. (Instead of running them only against firefox webpages)
So that we can know when our tools regress against these remote targets.

But in order to do that, we have to educate luciddream harness to handle Javascript files directly.

Comment 1

[Alexandre Poirot [:ochameau]]

Attachment: patch v1

Here is a WIP patch. This adds a LucidDreamJavascriptTestCase similar to MarionetteJSTestCase.
It includes a bunch of devtools specifics in luciddream but it is really nice
to be able to reference existing mochitests file like this.
May be there is some ways to put some more logic in /devtools instead of /testing/luciddream?

Comment 2

[Alexandre Poirot [:ochameau]]

Attachment: patch v2

Comment 3

[Alexandre Poirot [:ochameau]]

Attachment: python patch - v1

Spliting the patch in two:
- this one, dedicated to luciddream python code:
   * Introduced the JavascriptTestCase, make it so that we can run a js file instead of python.
   * Run /devtools/shared/luciddream/b2g-head.js in b2g runtime once for all tests
                                    /browser-head.js in desktop runtime before each test
   * Execute each test (with browser-head.js first, head.js and the test itself)

Comment 4

[Alexandre Poirot [:ochameau]]

Attachment: javascript patch - v1

- this other one, dedicated to test helpers in javascript:
    * b2g-head.js setup prefs/settings to have a decent test environment 
    * browser-head.js do the same thing in firefox, but also fake a Mochitest
    environment and hook critical devtools test helpers like
    `openInspector` method  in order to target an app context via webide
    (instead of a regular tab in Fx).
    * also tweak test-actor and head.js to connect all the things.

Comment 5

[Alexandre Poirot [:ochameau]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=09d57fe11e74

Comment 6

[Alexandre Poirot [:ochameau]]

Attachment: javascript patch - v2

Fixed duplicated test actor fronts that creates random breakages.