Update Mozmill/Mozrunner/Jsbridge to allow software update tests for multiple builds



Testing Graveyard
9 years ago
2 years ago


(Reporter: whimboo, Assigned: whimboo)



(Whiteboard: [verified-mozmill-1.2.4][mozmill-doc-needed])


(3 attachments)

All three components of Mozmill (Mozmill/Mozrunner/JSBridge) have to be updated to allow multiple runs for different builds. This bug will track this work. I have created branches on Github which will show the latest state:


I still have to get the following components working:
* Exchange persisted data between Python and the tests itself
* Reset all the data for the next test run
Assignee: nobody → hskupin
(In reply to comment #0)
> * Exchange persisted data between Python and the tests itself

I was able to get this part working. The initial implementation for persisted data was broken when you wanted to initialize the object in the Python script itself. Nothing has been send to the test. The trick with persisted.__dict__ is the right way.

> * Reset all the data for the next test run

A big chunk of code in all modules have been refactored to make it usable for multiple test-runs and that consumers can make it more configurable. All those parts are necessary for my software update tests.

Some more comment to the changes:
* the pre-filled lists for global and normal listeners should be part of MozMill itself and should be called directly when the network is created. That way sub-classes don't have to take care about the assignment to the internal back channel. Mikeal, can you point me to a doc or the code how other listeners could be implemented. Also having the possibility to add callback to Python code would be great.

* Probably we should also get rid of the mozmill_class declaration in each sub class. I believe this should be a part of the constructor and would make it more obvious. I haven't changed it yet. Instead I have added the instantiation directly to the constructor so the .mozmill attribute is always available and can be used in any sub class too, e.g. to set values for the persisted attribute. With a local object as it has been used so far there was no way for me to supply user defined data. 

* I have also removed the second call to clear_profile which has been called if tests fail during the test run.

Mikeal, it would be great when you could have a look at the current parser branch version.
Created attachment 408709 [details] [diff] [review]
Mozmill Patch

That's the final patch for Mozmill
Created attachment 408710 [details] [diff] [review]
JSBridge Patch

That's the final patch for JSBridge
Created attachment 408711 [details] [diff] [review]
Mozrunner Patch

That's the final patch for Mozrunner
Attachment #408710 - Attachment is patch: true
My branch has been merged into Mikeal's master:
Last Resolved: 9 years ago
Resolution: --- → FIXED
This will need updates to http://mikeal.github.com/mozrunner/#mozrunner.CLI.parser_options
Whiteboard: [mozmill-1.2.4][mozmill-doc-needed]
Yesterdays update tests pass without any issues. Marking verified fixed.
Whiteboard: [mozmill-1.2.4][mozmill-doc-needed] → [verified-mozmill-1.2.4][mozmill-doc-needed]
Depends on: 527159
Product: Testing → Testing Graveyard
You need to log in before you can comment on or make changes to this bug.