786463 - Marionette should mark TEST-START and TEST-END in the log

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect)

Description

[Jonathan Griffin (:jgriffin)]

Currently, Marionette outputs log messages to gecko's stdout, but we don't output the start or end of test.  Thus, it's hard to tell which log statements belong to tests. 

We should be output something similar to mochitest:

INFO TEST-START: test_something.py:test_something_good
 ...
INFO TEST-END: test_something.py:test_something_good

We can achieve this by having MarionetteTestCase call Marionette's log() method with the test name at the start and end of a test.

Comment 1

[Jonathan Griffin (:jgriffin)]

Attachment: Add TEST-START and TEST-END logging, DONTBUILD because NPOTB

Turns out this wouldn't have been a very good first-bug, due to the bug in executeJSScript that was eating newSandbox, which this patch fixes (since without it, the logging messes up the subsequent script).

Comment 2

[Malini Das [:mdas] - Away, not checking bugmail]

Comment on attachment 656280 [details] [diff] [review]
Add TEST-START and TEST-END logging,  DONTBUILD because NPOTB

Review of attachment 656280 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm

::: testing/marionette/marionette-actors.js
@@ +631,5 @@
>      else {
> +      this.sendAsync("executeJSScript", { value:aRequest.value,
> +                                          args:aRequest.args,
> +                                          newSandbox:aRequest.newSandbox,
> +                                          timeout:aRequest.timeout });

ah, good catch :)

Comment 3

[Jonathan Griffin (:jgriffin)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/616ff690fdc3

Comment 4

[Ed Morley [:emorley]]

https://hg.mozilla.org/mozilla-central/rev/616ff690fdc3