867548 - Intermittent B2G emulator Marionette test_emulator.py TestEmulatorContent.test_emulator_cmd | ScriptTimeoutException: timed out

Status: RESOLVED FIXED

(Testing :: Marionette Client and Harness, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=22432588&tree=Mozilla-Inbound

b2g_ics_armv7a_gecko_emulator_vm mozilla-inbound opt test marionette-webapi on 2013-04-30 15:39:19 PDT for push d963b65538e1
slave: tst-linux64-ec2-303

15:45:09     INFO -  TEST-START test_emulator.py
15:45:10     INFO -  test_emulator_cmd (test_emulator.TestEmulatorChrome) ... ok
15:45:31     INFO -  test_emulator_cmd (test_emulator.TestEmulatorContent) ... ERROR
15:45:37     INFO -  test_emulator_orientation (test_emulator.TestEmulatorScreen) ... ok
15:45:37     INFO -  ======================================================================
15:45:37     INFO -  ERROR: test_emulator_cmd (test_emulator.TestEmulatorContent)
15:45:37     INFO -  ----------------------------------------------------------------------
15:45:37     INFO -  Traceback (most recent call last):
15:45:37     INFO -    File "/builds/slave/test/build/tests/marionette/tests/testing/marionette/client/marionette/tests/unit/test_emulator.py", line 17, in test_emulator_cmd
15:45:37     INFO -      """);
15:45:37     INFO -    File "/builds/slave/test/build/tests/marionette/marionette/marionette.py", line 616, in execute_async_script
15:45:37     INFO -      scriptTimeout=script_timeout)
15:45:37     INFO -    File "/builds/slave/test/build/tests/marionette/marionette/marionette.py", line 342, in _send_message
15:45:37     INFO -      self._handle_error(response)
15:45:37     INFO -    File "/builds/slave/test/build/tests/marionette/marionette/marionette.py", line 391, in _handle_error
15:45:37    ERROR -      raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
15:45:37    ERROR -  TEST-UNEXPECTED-FAIL | test_emulator.py TestEmulatorContent.test_emulator_cmd | ScriptTimeoutException: timed out
15:45:37     INFO -  ----------------------------------------------------------------------
15:45:37     INFO -  Ran 3 tests in 27.910s
15:45:37  WARNING -  FAILED (errors=1)

Comment 1

[Jonathan Griffin (:jgriffin)]

This test happened to time out immediately after the emulator checked for OTA updates.  When running emulator tests, we should disable these checks by setting the appropriate pref.

Comment 2

[Jonathan Griffin (:jgriffin)]

Attachment: Disable updates when launching emulator,

Comment 3

[Andrew Halberstadt [:ahal]]

Comment on attachment 744255 [details] [diff] [review]
Disable updates when launching emulator,

Review of attachment 744255 [details] [diff] [review]:
-----------------------------------------------------------------

Isn't there already a marionette session running? Why do we have to start a new one?

Also, I'd much rather the marionette test runner use mozprofile to create a new profile with these prefs in them, but I guess that is outside the scope of this bug. r+ for now

Comment 4

[Jonathan Griffin (:jgriffin)]

(In reply to Andrew Halberstadt [:ahal] from comment #3)
> Comment on attachment 744255 [details] [diff] [review]
> Disable updates when launching emulator,
> 
> Review of attachment 744255 [details] [diff] [review]:
> -----------------------------------------------------------------
> 
> Isn't there already a marionette session running? Why do we have to start a
> new one?

There isn't; otherwise this would cause an error about there already being a session.
 
> Also, I'd much rather the marionette test runner use mozprofile to create a
> new profile with these prefs in them, but I guess that is outside the scope
> of this bug. r+ for now

The "bad" thing about doing it that way would be that we'd need to restart B2G to pick up the new profile, which would add 15+ seconds to every test run.  Not a big deal, but possibly a pain when running/debugging tests locally.

Comment 5

[Jonathan Griffin (:jgriffin)]

try: https://tbpl.mozilla.org/?tree=Try&rev=c452ba4f6109

Comment 6

[Jonathan Griffin (:jgriffin)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/f9a5c9ba7d7a

Comment 7

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=22537317&tree=Mozilla-Inbound
b2g_ics_armv7a_gecko_emulator_vm mozilla-inbound opt test marionette-webapi on 2013-05-02 19:30:06
slave: tst-linux64-ec2-075

19:36:18    ERROR -      raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
19:36:18    ERROR -  TEST-UNEXPECTED-FAIL | test_emulator.py TestEmulatorContent.test_emulator_cmd | ScriptTimeoutException: timed out
19:51:02    ERROR - Return code: 10

Comment 8

[Ed Morley [:emorley]]

https://hg.mozilla.org/mozilla-central/rev/f9a5c9ba7d7a

Comment 9

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-b2g18/rev/00c554abfc17

Comment 10

[Jonathan Griffin (:jgriffin)]

https://hg.mozilla.org/releases/mozilla-b2g18_v1_0_1/rev/8b6753753914

Comment 11

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=22816586&tree=Birch
b2g_ics_armv7a_gecko_emulator_vm birch opt test marionette-webapi on 2013-05-10 04:58:33
slave: tst-linux64-ec2-113

05:04:50    ERROR -      raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
05:04:50    ERROR -  TEST-UNEXPECTED-FAIL | test_emulator.py TestEmulatorContent.test_emulator_cmd | ScriptTimeoutException: timed out
05:19:59    ERROR - Return code: 10

Comment 12

[Legacy TBPL/Treeherder Robot]

past
https://tbpl.mozilla.org/php/getParsedLog.php?id=22916729&tree=Fx-Team
b2g_ics_armv7a_gecko_emulator_vm fx-team opt test marionette-webapi on 2013-05-13 14:47:32
slave: tst-linux64-ec2-351

14:53:54    ERROR -      raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
14:53:54    ERROR -  TEST-UNEXPECTED-FAIL | test_emulator.py TestEmulatorContent.test_emulator_cmd | ScriptTimeoutException: timed out
15:09:19    ERROR - Return code: 10

Comment 13

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.