Closed Bug 837137 Opened 12 years ago Closed 12 years ago

Intermittent B2G test_execute_async_script.py TestExecuteAsyncContent.test_execute_async_unload | AssertionError: JavascriptException not raised

Categories

(Testing :: Marionette Client and Harness, defect)

Product:
Testing
Component:
Marionette Client and Harness
Platform:
ARM
Gonk (Firefox OS)
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(firefox22 fixed, b2g18 fixed, b2g18-v1.0.0 wontfix, b2g18-v1.0.1 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla22
Tracking Flags:
Tracking Status
firefox22 --- fixed
b2g18 --- fixed
b2g18-v1.0.0 --- wontfix
b2g18-v1.0.1 --- fixed

People

(Reporter: RyanVM, Assigned: jgriffin)

References

Details

(Keywords: intermittent-failure)

Attachments

(2 files)

Add a sleep temporarily to fix a frequent orange,
1.32 KB, patch
Details | Diff | Splinter Review
Fix some errors in commandId usage,
4.02 KB, patch
mdas
: review+
Details | Diff | Splinter Review
https://tbpl.mozilla.org/php/getParsedLog.php?id=19338572&tree=Mozilla-Inbound b2g_ics_armv7a_gecko_emulator mozilla-inbound opt test marionette-webapi on 2013-01-31 16:03:52 PST for push 566e7485b29a slave: talos-r3-fed-072 16:09:23 INFO - TEST-START test_execute_async_script.py 16:09:24 INFO - test_check_window (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:25 INFO - test_execute_async_js_exception (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:25 INFO - test_execute_async_ours (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:26 INFO - test_execute_async_simple (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:28 INFO - test_execute_async_timeout (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:32 INFO - test_execute_async_unique_timeout (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:33 INFO - test_execute_async_unload (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:34 INFO - test_execute_js_exception (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:35 INFO - test_execute_no_return (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:36 INFO - test_execute_permission (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:37 INFO - test_no_timeout (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:38 INFO - test_same_context (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:38 INFO - test_sandbox_reuse (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:39 INFO - test_script_finished (test_execute_async_script.TestExecuteAsyncChrome) ... ok 16:09:41 INFO - test_check_window (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:41 INFO - test_execute_async_js_exception (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:42 INFO - test_execute_async_ours (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:43 INFO - test_execute_async_simple (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:45 INFO - test_execute_async_timeout (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:49 INFO - test_execute_async_unique_timeout (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:50 INFO - test_execute_async_unload (test_execute_async_script.TestExecuteAsyncContent) ... FAIL 16:09:51 INFO - ERROR 16:09:52 INFO - test_execute_js_exception (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:53 INFO - test_execute_no_return (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:53 INFO - test_execute_permission (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:54 INFO - test_no_timeout (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:55 INFO - test_same_context (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:56 INFO - test_sandbox_reuse (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:56 INFO - test_script_finished (test_execute_async_script.TestExecuteAsyncContent) ... ok 16:09:56 INFO - ====================================================================== 16:09:56 INFO - ERROR: test_execute_async_unload (test_execute_async_script.TestExecuteAsyncContent) 16:09:56 INFO - ---------------------------------------------------------------------- 16:09:56 ERROR - Traceback (most recent call last): 16:09:56 INFO - File "/home/cltbld/talos-slave/test/build/tests/marionette/marionette/marionette_test.py", line 138, in tearDown 16:09:56 INFO - (self.filepath.replace('\\', '\\\\'), self.methodName)) 16:09:56 INFO - File "/home/cltbld/talos-slave/test/build/tests/marionette/marionette/marionette.py", line 491, in execute_script 16:09:56 INFO - scriptTimeout=script_timeout) 16:09:56 INFO - File "/home/cltbld/talos-slave/test/build/tests/marionette/marionette/marionette.py", line 249, in _send_message 16:09:56 INFO - self._handle_error(response) 16:09:56 INFO - File "/home/cltbld/talos-slave/test/build/tests/marionette/marionette/marionette.py", line 284, in _handle_error 16:09:56 ERROR - raise JavascriptException(message=message, status=status, stacktrace=stacktrace) 16:09:56 ERROR - TEST-UNEXPECTED-FAIL | test_execute_async_script.py TestExecuteAsyncContent.test_execute_async_unload | JavascriptException: unload was called 16:09:56 INFO - ====================================================================== 16:09:56 INFO - FAIL: test_execute_async_unload (test_execute_async_script.TestExecuteAsyncContent) 16:09:56 INFO - ---------------------------------------------------------------------- 16:09:56 ERROR - Traceback (most recent call last): 16:09:56 INFO - File "/home/cltbld/talos-slave/test/build/tests/marionette/tests/testing/marionette/client/marionette/tests/unit/test_execute_async_script.py", line 38, in test_execute_async_unload 16:09:56 ERROR - self.assertRaises(JavascriptException, self.marionette.execute_async_script, unload) 16:09:56 ERROR - TEST-UNEXPECTED-FAIL | test_execute_async_script.py TestExecuteAsyncContent.test_execute_async_unload | AssertionError: JavascriptException not raised 16:09:56 INFO - ---------------------------------------------------------------------- 16:09:56 INFO - Ran 28 tests in 33.022s 16:09:56 INFO - FAILED (failures=1, errors=1)
Blocks: 823076
jgriffin, please could you find an owner for this? :-)
Flags: needinfo?(jgriffin)
This has the same root cause as bug 845625, so I believe they will get fixed at the same time.
Flags: needinfo?(jgriffin)
Assignee: nobody → jgriffin
Probable fix landed in bug 845625. I'll dupe this after I verify it really fixes this problem as well.
(In reply to TinderboxPushlog Robot from comment #85) > RyanVM > https://tbpl.mozilla.org/php/getParsedLog.php?id=20390525&tree=Mozilla- > Inbound > b2g_ics_armv7a_gecko_emulator_vm mozilla-inbound opt test marionette-webapi > on 2013-03-06 12:39:17 > slave: tst-linux64-ec2-364 > > 12:44:45 ERROR - Traceback (most recent call last): > 12:44:45 ERROR - self.assertRaises(JavascriptException, > self.marionette.execute_async_script, unload) > 12:44:45 ERROR - TEST-UNEXPECTED-FAIL | test_execute_async_script.py > TestExecuteAsyncContent.test_execute_async_unload | AssertionError: > JavascriptException not raised > 12:51:38 ERROR - Return code: 10 This is for sure post-comment 80.
Yep, this is not fixed, although I think its sister bug 845625 is. I'll take another look at this problem.
I have a hacky workaround that may fix this problem until I get a chance to look at it and fix it correctly (I'll be traveling from tomorrow until 3/12). It has a green try run: https://tbpl.mozilla.org/?tree=Try&rev=5d69638a2968 I don't expect it will make anything worse, and there's a chance it will make things a lot better. I'll land it as soon as inbound opens.
Summary: Intermittent B2G test_execute_async_script.py TestExecuteAsyncContent.test_execute_async_unload | JavascriptException: unload was called | AssertionError: JavascriptException not raised → Intermittent B2G test_execute_async_script.py TestExecuteAsyncContent.test_execute_async_unload | AssertionError: JavascriptException not raised
Feel free to back out if that patch makes things any worse; I'll revert it myself when I get a proper fix.
Found some more errors in using command_id's that were responsible for this intermittent failure.
Attachment #726789 - Flags: review?(mdas)
Attachment #726789 - Flags: review?(mdas) → review+
try ate my last job, so here's another: https://tbpl.mozilla.org/?tree=Try&rev=d72aacd471fb
(In reply to Jonathan Griffin (:jgriffin) from comment #101) > try ate my last job (Try repo had to be reset sadly, bug 853697)
try was green: https://hg.mozilla.org/integration/mozilla-inbound/rev/48eec6e16e6c
Whiteboard: [leave-open]
Target Milestone: --- → mozilla22
https://hg.mozilla.org/mozilla-central/rev/48eec6e16e6c
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
So much for that idea. My attempt to uplift this was causing Marionette to timeout. Jonathan, can you please uplift this? https://hg.mozilla.org/releases/mozilla-b2g18/rev/17c08008192a https://hg.mozilla.org/releases/mozilla-b2g18_v1_0_1/rev/9a3ac46e113a
status-b2g18: fixed → affected
status-b2g18-v1.0.1: fixed → affected
Flags: needinfo?(jgriffin)
Product: Testing → Remote Protocol
Moving bug to Testing::Marionette Client and Harness component per bug 1815831.
Component: Marionette → Marionette Client and Harness
Product: Remote Protocol → Testing
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: