1131720 - Intermittent run-by-dir test_whitespace.html | Different amount of expected children of ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]]. - got 6, expected 5

Status: RESOLVED WONTFIX

(Core :: Disability Access APIs, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

08:19:59 INFO - 1369 INFO TEST-START | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html
08:20:00 INFO - 1370 INFO must wait for load
08:20:00 INFO - 1371 INFO Invoke the 'remove middle img' test { scenario #0: expected 'hide' event; expected 'hide' event; expected 'reorder' event; }
08:20:00 INFO - 1372 INFO TEST-PASS | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Wrong value of property 'role' for ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]].
08:20:00 INFO - 1373 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Different amount of expected children of ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]]. - got 6, expected 5
08:20:00 INFO - 1374 INFO TEST-PASS | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Wrong value of property 'role' for ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]].
08:20:00 INFO - 1375 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Different amount of expected children of ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]]. - got 4, expected 3
08:20:00 INFO - 1376 INFO TEST-PASS | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Test with ID = 'remove middle img' succeed. Event hide was handled.
08:20:00 INFO - 1377 INFO TEST-PASS | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Test with ID = 'remove middle img' succeed. Event hide was handled.
08:20:00 INFO - 1378 INFO TEST-PASS | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Test with ID = 'remove middle img' succeed. Event reorder was handled.

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=6466281
repository: mozilla-inbound
start_time: 2015-02-10T07:37:31
who: rvandermeulen[at]mozilla[dot]com
machine: t-w864-ix-025
buildname: Windows 8 64-bit mozilla-inbound pgo test mochitest-other
revision: 32d06ff1119a

Return code: 1
1373 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Different amount of expected children of ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]]. - got 6, expected 5
1375 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | Different amount of expected children of ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: [xpconnect wrapped nsIAccessible]]. - got 4, expected 3
Return code: 1
Return code: 1

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

I continue to be able to reproduce this error on try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=98fd5e44a30e&filter-searchStr=osx

This is something which I don't know anything about debugging or even fiddling with.  What is happening is that we are running each accessibility directory as a standalone directory (fresh browser launch with a fresh profile, then after the tests in only that directory run shut down the directory).

This usually affects timing (for example this test case is the last to run in a nice healthy list of tests) either while depending on the browser to startup, or if we shutdown to fast.  I doubt this is shutdown or startup related though.  Other issues are around GC's (timing is much different for the whole session), or sometimes previous test cases affecting the browser.

David, can you help find someone to help us hack this a bit or look into what is really going on?  Even a few suggestions to try out would be helpful!

Comment 3

[David Bolter [:davidb] (NeedInfo me for attention)]

Alex might have ideas.

Comment 4

[alexander :surkov (:asurkov)]

It will be helpful to know what the extra accessible is. It'd be nice if testAccessilbeTree logged the difference (http://mxr.mozilla.org/mozilla-central/source/accessible/tests/mochitest/common.js#454).

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

I haven't seen this after adding more verbose information to common.js, going to close as wontfix.

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=2794460
repository: b2g-inbound
start_time: 2015-09-17T01:11:46
who: tomcat[at]mozilla[dot]com
machine: t-snow-r4-0135
buildname: Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-other
revision: 15cc3c9efd9d

566 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: 0x11f757960] has an extra child at index 5 : ['null node', address: [object Text], role: text leaf, name: ' ', address: 0x11f2243c0]
571 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/a11y/accessible/tests/mochitest/treeupdate/test_whitespace.html | ['div@id="container1" node', address: [object HTMLDivElement], role: section, address: 0x11f757960] has an extra child at index 3 : ['null node', address: [object Text], role: text leaf, name: ' ', address: 0x11f2243c0]