Closed Bug 1503084 Opened 6 years ago Closed 2 years ago

Intermittent accessible/tests/browser/e10s/browser_caching_name.js | <random text> - Got name from (alt|value), expected test4

Categories

(Core :: Disability Access APIs, defect, P5)

defect

Tracking

()

RESOLVED DUPLICATE of bug 1775683

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, Whiteboard: [retriggered][stockwell disabled])

Attachments

(3 files, 1 obsolete file)

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=208527558&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/OM8FlKpATnmdkPZCs4XQ2w/runs/0/artifacts/public/logs/live_backing.log

[task 2018-10-30T01:32:47.607Z] 01:32:47     INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'test2 test3', address: [xpconnect wrapped nsIAccessible]] - 
[task 2018-10-30T01:32:47.608Z] 01:32:47     INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'test1', address: [xpconnect wrapped nsIAccessible]] - 
[task 2018-10-30T01:32:47.610Z] 01:32:47     INFO - Buffered messages finished
[task 2018-10-30T01:32:47.614Z] 01:32:47     INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'name from alt', address: [xpconnect wrapped nsIAccessible]] - Got name from alt, expected test4
[task 2018-10-30T01:32:47.614Z] 01:32:47     INFO - Stack trace:
[task 2018-10-30T01:32:47.615Z] 01:32:47     INFO - chrome://mochikit/content/browser-test.js:test_is:1295
[task 2018-10-30T01:32:47.615Z] 01:32:47     INFO - chrome://mochitests/content/a11y/accessible/tests/mochitest/name.js:testName:14
[task 2018-10-30T01:32:47.616Z] 01:32:47     INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testElmRule:362
[task 2018-10-30T01:32:47.616Z] 01:32:47     INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testNameRule:421
[task 2018-10-30T01:32:47.616Z] 01:32:47     INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:null:432
[task 2018-10-30T01:32:47.617Z] 01:32:47     INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/</<:280
[task 2018-10-30T01:32:47.618Z] 01:32:47     INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:111
[task 2018-10-30T01:32:47.619Z] 01:32:47     INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/<:256
[task 2018-10-30T01:32:47.619Z] 01:32:47     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1093
[task 2018-10-30T01:32:47.620Z] 01:32:47     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1084
[task 2018-10-30T01:32:47.620Z] 01:32:47     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:986
[task 2018-10-30T01:32:47.641Z] 01:32:47     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
[task 2018-10-30T01:32:47.643Z] 01:32:47     INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'name from alt', address: [xpconnect wrapped nsIAccessible]] - 
[task 2018-10-30T01:32:47.645Z] 01:32:47     INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'name from value', address: [xpconnect wrapped nsIAccessible]] - 
[task 2018-10-30T01:32:47.645Z] 01:32:47     INFO - Leaving test bound
Summary: Intermittent accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-image, role: pushbutton, name: 'name from alt', address: [xpconnect wrapped nsIAccessible]] - Got name from alt, expected test4 → Intermittent accessible/tests/browser/e10s/browser_caching_name.js | <random text> - Got name from (alt|value), expected test4
The test fails on 2nd 'btn-image', which means it fails HTMLInputImageNoValidSrc case. 'name from alt' failure means the accessible name is not generated from label@for. Not sure why, but it seems there's some racing condition where two different elements share same ID but live in the tree at different times.

I guess that the intermittence can be fixed by assigning a different ID for 2nd test, but it doesn't fix a real problem that may be existing on the web. I think that adding logging to mDependentIDs hashes may give answer to the problem.

Btw, while we are here, I would suggest to make error messages more descriptive to help in finding a failing test, for example, give ID to each test and also print which part of it failed: "HTMLInputImageNoValidSrc: expected name from @aria-label, got name from @alt.

I'm curious if Yura has cycles and interest to pick it up?
Flags: needinfo?(surkov.alexander) → needinfo?(yzenevich)
However bug 1503328 points out that clashing IDs may be not be a problem as I originally thought, because 'btn-submit' ID is unique within the document. Having said, the crash ratio of this bug is higher than 'btn-submit' one (note, 'btn-submit' test goes first), thus it might be a correlation between the failure ratio and elements with same IDs.
Assignee: nobody → ccoroiu
Attachment #9025043 - Flags: review?(jmaher)
Flags: needinfo?(gbrown)
Attachment #9025043 - Flags: review?(jmaher) → review+
Flags: needinfo?(gbrown)
Pushed by ccoroiu@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/c45b58286c47
disable browser_caching_name.js for frequent failures r=gbrown
Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered][stockwell disabled]

There are 25 total failures in the last 7 days on linux32 opt, linux64 pgo and osx-10-10 opt

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=232932579&repo=autoland&lineNumber=1545

[task 2019-03-09T21:31:27.338Z] 21:31:27 INFO - TEST-START | accessible/tests/browser/e10s/browser_caching_name.js
[task 2019-03-09T21:31:29.112Z] 21:31:29 INFO - TEST-INFO | started process screentopng
[task 2019-03-09T21:31:29.644Z] 21:31:29 INFO - TEST-INFO | screentopng: exit 0
[task 2019-03-09T21:31:29.649Z] 21:31:29 INFO - Buffered messages logged at 21:31:27
[task 2019-03-09T21:31:29.652Z] 21:31:29 INFO - Entering test bound
[task 2019-03-09T21:31:29.653Z] 21:31:29 INFO - Buffered messages logged at 21:31:28
[task 2019-03-09T21:31:29.654Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test2 test3', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.654Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test1', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.655Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test4', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.656Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'press me', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.656Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test5', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.657Z] 21:31:29 INFO - Leaving test bound
[task 2019-03-09T21:31:29.657Z] 21:31:29 INFO - Entering test bound
[task 2019-03-09T21:31:29.658Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test2 test3', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.659Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test1', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.659Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'test4', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.663Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'name from value', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.665Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn, role: pushbutton, name: 'name from title', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.666Z] 21:31:29 INFO - Leaving test bound
[task 2019-03-09T21:31:29.667Z] 21:31:29 INFO - Entering test bound
[task 2019-03-09T21:31:29.676Z] 21:31:29 INFO - Buffered messages logged at 21:31:29
[task 2019-03-09T21:31:29.683Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-submit, role: pushbutton, name: 'test2 test3', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.684Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-submit, role: pushbutton, name: 'test1', address: [xpconnect wrapped nsIAccessible]] -
[task 2019-03-09T21:31:29.685Z] 21:31:29 INFO - Buffered messages finished
[task 2019-03-09T21:31:29.687Z] 21:31:29 INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-submit, role: pushbutton, name: 'name from value', address: [xpconnect wrapped nsIAccessible]] - Got name from value, expected test4
[task 2019-03-09T21:31:29.687Z] 21:31:29 INFO - Stack trace:
[task 2019-03-09T21:31:29.688Z] 21:31:29 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
[task 2019-03-09T21:31:29.688Z] 21:31:29 INFO - chrome://mochitests/content/a11y/accessible/tests/mochitest/name.js:testName:14
[task 2019-03-09T21:31:29.689Z] 21:31:29 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testElmRule:362
[task 2019-03-09T21:31:29.690Z] 21:31:29 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testNameRule:421
[task 2019-03-09T21:31:29.690Z] 21:31:29 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:null:432
[task 2019-03-09T21:31:29.691Z] 21:31:29 INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/</<:280
[task 2019-03-09T21:31:29.691Z] 21:31:29 INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:111
[task 2019-03-09T21:31:29.692Z] 21:31:29 INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/<:256
[task 2019-03-09T21:31:29.692Z] 21:31:29 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2019-03-09T21:31:29.693Z] 21:31:29 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
[task 2019-03-09T21:31:29.694Z] 21:31:29 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
[task 2019-03-09T21:31:29.694Z] 21:31:29 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-03-09T21:31:29.696Z] 21:31:29 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-submit, role: pushbutton, name: 'name from value', address: [xpconnect wrapped nsIAccessible]] -

Marco can you assign someone to take a look?

Flags: needinfo?(yzenevich) → needinfo?(mzehe)

Yura, could you take a look at this, since you were involved in creating these tests originally? Thanks!

Flags: needinfo?(mzehe) → needinfo?(yzenevich)

I think this test must be broken down into individual ones. One obvious thing I notice is that test cleanup functionality is designed for tests that run for 1 remote document where this is the test with a lot of remote documents being spun up. This could be a good first bug perhaps for someone to pick up?

Flags: needinfo?(yzenevich)

This bug failed 33 times in the last 7 days. Occurs on macosx1010-64-shippable, linux64 and linux64-shippable on opt build types.

Log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=251778091&repo=mozilla-central&lineNumber=1503

This bug failed 31 times in the last 7 days. Occurs on linux64 and linux64-shippable on asan, debug and opt build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=263305066&repo=autoland&lineNumber=1568

Jamie: Can you please take a look at this bug?

Flags: needinfo?(jteh)

Yura, would you mind investigating? Thanks.

Flags: needinfo?(jteh) → needinfo?(yzenevich)

Geoff can this test be disabled on all platforms until there is a fix?

Seems like the failure rate is always below the disable-recommended line, however still fails.

There are 109 total failures in the last 30 days and 29 in the last 7 days.

Entire history: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-05-11&endday=2019-09-08&tree=trunk&bug=1503084

Flags: needinfo?(gbrown)

(In reply to Andreea Pavel [:apavel] from comment #71)

Geoff can this test be disabled on all platforms until there is a fix?

Yes, I think that's reasonable.

Flags: needinfo?(gbrown)

I'm looking at this bug this week, perhaps it's worth holding off disabling for a bit in case there's a solution..

Flags: needinfo?(yzenevich)

Yura, okay. We'll hold off until you give it a go.

Pushed by yura.zenevich@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/703f93f28ac8
added a wait for NAME_CHANGE event after aria-label removal. r=eeejay

This is still failing, we've reached 79 failure in the past 7 days:
linux64 asan and debug
linux64-devedition opt
macosx1014-64 debug
windows10-64 debug
windows10-64-qr debug
windows10-aarch64 opt
windows7-32 debug

Created a disable patch for this, just in case

Flags: needinfo?(yzenevich)

Will land a patch with more logging shortly, hopefully we can hold of on disabling it just yet as it's likely a missing event or condition that we are hunting.

Flags: needinfo?(yzenevich)
Pushed by yura.zenevich@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/0cabfa57360c
add additional event logging to e10s name tests. r=eeejay

There have been 82 failures within the last 7 days:

  • 3 failures on Windows 7 debug
  • 1 failure on Windows 10 AArch64 opt
  • 12 failures on Windows 10 x64 QuantumRender debug
  • 7 failures on Windows 10 x64 debug
  • 27 failures on OS X 10.14 debug
  • 5 failures on Linux x64 shippable opt
  • 27 failures on Linux x64 asan/opt/debug

Recent failure log e.g. : https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=269793340&repo=autoland&lineNumber=1666

[task 2019-10-04T15:17:44.144Z] 15:17:44 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Recieved name changed event -
[task 2019-10-04T15:17:44.144Z] 15:17:44 INFO - Buffered messages finished
[task 2019-10-04T15:17:44.147Z] 15:17:44 INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/e10s/browser_caching_name.js | Wrong name of the accessible for [DOM node id: btn-reset, role: pushbutton, name: 'name from value', address: [xpconnect wrapped nsIAccessible]] - Got name from value, expected test4
[task 2019-10-04T15:17:44.147Z] 15:17:44 INFO - Stack trace:
[task 2019-10-04T15:17:44.147Z] 15:17:44 INFO - chrome://mochikit/content/browser-test.js:test_is:1595
[task 2019-10-04T15:17:44.147Z] 15:17:44 INFO - chrome://mochitests/content/a11y/accessible/tests/mochitest/name.js:testName:15
[task 2019-10-04T15:17:44.147Z] 15:17:44 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testElmRule:443
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:testNameRule:512
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochitests/content/browser/accessible/tests/browser/e10s/browser_caching_name.js:null:530
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/</<:297
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:141
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochitests/content/browser/accessible/tests/browser/shared-head.js:addAccessibleTask/<:268
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1350
[task 2019-10-04T15:17:44.148Z] 15:17:44 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1385
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1213
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:805
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - GECKO(1157) | console.log: Event type: hide. Target: [defunct, address: [xpconnect wrapped nsIAccessible]]
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - GECKO(1157) | console.log: Event type: hide. Target: [defunct, address: [xpconnect wrapped nsIAccessible]]
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - GECKO(1157) | console.log: Event type: text removed, start: 4, length: 2, removed text:  . Target: [DOM node id: body, role: document, name: 'Accessibility Test', address: [xpconnect wrapped (nsISupports, nsIAccessible, nsIAccessibleDocument)]]
[task 2019-10-04T15:17:44.149Z] 15:17:44 INFO - TEST-PASS | accessible/tests/browser/e10s/browser_caching_name.js | Recieved reorder event -

Whiteboard: [retriggered][stockwell disabled] → [retriggered][stockwell disabled][stockwell needswork]
Whiteboard: [retriggered][stockwell disabled][stockwell needswork] → [retriggered][stockwell disabled]

The bug assignee didn't login in Bugzilla in the last 7 months.
:Jamie, could you have a look please?
For more information, please visit auto_nag documentation.

Assignee: ccoroiu → nobody
Flags: needinfo?(jteh)
Flags: needinfo?(jteh)

The following patch is waiting for review from an inactive reviewer:

ID Title Author Reviewer Status
D46700 Bug 1503084 - Disable browser_caching_name.js for frequent failures r=#intermittent-reviewers noemi_erli bc: Resigned from review

:noemi_erli, could you please find another reviewer or abandon the patch if it is no longer relevant?

For more information, please visit auto_nag documentation.

Flags: needinfo?(nerli)
Attachment #9094371 - Attachment is obsolete: true

(In reply to Release mgmt bot [:suhaib / :marco/ :calixte] from comment #133)

The following patch is waiting for review from an inactive reviewer:

ID Title Author Reviewer Status
D46700 Bug 1503084 - Disable browser_caching_name.js for frequent failures r=#intermittent-reviewers noemi_erli bc: Resigned from review

:noemi_erli, could you please find another reviewer or abandon the patch if it is no longer relevant?

For more information, please visit auto_nag documentation.

The patch is no longer needed.

Flags: needinfo?(nerli)
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: