windows/aarch64 - browser/base/content/test/tabs/browser_accessibility_indicator.js failures

RESOLVED FIXED in Firefox 67

Status

()

defect
P5
normal
RESOLVED FIXED
4 months ago
3 months ago

People

(Reporter: intermittent-bug-filer, Assigned: egao)

Tracking

(Blocks 1 bug, {intermittent-failure})

unspecified
Firefox 67
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox67 fixed)

Details

Attachments

(1 attachment)

Assignee

Comment 1

4 months ago

I believe the second TEST-UNEXPECTED-FAIL is caused by the first failure, which left the browser window open.

16:18:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Uncaught exception - at chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:41 - TypeError: Cc['@mozilla.org/accessibilityService;1'] is undefined
16:18:59     INFO - Stack trace:
16:18:59     INFO - initAccessibilityService@chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:41:7
16:18:59     INFO - async*test_accessibility_indicator@chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:94:26
16:18:59     INFO - Async*Tester_execTest/<@chrome://mochikit/content/browser-test.js:1106:34
16:18:59     INFO - async*Tester_execTest@chrome://mochikit/content/browser-test.js:1097:16
16:18:59     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:995:9
16:18:59     INFO - SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:803:59
16:18:59     INFO - Leaving test bound test_accessibility_indicator
16:18:59     INFO - GECKO(5836) | MEMORY STAT | vsize 5830MB | vsizeMaxContiguous 67599037MB | residentFast 267MB | heapAllocated 121MB
16:18:59     INFO - TEST-OK | browser/base/content/test/tabs/browser_accessibility_indicator.js | took 419ms
16:18:59     INFO - checking window state
16:18:59     INFO - Not taking screenshot here: see the one that was previously logged
16:18:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found an unexpected browser window at the end of test run - 
16:18:59     INFO - GECKO(5836) | must wait for focus

waiting for a11y support to be completed in win/aarch64.

Blocks: 1516214
Summary: TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js failures → windows/aarch64 - browser/base/content/test/tabs/browser_accessibility_indicator.js failures
Comment hidden (Intermittent Failures Robot)
Assignee

Comment 4

3 months ago

a11y support appears to have been re-enabled in 1516214.

Re-run the test windows10-aarch64 opt Mochitests with e10s test-windows10-aarch64/opt-mochitest-browser-chrome-e10s-1 M-e10s(bc1).

No longer blocks: 1516214
Depends on: 1516214
Flags: needinfo?(egao)
Assignee

Comment 5

3 months ago

a11y has been enabled on windows10-aarch64, however the test opt-mochitest-browser-chrome-3 continues to experience the following failures.

:jamie - could these be related to 1516214?

21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is disabled. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:18
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:22
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - Got 0, expected 1
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:32
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is disabled. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:18
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:22
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - Got 0, expected 1
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:32
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Enable accessibility and ensure the indicator is shown in all windows.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - Open a new window and ensure the indicator is shown there by default.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - Preff off accessibility indicator.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:39     INFO - Preff on accessibility indicator.
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - Disable accessibility and ensure the indicator is hidden in all windows.
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Test timed out - 
21:11:22     INFO - GECKO(5856) | MEMORY STAT | vsize 5840MB | vsizeMaxContiguous 67722745MB | residentFast 235MB | heapAllocated 80MB
21:11:22     INFO - TEST-OK | browser/base/content/test/tabs/browser_accessibility_indicator.js | took 45097ms
21:11:22     INFO - checking window state
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found a browser window after previous test timed out - 
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found a browser window after previous test timed out - 
Flags: needinfo?(egao) → needinfo?(jteh)

Comment 6

3 months ago

As discussed in bug 1516214:

So something is triggering a11y, but we have no idea what.
...
I filed bug 1531537 to investigate this.
...
In the short term, I think we should just disable the indicator test for Windows aarch64.

Flags: needinfo?(jteh)

:egao, can you disable this?

Flags: needinfo?(egao)
Assignee

Comment 8

3 months ago

Try run: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedJob=232221108&revision=7bfc65a493696ccb9afa78bba3464e9c454dc000

The only remaining failure is browser/base/content/test/performance/browser_appmenu.js, which I'm not sure is related to a11y. Do you want me to disable this too, :jmaher?

Flags: needinfo?(egao)

that test times out often in 90seconds but normally runs in 10-15 seconds. Given that, we should disable it and file a new bug to track enabling it. In bug 1505051, we track it intermittently timing out, that is on linux though.

Assignee

Updated

3 months ago
Assignee

Updated

3 months ago
Blocks: 1533114

Comment 11

3 months ago
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/ac5ecad3f2d0
disable browser/base/content/test/tabs/browser_accessibility_indicator.js tests r=jmaher

Comment 12

3 months ago
bugherder
Status: NEW → RESOLVED
Last Resolved: 3 months ago
Resolution: --- → FIXED
Target Milestone: --- → Firefox 67
Assignee: nobody → egao
Comment hidden (Intermittent Failures Robot)
You need to log in before you can comment on or make changes to this bug.