1525665 - windows/aarch64 - browser/base/content/test/tabs/browser_accessibility_indicator.js failures

Status: RESOLVED FIXED

(Firefox :: Tabbed Browser, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: egao [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=226341283&repo=try

https://queue.taskcluster.net/v1/task/IUTuY9AzSfWATkh_qXYPFg/runs/0/artifacts/public/logs/live_backing.log

Filing issues for win10/aarch64 failures.

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

I believe the second TEST-UNEXPECTED-FAIL is caused by the first failure, which left the browser window open.

16:18:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Uncaught exception - at chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:41 - TypeError: Cc['@mozilla.org/accessibilityService;1'] is undefined
16:18:59     INFO - Stack trace:
16:18:59     INFO - initAccessibilityService@chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:41:7
16:18:59     INFO - async*test_accessibility_indicator@chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:94:26
16:18:59     INFO - Async*Tester_execTest/<@chrome://mochikit/content/browser-test.js:1106:34
16:18:59     INFO - async*Tester_execTest@chrome://mochikit/content/browser-test.js:1097:16
16:18:59     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:995:9
16:18:59     INFO - SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:803:59
16:18:59     INFO - Leaving test bound test_accessibility_indicator
16:18:59     INFO - GECKO(5836) | MEMORY STAT | vsize 5830MB | vsizeMaxContiguous 67599037MB | residentFast 267MB | heapAllocated 121MB
16:18:59     INFO - TEST-OK | browser/base/content/test/tabs/browser_accessibility_indicator.js | took 419ms
16:18:59     INFO - checking window state
16:18:59     INFO - Not taking screenshot here: see the one that was previously logged
16:18:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found an unexpected browser window at the end of test run - 
16:18:59     INFO - GECKO(5836) | must wait for focus

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

waiting for a11y support to be completed in win/aarch64.

Comment 3

[Intermittent Failures Robot]

1 failures in 2658 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1525665&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 4

[Edwin Takahashi (:egao | infrequent contributor)]

a11y support appears to have been re-enabled in 1516214.

Re-run the test windows10-aarch64 opt Mochitests with e10s test-windows10-aarch64/opt-mochitest-browser-chrome-e10s-1 M-e10s(bc1).

Comment 5

[Edwin Takahashi (:egao | infrequent contributor)]

a11y has been enabled on windows10-aarch64, however the test opt-mochitest-browser-chrome-3 continues to experience the following failures.

:jamie - could these be related to 1516214?

21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is disabled. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:18
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:22
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - Got 0, expected 1
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:32
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:90
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is disabled. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:18
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - Got true, expected false
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:22
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Not taking screenshot here: see the one that was previously logged
21:10:38     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - Got 0, expected 1
21:10:38     INFO - Stack trace:
21:10:38     INFO - chrome://mochikit/content/browser-test.js:test_is:1315
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:testIndicatorState:32
21:10:38     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_accessibility_indicator.js:test_accessibility_indicator:91
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
21:10:38     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
21:10:38     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
21:10:38     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:10:38     INFO - Enable accessibility and ensure the indicator is shown in all windows.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - Open a new window and ensure the indicator is shown there by default.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:38     INFO - Preff off accessibility indicator.
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:38     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is disabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is unset. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is invisible. - 
21:10:39     INFO - Preff on accessibility indicator.
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Accessibility service is enabled. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | accessibilitymode flag is set. - 
21:10:39     INFO - TEST-PASS | browser/base/content/test/tabs/browser_accessibility_indicator.js | Indicator is visible. - 
21:10:39     INFO - Disable accessibility and ensure the indicator is hidden in all windows.
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Test timed out - 
21:11:22     INFO - GECKO(5856) | MEMORY STAT | vsize 5840MB | vsizeMaxContiguous 67722745MB | residentFast 235MB | heapAllocated 80MB
21:11:22     INFO - TEST-OK | browser/base/content/test/tabs/browser_accessibility_indicator.js | took 45097ms
21:11:22     INFO - checking window state
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found a browser window after previous test timed out - 
21:11:22     INFO - Not taking screenshot here: see the one that was previously logged
21:11:22     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_accessibility_indicator.js | Found a browser window after previous test timed out - 

Comment 6

[James Teh [:Jamie]]

As discussed in bug 1516214:

So something is triggering a11y, but we have no idea what.
...
I filed bug 1531537 to investigate this.
...
In the short term, I think we should just disable the indicator test for Windows aarch64.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

:egao, can you disable this?

Comment 8

[Edwin Takahashi (:egao | infrequent contributor)]

Try run: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedJob=232221108&revision=7bfc65a493696ccb9afa78bba3464e9c454dc000

The only remaining failure is browser/base/content/test/performance/browser_appmenu.js, which I'm not sure is related to a11y. Do you want me to disable this too, :jmaher?

Comment 9

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1525665 - disable browser/base/content/test/tabs/browser_accessibility_indicator.js tests

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

that test times out often in 90seconds but normally runs in 10-15 seconds. Given that, we should disable it and file a new bug to track enabling it. In bug 1505051, we track it intermittently timing out, that is on linux though.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ac5ecad3f2d0
disable browser/base/content/test/tabs/browser_accessibility_indicator.js tests r=jmaher

Comment 12

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/ac5ecad3f2d0

Comment 13

[Intermittent Failures Robot]

1 failures in 2818 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1525665&startday=2019-03-04&endday=2019-03-10&tree=all