Bug 1849021 Comment 0 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

Filing this bug to skip with `fail-if` condition the set of DevTools tests and for the easier back tracking of these tests once they're resolved. 

Jobs affected:
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-1 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=C_xEBjtFRA-mZTBp4H29VA.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-2 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=F0hq0ycHQkiKZNbdjw-1Zw.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-3 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=DIrGU5BVRYqUfewGg3IeYA.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-4 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=A5XW_vsAQne9riwt_RFuLw.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-5 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=Pf1QLRKpTeeUaTZxkmM1Qw.0))

----------------------------------------

Do not perform accessibility checks on files that fire click events on controls that should be keyboard accessible too (captured by `testing/mochitest/tests/SimpleTest/AccessibilityUtils.js` via bug 1692110) for which there are individual bugs filed.

When the individual test failures are resolved and the individual bugs are closed, remove the `fail-if` condition for `a11y_checks` for appropriate files/sections to ensure better test coverage and avoid regressions in a11y.
We are working on [enabling Tier 2 a11y-checks to ensure our products have basic accessibility built-in (bug 1692110)](https://bugzilla.mozilla.org/show_bug.cgi?id=1692110) and before that, we need to prepare the existing code base. While we triage and investigate existent tests that would fail once the a11y-checks are enabled in the CI, we are going to skip the failing tests altogether and then handle each one of them individually.

This task is to skip with `fail-if` condition of the failing tests while the ongoing accessibility improvement work is ongoing and we continue investigation into the reasons these tests failed and to be able to backtrack these tests once they're resolved. A separate task to investigate the failed Tier 2 a11y_checks will be filed for an appropriate component.

Jobs affected:
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-1 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=C_xEBjtFRA-mZTBp4H29VA.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-2 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=F0hq0ycHQkiKZNbdjw-1Zw.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-3 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=DIrGU5BVRYqUfewGg3IeYA.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-4 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=A5XW_vsAQne9riwt_RFuLw.0))
1. test-linux1804-64-qr/opt-mochitest-devtools-chrome-a11y-checks-5 ([Try run](https://treeherder.mozilla.org/jobs?repo=try&revision=eaf122fe18ed6466e0f02638711a8633d459e598&test_paths=browser%2Fcomponents%2Fcustomizableui%2Ftest&selectedTaskRun=Pf1QLRKpTeeUaTZxkmM1Qw.0))

----------------------------------------

Do not perform accessibility checks on files that fire click events on controls that should be keyboard accessible too (captured by `testing/mochitest/tests/SimpleTest/AccessibilityUtils.js` via bug 1692110) for which there are individual bugs filed.

When the individual test failures are resolved and the individual bugs are closed, remove the `fail-if` condition for `a11y_checks` for appropriate files/sections to ensure better test coverage and avoid regressions in a11y.

Back to Bug 1849021 Comment 0