1854233 - [meta] Investigate elements that are failing Tier 2 a11y_checks for Desktop UI

Status: ASSIGNED

(Firefox :: General, task, P3)

Description

[Anna Yeddi [:ayeddi] ⚠️ Online half days through May 23]

We are working on enabling Tier 2 a11y-checks to ensure our products have basic accessibility built-in (bug 1692110) and before that, we need to prepare the existing code base. While we triage and investigate existent tests that would fail once the a11y-checks are enabled in the CI, the failing tests were failed-if by the bug 1854228.

This task is to track the investigation into the reasons each of these tests failed and to be able to backtrack these tests once they're resolved.

Individual bugs to block the following bugs

1. (all) this meta bug
2. (Interactive elements must be labeled / Node is enabled but disabled via the accessibility API) bug 1854227 (a11y_checks_labeled)
3. (Node is not accessible via accessibility API / Node is not focusable via the accessibility API / Node is enabled but disabled via the accessibility API) Bug 1848394 (a11y_checks_focusable)

Tests affected:

browser/base/content/test/backforward/browser_history_menu.js	Node is not accessible via accessibility API	navigator-toolbox	toolbox	
browser/base/content/test/popupNotifications/browser_popupNotification_checkbox.js	Node is not accessible via accessibility API		label	checkbox-label
browser/base/content/test/protectionsUI/browser_protectionsUI.js	Node is not accessible via accessibility API	protections-popup-mainView-panel-header	box	panel-header panel-header-with-info-button
browser/base/content/test/protectionsUI/browser_protectionsUI_milestones.js	Interactive elements must be labeled	protections-popup-milestones-content	toolbarbutton	subviewbutton
browser/base/content/test/tabPrompts/browser_auth_spoofing_url_drag_and_drop.js	Node is not accessible via accessibility API	urlbar-input-container	hbox	
browser/base/content/test/tabs/browser_overflowScroll.js	Node is not focusable via the accessibility API	scrollbutton-down	toolbarbutton	
browser/base/content/test/tabs/browser_overflowScroll.js	Interactive elements must be labeled	scrollbutton-down	toolbarbutton	
browser/base/content/test/tabs/browser_overflowScroll.js	Node is not focusable via the accessibility API	scrollbutton-up	toolbarbutton	
browser/base/content/test/tabs/browser_overflowScroll.js	Interactive elements must be labeled	scrollbutton-up	toolbarbutton	
browser/base/content/test/tabs/browser_overflowScroll.js	"Scrolled one page of tabs with a double click - Got 193, expected 117
"			
browser/base/content/test/about/browser_aboutNewTab_bookmarksToolbarEmpty.js	Node is not accessible via accessibility API		html:a	text-link
browser/base/content/test/forms/browser_selectpopup_large.js	Interactive elements must be labeled	ContentSelectDropdown	menulist	
browser/base/content/test/forms/browser_selectpopup_searchfocus.js	Interactive elements must be labeled		input	
browser/base/content/test/forms/browser_selectpopup_toplevel.js	Interactive elements must be labeled		select	
browser/base/content/test/permissions/browser_permissions.js	Node is not accessible via accessibility API	identity-permission-box	box	identity-box-button
browser/base/content/test/general/browser_accesskeys.js	Interactive elements must be labeled	chromebutton	button	

toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_show_threads.js	Node is not accessible via accessibility API		TD	action-icon close-icon
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_show_frames_without_threads.js	Node is not accessible via accessibility API		TD	action-icon close-icon
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_show_all_frames.js	Node is not accessible via accessibility API		TD	action-icon close-icon
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_selection.js	Node is not accessible via accessibility API		TR	process
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_selection.js	Node is not accessible via accessibility API		TR	window
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_selection.js	Node is not accessible via accessibility API		TR	thread-summary
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_selection.js	Node is not accessible via accessibility API		TR	thread
toolkit/components/aboutprocesses/tests/browser/browser_aboutprocesses_default_options.js	Node is not accessible via accessibility API		TD	action-icon close-icon

Jobs affected:

1. test-linux1804-64-qr/opt-mochitest-browser-chrome-swr-a11y-checks-${1-7} (Try run)

---

Some Tier 2 accessibility checks for click events fired on controls that should be keyboard accessible and have valid labels were failing for this component. They were captured by testing/mochitest/tests/SimpleTest/AccessibilityUtils.js via bug 1692110. These failing tests should be temporarily skipped in the directory's browser.ini file while we investigate these failures. For all confirmed bugs individual defects should be filed.

When the individual test failures are resolved and the individual bugs are closed, remove the fail-if condition for a11y_checks from the appropriate files/sections to ensure better test coverage and to avoid regressions in a11y of these components.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Core::Disability Access APIs' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[Anna Yeddi [:ayeddi] ⚠️ Online half days through May 23]

Newly failing test (try):

FAIL	browser/base/content/test/webextensions/browser_permissions_installTrigger.js	Node is not focusable via the accessibility API		button	popup-notification-secondary-button footer-button

Newly passing test: browser/base/content/test/popupNotifications/browser_popupNotification_checkbox.js

Comment 3

[Anna Yeddi [:ayeddi] ⚠️ Online half days through May 23]

New test results (Try):

FAIL	browser/base/content/test/popupNotifications/browser_popupNotification_checkbox.js	Node is not accessible via accessibility API		label	checkbox-label
PASS	browser/base/content/test/webextensions/browser_permissions_installTrigger.js	We expect at least one assertion to fail because this test file is marked as fail-if in the manifest

Comment 4

[Anna Yeddi [:ayeddi] ⚠️ Online half days through May 23]

New test failure: (Try):

FAIL	browser/base/content/test/permissions/browser_site_scoped_permissions.js	Node is not accessible via accessibility API	identity-permission-box	box	identity-box-button