1968688 - perma fail ubuntu 24.04 opt/a11y_checks devtools/client/inspector/test/browser_inspector_textbox-menu.js

Status: NEW

(DevTools :: Inspector, defect, P3)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

when running tests in CI on a newer version of linux (18.04 -> 24.04) we run into some new perma failures.

in this opt log, you can see this failure:

[task 2025-05-26T21:21:00.494Z] 21:21:00     INFO - TEST-PASS | devtools/client/inspector/test/browser_inspector_textbox-menu.js | The menu is closed again - 
[task 2025-05-26T21:21:00.495Z] 21:21:00     INFO - Switching to the layout-view
[task 2025-05-26T21:21:00.495Z] 21:21:00     INFO - Testing the box-model region
[task 2025-05-26T21:21:00.496Z] 21:21:00     INFO - Buffered messages finished
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - TEST-UNEXPECTED-FAIL | devtools/client/inspector/test/browser_inspector_textbox-menu.js | Node is not focusable via the accessibility API: id: , tagName: span, className: boxmodel-editable - 
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - Stack trace:
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/browser-test.js:test_ok:1626
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:a11yFail:760
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:assertFocusable:807
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:assertCanBeClicked:1178
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:runIfA11YChecks/this.AccessibilityUtils:1145
[task 2025-05-26T21:21:00.497Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:handleEvent:1264
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouseAtPoint:825
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouse:557
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouseAtCenter:989
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochitests/content/browser/devtools/client/inspector/test/browser_inspector_textbox-menu.js:null:74
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/browser-test.js:handleTask:1170
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1242
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1383
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1159
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1058
[task 2025-05-26T21:21:00.498Z] 21:21:00     INFO - TEST-PASS | devtools/client/inspector/test/browser_inspector_textbox-menu.js | The menu is closed - 

this bug will be for tracking investigations, I will be skipping these tests in a manifest in a larger patch to green stuff up.

Comment 1

[Nicolas Chevobbe [:nchevobbe]]

This is not platform specific, if I apply the following patch:

diff --git a/devtools/client/inspector/test/browser_inspector_textbox-menu.js b/devtools/client/inspector/test/browser_inspector_textbox-menu.js
index a95fcc02b8..f18b81ca10 100644
--- a/devtools/client/inspector/test/browser_inspector_textbox-menu.js
+++ b/devtools/client/inspector/test/browser_inspector_textbox-menu.js
@@ -67,6 +67,8 @@
   selectLayoutView(inspector);
   await onBoxModelUpdated;
 
+  await new Promise(res => setTimeout(res, 2000));
+
   info("Testing the box-model region");
   const margin = inspector.panelDoc.querySelector(
     ".boxmodel-margin.boxmodel-top > span"

and run ./mach test devtools/client/inspector/test/browser_inspector_textbox-menu.js --enable-a11y-checks , then I'm seeing the failure
I guess this is a case where the items don't have a size yet when we trigger the interaction, which makes the a11y check to pass (see Bug 1946641)

In any case, the box model layout buttons/inputs aren't accessible. The box-model specific tests are already annotated in this way (https://searchfox.org/mozilla-central/rev/85d6bf1b521040c79ed72f3966274a25a2f987c7/devtools/client/inspector/boxmodel/test/browser.toml#17-21,26-36)