Open Bug 1767748 Opened 2 years ago Updated 6 days ago

Intermittent devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js | single tracking bug

Categories

(DevTools :: Accessibility Tools, defect, P3)

Product:
DevTools
Component:
Accessibility Tools
Type:
defect

Tracking

(firefox116 affected)

Status:
REOPENED
Tracking Flags:
Tracking Status
firefox116 --- affected

People

(Reporter: jmaher, Assigned: nchevobbe)

References

Details

(Keywords: intermittent-failure, intermittent-testcase, leave-open, Whiteboard: [stockwell disabled])

Attachments

(3 files, 1 obsolete file)

Bug 1767748 - [devtools] Fix browser_accessibility_sidebar_checks.js intermittent. r=#devtools-reviewers.
48 bytes, text/x-phabricator-request
Details | Review
Bug 1767748 - [devtools] Fix browser_accessibility_sidebar_checks.js intermittent. r=#devtools-reviewers.
48 bytes, text/x-phabricator-request
Details | Review
Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. r=#intermittent-reviewers
48 bytes, text/x-phabricator-request
Details | Review
No description provided.

Filter on devtools-intermittent-singletrackingbug-triage

Severity: -- → S4

There have been 34 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-qr
  • linux1804-64-shippable-qr
[task 2023-03-15T20:54:36.455Z] 20:54:36     INFO - TEST-START | devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js
[task 2023-03-15T20:54:56.484Z] 20:54:56     INFO - GECKO(1536) | ALSA lib seq_hw.c:466:(snd_seq_hw_open) open /dev/snd/seq failed: No such file or directory
[task 2023-03-15T20:55:21.510Z] 20:55:21     INFO - TEST-INFO | started process screentopng
[task 2023-03-15T20:55:21.649Z] 20:55:21     INFO - TEST-INFO | screentopng: exit 0
[task 2023-03-15T20:55:21.651Z] 20:55:21     INFO - Buffered messages logged at 20:54:36
[task 2023-03-15T20:55:21.651Z] 20:55:21     INFO - Entering test bound a11YPanelTask
[task 2023-03-15T20:55:21.652Z] 20:55:21     INFO - Test Accessibility panel sidebar.
[task 2023-03-15T20:55:21.653Z] 20:55:21     INFO - Adding a new test tab with URL: 'data:text/html;charset=UTF-8,%3Chtml%3E%0A%20%20%3Chead%3E%0A%20%20%20%20%3Cmeta%20charset%3D%22utf-8%22%2F%3E%0A%20%20%20%20%3Ctitle%3EAccessibility%20Panel%20Test%3C%2Ftitle%3E%0A%20%20%3C%2Fhead%3E%0A%20%20%3Cbody%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20red%3B%22%3ERed%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20blue%3B%22%3EBlue%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20gray%3B%20background%3A%20linear-gradient(%23e66465%2C%20%239198e5)%3B%22%3EGray%3C%2Fp%3E%0A%20%20%3C%2Fbody%3E%0A%3C%2Fhtml%3E'
[task 2023-03-15T20:55:21.654Z] 20:55:21     INFO - Adding a new tab with URL: data:text/html;charset=UTF-8,%3Chtml%3E%0A%20%20%3Chead%3E%0A%20%20%20%20%3Cmeta%20charset%3D%22utf-8%22%2F%3E%0A%20%20%20%20%3Ctitle%3EAccessibility%20Panel%20Test%3C%2Ftitle%3E%0A%20%20%3C%2Fhead%3E%0A%20%20%3Cbody%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20red%3B%22%3ERed%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20blue%3B%22%3EBlue%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20gray%3B%20background%3A%20linear-gradient(%23e66465%2C%20%239198e5)%3B%22%3EGray%3C%2Fp%3E%0A%20%20%3C%2Fbody%3E%0A%3C%2Fhtml%3E
[task 2023-03-15T20:55:21.657Z] 20:55:21     INFO - Console message: [JavaScript Warning: "This page is in Quirks Mode. Page layout may be impacted. For Standards Mode use “<!DOCTYPE html>”." {file: "data:text/html;charset=UTF-8,%3Chtml%3E%0A%20%20%3Chead%3E%0A%20%20%20%20%3Cmeta%20charset%3D%22utf-8%22%2F%3E%0A%20%20%20%20%3Ctitle%3EAccessibility%20Panel%20Test%3C%2Ftitle%3E%0A%20%20%3C%2Fhead%3E%0A%20%20%3Cbody%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20red%3B%22%3ERed%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20blue%3B%22%3EBlue%3C%2Fp%3E%0A%20%20%20%20%3Cp%20style%3D%22color%3A%20gray%3B%20background%3A%20linear-gradient(%23e66465%2C%20%239198e5)%3B%22%3EGray%3C%2Fp%3E%0A%20%20%3C%2Fbody" line: 0}]
[task 2023-03-15T20:55:21.658Z] 20:55:21     INFO - Tab added and finished loading
[task 2023-03-15T20:55:21.659Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500 column: 24 source: "display: none !important"}]
[task 2023-03-15T20:55:21.660Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500}]
[task 2023-03-15T20:55:21.661Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/elements/panel.js" line: 62}]
[task 2023-03-15T20:55:21.662Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500 column: 24 source: "display: none !important"}]
[task 2023-03-15T20:55:21.662Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500}]
[task 2023-03-15T20:55:21.663Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/elements/panel.js" line: 62}]
[task 2023-03-15T20:55:21.664Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500 column: 24 source: "display: none !important"}]
[task 2023-03-15T20:55:21.665Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/elements/panel.js" line: 62}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500 column: 24 source: "display: none !important"}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/elements/panel.js" line: 62}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500 column: 24 source: "display: none !important"}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/customElements.js" line: 500}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Console message: [JavaScript Error: "Content Security Policy: The page’s settings blocked the loading of a resource at inline (“default-src”)." {file: "chrome://global/content/elements/panel.js" line: 62}]
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - Buffered messages finished
[task 2023-03-15T20:55:21.666Z] 20:55:21     INFO - TEST-UNEXPECTED-FAIL | devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js | Test timed out - 
[task 2023-03-15T20:58:30.590Z] 20:58:30     INFO - GECKO(1536) | console.error: (new Error("Polling for changes failed: Unexpected content-type \"text/plain;charset=US-ASCII\".", "resource://services-settings/remote-settings.sys.mjs", 325))
[task 2023-03-15T21:00:30.594Z] 21:00:30     INFO - GECKO(1536) | 1678914030593	addons.xpi	ERROR	System addon update list error Error: got node name: html, expected: updates
[task 2023-03-15T21:00:30.598Z] 21:00:30     INFO - Console message: [JavaScript Error: "1678914030593	addons.xpi	ERROR	System addon update list error Error: got node name: html, expected: updates" {file: "resource://gre/modules/Log.sys.mjs" line: 722}]
[task 2023-03-15T21:00:30.598Z] 21:00:30     INFO - append@resource://gre/modules/Log.sys.mjs:722:12
[task 2023-03-15T21:00:30.598Z] 21:00:30     INFO - log@resource://gre/modules/Log.sys.mjs:376:16
[task 2023-03-15T21:00:30.598Z] 21:00:30     INFO - error@resource://gre/modules/Log.sys.mjs:384:10
[task 2023-03-15T21:00:30.598Z] 21:00:30     INFO - updateSystemAddons/res<@resource://gre/modules/addons/XPIInstall.jsm:4104:25
[task 2023-03-15T21:00:30.599Z] 21:00:30     INFO - 
[task 2023-03-15T21:06:40.600Z] 21:06:40     INFO - Buffered messages finished
Flags: needinfo?(jteh)
Whiteboard: [stockwell needswork:owner]

Update:

There have been 42 total failures in the last 7 days.
There are:

  • 10 failures on linux1804-64-qr opt
  • 32 failures on linux1804-64-shippable-qr opt

Recent failure log.

James , as the owner of this component, can you help us assign the bug to someone? Thank you.

There have been 31 total failures in the last 7 days.
There are:

  • 9 failures on linux1804-64-qr opt
  • 22 failures on linux1804-64-shippable-qr opt

Recent failure log.

James, as the owner of this component, can you help us assign the bug to someone? Thank you.

Whiteboard: [stockwell unknown] → [stockwell unknown][stockwell needswork:owner]
Flags: needinfo?(jteh)
Flags: needinfo?(jteh)

Update:

There have been 34 failures within the last 7 days:

  • 26 failures on Linux 18.04 x64 WebRender Shippable opt
  • 8 failures on Linux 18.04 x64 WebRender opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=416801930&repo=autoland&lineNumber=3988

The test failure screenshots show that the accessibility panel is not focused
and the document node not selected, so there's no data being displayed in the
sidebar.
Let's try to focus the a11y panel to see if this fixes the problem.

Also, we remove an unnecessary check on accessibility-enable-button as the
element does not exist anymore.

Assignee: nobody → nchevobbe
Status: NEW → ASSIGNED
Pushed by nchevobbe@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/08fb757d7ac8
[devtools] Fix browser_accessibility_sidebar_checks.js intermittent. r=devtools-reviewers,ochameau.

https://hg.mozilla.org/mozilla-central/rev/08fb757d7ac8

Status: ASSIGNED → RESOLVED
Closed: 1 year ago
status-firefox116: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 116 Branch

This seems not to be fixed, as it can be seen here.

Status: RESOLVED → REOPENED
status-firefox116: fixed → affected
Resolution: FIXED → ---
Target Milestone: 116 Branch → ---
Flags: needinfo?(nchevobbe)

(In reply to Serban Stanca [:SerbanS] from comment #47)

This seems not to be fixed, as it can be seen here.

I'll try something else then

Flags: needinfo?(nchevobbe)
Flags: needinfo?(jteh)

Update

There have been 36 failures within the last 7 days:

  • 11 failures on Linux 18.04 x64 WebRender opt
  • 25 failures on Linux 18.04 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=420533819&repo=autoland&lineNumber=3923

There have been 43 total failures in the last 7 days.
There are:

  • 14 failures on linux1804-64-qr opt
  • 29 failures on linux1804-64-shippable-qr opt

Recent failure log.

There have been 39 total failures in the last 7 days.
There are:

  • 14 failures on linux1804-64-qr opt
  • 25 failures on linux1804-64-shippable-qr opt

Recent failure log.

Update

There have been 31 total failures within the last 7 days:

  • 13 failures on Linux 18.04 x64 WebRender opt
  • 18 failures on Linux 18.04 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=424049035&repo=autoland&lineNumber=3308

Update

There have been 31 total failures within the last 7 days:

  • 9 failures on Linux 18.04 x64 WebRender opt
  • 22 failures on Linux 18.04 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=425058312&repo=autoland&lineNumber=4075

Nicolas, are you still working on this?
Thank you.

Flags: needinfo?(nchevobbe)

Update

There have been 32 total failures within the last 7 days:

  • 10 failures on Linux 18.04 x64 WebRender opt
  • 22 failures on Linux 18.04 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=426200516&repo=mozilla-central&lineNumber=4073

Update

There have been 30 total failures within the last 7 days:

10 failures on linux1804-64-qr opt
20 failures on linux1804-64-shippable-qr opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=427812979&repo=autoland&lineNumber=4081

Select the root node before checking the side panel data.

Pushed by nchevobbe@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/88f80ffa78ac
[devtools] Fix browser_accessibility_sidebar_checks.js intermittent. r=devtools-reviewers,ochameau.

https://hg.mozilla.org/mozilla-central/rev/88f80ffa78ac

Status: REOPENED → RESOLVED
Closed: 1 year ago → 9 months ago
status-firefox120: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 120 Branch

this is still happening
recent failure log -> TEST-UNEXPECTED-FAIL | devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js | Test timed out

Status: RESOLVED → REOPENED
status-firefox120: fixed → ---
Resolution: FIXED → ---
Target Milestone: 120 Branch → ---

There have been 37 total failures in the last 7 days.
There are:

  • 8 failures on linux1804-64-qr opt
  • 29 failures on linux1804-64-shippable-qr opt

Recent failure log.

Update:

There have been 32 total failures in the last 7 days.
There are:

  • 6 failures on linux1804-64-qr opt
  • 26 failures on linux1804-64-shippable-qr opt

Recent failure log.

Flags: needinfo?(jteh)
Flags: needinfo?(jteh)
Flags: needinfo?(nchevobbe)

Update:

There have been 42 total failures within the last 7 days:

  • 14 failures on Linux 18.04 x64 WebRender opt
  • 28 failures on Linux 18.04 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=434686295&repo=autoland&lineNumber=4254

[task 2023-11-02T12:44:31.601Z] 12:44:31     INFO - TEST-UNEXPECTED-FAIL | devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js | Test timed out - 
[task 2023-11-02T12:50:41.488Z] 12:50:41     INFO - TEST-UNEXPECTED-TIMEOUT | devtools/client/accessibility/test/browser/browser_accessibility_sidebar_checks.js | application timed out after 370 seconds with no output
[task 2023-11-02T12:50:41.488Z] 12:50:41     INFO - TEST-INFO took 414580ms

Nicolas, any chance you could look into this please?
Thank you.

Flags: needinfo?(nchevobbe)
Whiteboard: [stockwell unknown][stockwell unknown] → [stockwell needswork:owner]
Attachment #9363122 - Attachment description: WIP: Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. → Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures.
Attachment #9363122 - Attachment description: Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. → Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. r=#intermittent-reviewers
Attachment #9363122 - Attachment description: Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. r=#intermittent-reviewers → Bug 1767748 - disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. r=#intermittent-reviewers
Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/3ebc1aa92c2c
disable browser_accessibility_sidebar_checks.js on linux opt for frequent failures. r=devtools-reviewers,nchevobbe DONTBUILD
Keywords: leave-open
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Attachment #9385596 - Attachment is obsolete: true

Test was disabled
Sorry for dropping the ball here :/

Flags: needinfo?(nchevobbe)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: