1781321 - Perma devtools/server/tests/browser/browser_accessibility_text_label_audit.js | single tracking bug

Status: RESOLVED FIXED

(DevTools :: Accessibility Tools, defect, P3)

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Additional information about this bug failures and frequency patterns can be found by running: ./mach test-info failure-report --bug 1781321

Comment 3

[Intermittent Failures Robot]

25 failures in 686 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 25

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 4
  • opt: 5
• linux1804-64-asan-qr: 3
  • opt: 3
• macosx1015-64-qr: 3
  • debug: 2
  • opt: 1
• windows10-64-2004-qr: 5
  • opt: 3
  • debug: 2
• windows10-64-2004-asan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781321&startday=2022-11-03&endday=2022-11-03&tree=all

Comment 4

[BugBot [:suhaib / :marco]]

Set release status flags based on info from the regressing bug 1748585

:nlapre, since you are the author of the regressor, bug 1748585, could you take a look?

For more information, please visit auto_nag documentation.

Comment 5

[Cristian Tuns]

Backfills link: https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&fromchange=7a26d2290b51df8a28c18073dfcb077e0577e5d0&searchStr=Windows%2C10%2Cx64%2C2004%2CWebRender%2Cdebug%2CMochitests%2Cwith%2Cnetworking%2Con%2Csocket%2Cprocess%2Ctest-windows10-64-2004-qr%2Fdebug-mochitest-devtools-chrome-spi-nw%2Cdt4&tochange=01a1ef64e2ee1480ab3940a456e998af86e3230e&selectedTaskRun=XCDfMP8mQvOzTaNzmBmAvw.0

Comment 6

[Nathan LaPré]

Yup, looks like my fault, sorry. Will have a patch to update the test today. To summarize, there's a test that has an img element with alt="". I made a change to the accessibility code so that we no longer create an accessible for images with empty alt text (this is now considered decorative). I think the solution here is simply to remove the test since it's no longer intended for an accessible to be created here.

Comment 7

[Nathan LaPré]

Attachment: Bug 1781321: Fix devtools browser a11y tests for img elements with no alt text, r?nchevobbe

This revision fixes these failing tests. I made a change in Bug 1748585 which
causes img elements with alt="" to be considered decorative (in most cases).
These tests rely on the accessible existing in the tree, so I've removed them.
I don't think it makes sense to test this any more. FWIW, I've made the same
changes to accessibility tests in the accessible directory.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b1f1440164f8
Fix devtools browser a11y tests for img elements with no alt text, r=morgan

Comment 9

[Intermittent Failures Robot]

224 failures in 686 pushes (0.327 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 152
• mozilla-central: 52
• try: 20

Platform and build breakdown:

• macosx1015-64-qr: 30
  • debug: 20
  • opt: 10
• windows10-64-2004-qr: 28
  • debug: 18
  • opt: 10
• linux1804-64-qr: 69
  • debug: 36
  • opt: 33
• windows10-64-2004-asan-qr: 10
  • opt: 10
• linux1804-64-asan-qr: 23
  • opt: 23
• linux1804-64-shippable-qr: 31
  • opt: 31
• macosx1015-64-shippable-qr: 12
  • opt: 12
• windows10-64-2004-shippable-qr: 12
  • opt: 12
• windows10-64-2004-ccov-qr: 3
  • opt: 3
• windows10-64-2004-devedition-qr: 2
  • opt: 2
• linux1804-64-devedition-qr: 2
  • opt: 2
• macosx1015-64-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781321&startday=2022-11-04&endday=2022-11-04&tree=all

Comment 10

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/b1f1440164f8

Comment 11

[Intermittent Failures Robot]

254 failures in 3626 pushes (0.07 failures/push) were associated with this bug in the last 7 days.

This is the #4 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 182
• mozilla-central: 52
• try: 20

Platform and build breakdown:

• linux1804-64-qr: 78
  • debug: 40
  • opt: 38
• macosx1015-64-qr: 34
  • debug: 22
  • opt: 12
• windows10-64-2004-qr: 37
  • opt: 13
  • debug: 24
• windows10-64-2004-asan-qr: 11
  • opt: 11
• linux1804-64-asan-qr: 26
  • opt: 26
• linux1804-64-shippable-qr: 34
  • opt: 34
• windows10-64-2004-shippable-qr: 13
  • opt: 13
• macosx1015-64-shippable-qr: 12
  • opt: 12
• windows10-64-2004-ccov-qr: 3
  • opt: 3
• windows10-64-2004-devedition-qr: 2
  • opt: 2
• linux1804-64-devedition-qr: 2
  • opt: 2
• macosx1015-64-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781321&startday=2022-10-31&endday=2022-11-06&tree=all