1784520 - Perma [tier 2] TEST-UNEXPECTED-PASS | devtools/client/accessibility/test/browser/browser_accessibility_relation_navigation.js | We expect at least one assertion to fail because this test file is marked as fail-if in the manifest. -

Status: RESOLVED FIXED

(DevTools :: Accessibility Tools, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=387180138&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CzyQB_A8R3qUDCpxNRwHJg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-08-12T17:09:34.526Z] 17:09:34     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_relation_navigation.js | The main process DevToolsServer has no pending connection when the test ends - 
[task 2022-08-12T17:09:34.527Z] 17:09:34     INFO - Cleaning up...
[task 2022-08-12T17:09:34.529Z] 17:09:34     INFO - Buffered messages finished
[task 2022-08-12T17:09:34.530Z] 17:09:34     INFO - TEST-UNEXPECTED-PASS | devtools/client/accessibility/test/browser/browser_accessibility_relation_navigation.js | We expect at least one assertion to fail because this test file is marked as fail-if in the manifest. - 
[task 2022-08-12T17:09:34.531Z] 17:09:34     INFO - TEST-INFO | expected FAIL
[task 2022-08-12T17:09:34.532Z] 17:09:34     INFO - GECKO(1630) | MEMORY STAT | vsize 20027MB | residentFast 549MB | heapAllocated 271MB
[task 2022-08-12T17:09:34.533Z] 17:09:34     INFO - TEST-OK | devtools/client/accessibility/test/browser/browser_accessibility_relation_navigation.js | took 2374ms

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1688007

Comment 2

[Intermittent Failures Robot]

31 failures in 705 pushes (0.044 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 30
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 22
  • opt: 22
• linux1804-64-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1784520&startday=2022-08-12&endday=2022-08-12&tree=all

Comment 3

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1784520 - Mark browser_accessibility_relation_navigation.js as passing on a11y-checks after being fixed in bug 1688007. r=jdescottes,bomsy

Comment 4

[Intermittent Failures Robot]

49 failures in 3339 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #24 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 29
  • opt: 29
• linux1804-64-shippable-qr: 20
  • opt: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1784520&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 5

[Intermittent Failures Robot]

16 failures in 483 pushes (0.033 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 8
  • opt: 8
• linux1804-64-shippable-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1784520&startday=2022-08-15&endday=2022-08-15&tree=all

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/febe00b2cc21
Mark browser_accessibility_relation_navigation.js as passing on a11y-checks after being fixed in bug 1688007. r=jdescottes,bomsy DONTBUILD

Comment 7

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/febe00b2cc21

Comment 8

[Nicolas Chevobbe [:nchevobbe]]

Thanks for taking care of it Cosmin

Comment 9

[Intermittent Failures Robot]

22 failures in 2916 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 12
  • opt: 12
• linux1804-64-shippable-qr: 10
  • opt: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1784520&startday=2022-08-15&endday=2022-08-21&tree=all