1703620 - Intermittent accessible/tests/browser/events/browser_test_panel.js | Test timed out -

Status: RESOLVED DUPLICATE of bug 1784752

(Core :: Disability Access APIs, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=335730743&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PWmUtvy6S2C25Bx7Gf6ezQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-04-07T17:09:36.637Z] 17:09:36     INFO - TEST-START | accessible/tests/browser/events/browser_test_panel.js
[task 2021-04-07T17:10:21.674Z] 17:10:21     INFO - TEST-INFO | started process screenshot
[task 2021-04-07T17:10:21.764Z] 17:10:21     INFO - TEST-INFO | screenshot: exit 0
[task 2021-04-07T17:10:21.765Z] 17:10:21     INFO - Buffered messages logged at 17:09:36
[task 2021-04-07T17:10:21.765Z] 17:10:21     INFO - Entering test bound 
[task 2021-04-07T17:10:21.765Z] 17:10:21     INFO - TEST-PASS | accessible/tests/browser/events/browser_test_panel.js | Actually remote browser - 
[task 2021-04-07T17:10:21.765Z] 17:10:21     INFO - Buffered messages finished
[task 2021-04-07T17:10:21.765Z] 17:10:21     INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/events/browser_test_panel.js | Test timed out - ```

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1699053

Comment 2

[Intermittent Failures Robot]

13 failures in 3854 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 3
• try: 6

Platform and build breakdown:

• windows10-64-qr: 4
  • opt: 4
• windows10-64-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-04-05&endday=2021-04-11&tree=all

Comment 3

[Intermittent Failures Robot]

16 failures in 4255 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• try: 5
• autoland: 4

Platform and build breakdown:

• windows10-64-shippable-qr: 12
  • opt: 12
• windows10-64-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 4

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 44 failures within the last 7 days:

• 24 failures on Windows 10 x64 WebRender Shippable opt
• 20 failures on Windows 10 x64 WebRender opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=337631985&repo=mozilla-central&lineNumber=2189

[task 2021-04-24T18:27:23.840Z] 18:27:23 INFO - TEST-PASS | accessible/tests/browser/events/browser_test_panel.js | Actually remote browser -
[task 2021-04-24T18:27:23.840Z] 18:27:23 INFO - Buffered messages finished
[task 2021-04-24T18:27:23.840Z] 18:27:23 INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/events/browser_test_panel.js | Test timed out -
[task 2021-04-24T18:27:23.840Z] 18:27:23 INFO - GECKO(5260) | MEMORY STAT | vsize 2104146MB | vsizeMaxContiguous 65476904MB | residentFast 220MB | heapAllocated 76MB
[task 2021-04-24T18:27:23.840Z] 18:27:23 INFO - TEST-OK | accessible/tests/browser/events/browser_test_panel.js | took 45095ms

Comment 5

[Intermittent Failures Robot]

50 failures in 3224 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #15 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 18
• mozilla-central: 21
• mozilla-beta: 7
• try: 4

Platform and build breakdown:

• windows10-64-qr: 19
  • opt: 19
• windows10-64-shippable-qr: 31
  • opt: 31

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-04-19&endday=2021-04-25&tree=all

Comment 6

[James Teh [:Jamie]]

Morgan, could you take a look at this when you get a chance? It seems to be an intermittent test failure caused by the work to remove invisible panels from the a11y tree.

Comment 7

[Morgan Reschenberg [:morgan]]

Yep I'll investigate 😀 kicking off a windows build, might be a bit before I can reproduce. the logs and screenshot on try aren't super helpful, and doesn't seem to wanna fail on macos even with webrender enabled. maybe we're not loading the popup notifications object?

Comment 8

[Morgan Reschenberg [:morgan]]

Hmm I can't reproduce this locally by running with --webrender-endabled or --webredner-enabled --verify :( There's nothing obviously broken in the test that I can tell -- the screenshot from the failure shows a blank page titled "Accessibility Test" and the URL bar has the data URI from the test itself. Our first "check" is an OK to verify that the PopupNotification object isn't null -- and I'm assuming that fetch isn't a problem since we'd either get an object, or find the object isn't init'd and so we'd get a test failure.

Given that the log has no printout, it might be that we're not getting a page load notification and so the test isn't running.

:Jamie didn't you mention there were other tests that had this problem? 🤔

Comment 9

[James Teh [:Jamie]]

Thanks for looking into it.

It looks like yet another instance of the "document never fires events" problem described in bug 1652192 comment 44. This is getting ridiculous. I guess we'll have to sink more time into figuring out why that's happening. 😩

Comment 10

[Intermittent Failures Robot]

55 failures in 3706 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #19 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-central: 22
• mozilla-beta: 9
• try: 4

Platform and build breakdown:

• windows10-64-qr: 20
  • opt: 19
  • debug: 1
• windows10-64-shippable-qr: 32
  • opt: 32
• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 11

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 44 failures in the last 7 days:

• 3 failures on Windows 10 x64 CCov WebRender opt
• 21 failures on Windows 10 x64 WebRender opt
• 20 failures on Windows 10 x64 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=338511480&repo=mozilla-central&lineNumber=2388

[task 2021-05-03T11:25:08.348Z] 11:25:08 INFO - TEST-START | accessible/tests/browser/events/browser_test_panel.js
[task 2021-05-03T11:25:53.369Z] 11:25:53 INFO - TEST-INFO | started process screenshot
[task 2021-05-03T11:25:53.427Z] 11:25:53 INFO - TEST-INFO | screenshot: exit 0
[task 2021-05-03T11:25:53.428Z] 11:25:53 INFO - Buffered messages logged at 11:25:08
[task 2021-05-03T11:25:53.428Z] 11:25:53 INFO - Entering test bound
[task 2021-05-03T11:25:53.429Z] 11:25:53 INFO - TEST-PASS | accessible/tests/browser/events/browser_test_panel.js | Actually remote browser -
[task 2021-05-03T11:25:53.429Z] 11:25:53 INFO - Buffered messages finished
[task 2021-05-03T11:25:53.430Z] 11:25:53 INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/events/browser_test_panel.js | Test timed out -
[task 2021-05-03T11:25:53.430Z] 11:25:53 INFO - GECKO(6400) | MEMORY STAT | vsize 2104147MB | vsizeMaxContiguous 66093365MB | residentFast 212MB | heapAllocated 76MB
[task 2021-05-03T11:25:53.431Z] 11:25:53 INFO - TEST-OK | accessible/tests/browser/events/browser_test_panel.js | took 45075ms

Comment 12

[Morgan Reschenberg [:morgan]]

@Jamie should I disable this?

Comment 13

[James Teh [:Jamie]]

Yes please; I don't see another path forward at this point. :( You can disable it just for these affected jobs with a patch like this one. I'll set the leave-open keyword on this bug so the patch doesn't "fix" the bug, though.

Comment 14

[Intermittent Failures Robot]

16 failures in 641 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 4
• try: 2
• mozilla-beta: 2

Platform and build breakdown:

• windows10-64-qr: 8
  • debug: 1
  • opt: 7
• windows10-64-shippable-qr: 7
  • opt: 7
• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-04&endday=2021-05-04&tree=all

Comment 15

[Morgan Reschenberg [:morgan]]

Attachment: Bug 1703620: Disable browser_test_panel.js on windows 10 builds running webrender r?Jamie

Comment 16

[Intermittent Failures Robot]

25 failures in 633 pushes (0.039 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 10
• mozilla-central: 10
• try: 2
• mozilla-beta: 3

Platform and build breakdown:

• windows10-64-qr: 10
  • opt: 10
• windows10-64-shippable-qr: 12
  • opt: 12
• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-06&endday=2021-05-06&tree=all

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8687d2a8c37e
Disable browser_test_panel.js on windows 10 builds running webrender r=Jamie

Comment 18

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/8687d2a8c37e

Comment 19

[Intermittent Failures Robot]

73 failures in 3279 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 27
• mozilla-central: 25
• try: 7
• mozilla-beta: 14

Platform and build breakdown:

• windows10-64-qr: 28
  • opt: 27
  • debug: 1
• windows10-64-shippable-qr: 38
  • opt: 38
• windows10-64-ccov-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 20

[Morgan Reschenberg [:morgan]]

Attachment: Bug 1703620: Disable browser_test_panel.js on all windows 10 builds r?Jamie

Comment 21

[Intermittent Failures Robot]

4 failures in 3061 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 4

Platform and build breakdown:

• windows10-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 22

[Intermittent Failures Robot]

3 failures in 2908 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform and build breakdown:

• windows10-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 3065 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 24

[Intermittent Failures Robot]

4 failures in 3502 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• windows10-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 25

[Intermittent Failures Robot]

2 failures in 2888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• windows10-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 26

[Intermittent Failures Robot]

2 failures in 3115 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• windows10-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 3711 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2022-02-07&endday=2022-02-13&tree=all

Comment 28

[Intermittent Failures Robot]

4 failures in 3057 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• windows7-32-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1703620&startday=2022-08-01&endday=2022-08-07&tree=all