Closed Bug 1781917 Opened 2 years ago Closed 2 years ago

Frequent toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. -

Categories

(Toolkit :: Video/Audio Controls, defect, P5)

defect
Points:
5

Tracking

()

RESOLVED FIXED
106 Branch
Tracking Status
firefox-esr91 --- unaffected
firefox-esr102 --- unaffected
firefox103 --- unaffected
firefox104 --- unaffected
firefox105 --- disabled
firefox106 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: bigiri)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(3 files)

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=385596189&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EXFIjPEyQ4G88pMgmK4Fxg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EXFIjPEyQ4G88pMgmK4Fxg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2022-07-27T18:04:32.247Z] 18:04:32     INFO - TEST-START | toolkit/content/tests/widgets/test_videocontrols_audio.html
[task 2022-07-27T18:05:00.136Z] 18:05:00     INFO - GECKO(1907) | 2022-07-27 18:05:00.135 firefox[1907:32377] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)
[task 2022-07-27T18:09:32.996Z] 18:09:32     INFO - TEST-INFO | started process screencapture
[task 2022-07-27T18:09:33.082Z] 18:09:33     INFO - TEST-INFO | screencapture: exit 0
[task 2022-07-27T18:09:33.082Z] 18:09:33     INFO - Buffered messages logged at 18:04:33
[task 2022-07-27T18:09:33.082Z] 18:09:33     INFO - TEST-PASS | toolkit/content/tests/widgets/test_videocontrols_audio.html | Fullscreen button is hidden 
[task 2022-07-27T18:09:33.083Z] 18:09:33     INFO - Buffered messages finished
[task 2022-07-27T18:09:33.083Z] 18:09:33     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. - 
[task 2022-07-27T18:09:34.033Z] 18:09:34     INFO - GECKO(1907) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2022-07-27T18:09:34.034Z] 18:09:34     INFO - GECKO(1907) | MEMORY STAT | vsize 14778MB | residentFast 74MB | heapAllocated 8MB
[task 2022-07-27T18:09:34.041Z] 18:09:34     INFO - TEST-OK | toolkit/content/tests/widgets/test_videocontrols_audio.html | took 301793ms
[task 2022-07-27T18:09:34.043Z] 18:09:34     INFO - TEST-START | Shutdown
[task 2022-07-27T18:09:34.043Z] 18:09:34     INFO - Passed:  1
[task 2022-07-27T18:09:34.044Z] 18:09:34     INFO - Failed:  0
[task 2022-07-27T18:09:34.044Z] 18:09:34     INFO - Todo:    0
[task 2022-07-27T18:09:34.045Z] 18:09:34     INFO - Mode:    e10s
[task 2022-07-27T18:09:34.045Z] 18:09:34     INFO - Slowest: 301793ms - /tests/toolkit/content/tests/widgets/test_videocontrols_audio.html
[task 2022-07-27T18:09:34.046Z] 18:09:34     INFO - SimpleTest FINISHED
[task 2022-07-27T18:09:34.046Z] 18:09:34     INFO - TEST-INFO | Ran 1 Loops
[task 2022-07-27T18:09:34.047Z] 18:09:34     INFO - SimpleTest FINISHED
[task 2022-07-27T18:09:34.061Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.062Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.062Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.063Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.063Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.063Z] 18:09:34     INFO - GECKO(1907) | [GFX1-]: Receive IPC close with reason=AbnormalShutdown
[task 2022-07-27T18:09:34.064Z] 18:09:34     INFO - GECKO(1907) | Exiting due to channel error.
[task 2022-07-27T18:09:34.176Z] 18:09:34     INFO - TEST-INFO | Main app process: exit 0
[task 2022-07-27T18:09:34.176Z] 18:09:34     INFO - runtests.py | Application ran for: 0:05:04.408668

:mcomella, since you are the author of the regressor, bug 1775499, could you take a look?
For more information, please visit auto_nag documentation.

Flags: needinfo?(michael.l.comella)
Summary: Intermittent TV toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. - → Intermittent [tier 2] toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. -

Set release status flags based on info from the regressing bug 1775499

Summary: Intermittent [tier 2] toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. - → Intermittent toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. -
Flags: needinfo?(michael.l.comella) → needinfo?(bigiri)
Regressed by: 1776222
No longer regressed by: 1775499
Summary: Intermittent toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. - → Frequent toolkit/content/tests/widgets/test_videocontrols_audio.html | Test timed out. -
Assignee: nobody → bigiri
Status: NEW → ASSIGNED
Flags: needinfo?(bigiri)
Attachment #9287983 - Attachment description: WIP: Bug 1781917 - Fixed broken test → Bug 1781917 - Fixed broken test

Hi Bernard, I've made a disabling patch until the patch you posted has the all the updates needed. Please re-enable the test in your patch if the disable gets landed sooner.

Flags: needinfo?(bigiri)

Okay.

Flags: needinfo?(bigiri)
Attachment #9287983 - Attachment description: Bug 1781917 - Fixed broken test → Bug 1781917 - Fixed broken test r=gijs!
Attachment #9287983 - Attachment description: Bug 1781917 - Fixed broken test r=gijs! → Bug 1781917 - Try to make test_videocontrols_audio.html more robust to address the frequent failures. r=gijs

The following patch is waiting for review from an inactive reviewer:

ID Title Author Reviewer Status
D153385 Bug 1781917 - Try to make test_videocontrols_audio.html more robust to address the frequent failures. r=gijs bigiri Gijs: Back Aug 24, 2022

:bigiri, could you please find another reviewer?

For more information, please visit auto_nag documentation.

Flags: needinfo?(bigiri)
Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/c97989ad6a32
temporarily disable test_videocontrols_audio.html r=intermittent-reviewers,jmaher DONTBUILD
Keywords: leave-open
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]

I've approved on phab but please keep the commit message that Cosmin updated (thank you!) and please remember to update mochitest.ini to undo the disabling.

Flags: needinfo?(bigiri)

Will take of it, thank you Gijs and have a nice time OOO.

Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/17aff5e9bb24
Backed out changeset c97989ad6a32 for not being necessary anymore.
https://hg.mozilla.org/integration/autoland/rev/16345a72c5b6
Try to make test_videocontrols_audio.html more robust to address the frequent failures. r=Gijs
Keywords: leave-open
Whiteboard: [stockwell disabled]

It's still failing but let's see a failure rate over the next days.

Keywords: leave-open

I'm a bit confused about what I should do next with this ticket. I'm thinking of submitting a patch that adds more detailed logging to this test so that we can get more detail on the failure cases, and then a follow up patch to re-enable the test, remove the excessive logging, possibly applying any necessary fixes. To my mind that sounds like two follow up tickets. How should I proceed?

Flags: needinfo?(gijskruitbosch+bugs)
Flags: needinfo?(csabou)

Bernard, the test is enabled and still failing. If you have further takes on how to make these failures goes away it would be welcomed to give it a go. As you can see from Bug 1784716, the failure rate is still pretty high: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2022-08-10&endday=2022-08-17&tree=trunk&bug=1784716. If not eventually it will end up being disabled.
I'd say add patches to this bug until it's fixed.

Flags: needinfo?(csabou) → needinfo?(bigiri)

Will do.

Flags: needinfo?(bigiri)
Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/19a9274fe94f
disable test_videocontrols_audio.html on windows and mac opt for frequent failures. r=jmaher

Went on and disabled the test here until it's fixed because of the failure rate in the last week after the patch landed. https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2022-08-12&endday=2022-08-19&tree=trunk&bug=1784716
Bernard, please re-enable the test when landing a patch here.

Flags: needinfo?(gijskruitbosch+bugs)
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]

Adding more logging to test test_videocontrols_audio.html test to gather more information about test failure. Also, added test events to EventLogger to reduce the risk of timing related test failures.

Attachment #9291240 - Attachment description: Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=mhowell! → WIP: Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=gijs!
Attachment #9291240 - Attachment description: WIP: Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=gijs! → WIP: Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=mhowell!
Attachment #9291240 - Attachment description: WIP: Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=mhowell! → Bug 1781917 - Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=mhowell!
Pushed by bigiri@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/f7c6471c56a7
Add logging to test_videocontrols_audio.html to get information about the frequent failures. r=mhowell
Points: --- → 5

Fixed with comment 42.

Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Keywords: leave-open
Resolution: --- → FIXED
Whiteboard: [stockwell disabled]
Target Milestone: --- → 106 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: