1831695 - Intermittent dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | single tracking bug

Status: RESOLVED INCOMPLETE

(Core :: WebRTC: Audio/Video, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: jolin [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=414443791&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/T9sW7iA0R06YeVRhi1Q4vw/runs/0/artifacts/public/logs/live_backing.log

---

Enabling WMF software H.264 encoder causes some intermittent WebRTC stats test failures. This bug is filed to track it.

Comment 1

[Intermittent Failures Robot]

1 failures in 3411 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-05-01&endday=2023-05-07&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1818567

Comment 3

[Intermittent Failures Robot]

4 failures in 3578 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2

Platform and build breakdown:

• windows11-64-2009-asan-qr: 2
  • opt: 2
• windows11-64-2009-qr: 2
  • debug: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 4

[Intermittent Failures Robot]

15 failures in 3946 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 3
• try: 4

Platform and build breakdown:

• windows11-64-2009-qr: 5
  • opt: 4
  • debug: 1
• windows11-32-2009-shippable-qr: 3
  • opt: 3
• windows11-64-2009-shippable-qr: 2
  • opt: 2
• windows11-32-2009-qr: 2
  • opt: 1
  • debug: 1
• windows11-64-2009-asan-qr: 2
  • opt: 2
• windows11-64-2009-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-05-22&endday=2023-05-28&tree=all

Comment 5

[Intermittent Failures Robot]

29 failures in 3471 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #45 most frequent failure this week.

Repository breakdown:

• try: 2
• mozilla-central: 9
• autoland: 18

Platform and build breakdown:

• windows11-64-2009-qr: 9
  • opt: 6
  • debug: 3
• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-32-2009-qr: 2
  • opt: 1
  • debug: 1
• windows11-64-2009-asan-qr: 13
  • opt: 13
• windows11-64-2009-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-05-29&endday=2023-06-04&tree=all

Comment 6

[Cristina Horotan [:chorotan]]

There have been 43total failures in the last 7 days.
There are:

• 3 failures on windows11-32-2009-qr opt and debug
• 1 failure on windows11-32-2009-shippable-qr opt
• 25 failures on windows11-64-2009-asan-qr opt
• 10 failures on windows11-64-2009-qr opt and debug
• 4 failures on windows11-64-2009-shippable-qr opt

Recent failure log.

Jan, as the owner of this component, can you help us assign the bug to someone? Thank you.

Comment 7

[Natalia Csoregi [:nataliaCs]]

John is already assigned on the bug.
Removing Jan's needinfo.

Comment 8

[Intermittent Failures Robot]

55 failures in 3885 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #15 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 31
• mozilla-central: 17
• try: 5
• mozilla-beta: 2

Platform and build breakdown:

• windows11-64-2009-asan-qr: 30
  • opt: 30
• windows11-64-2009-qr: 6
  • debug: 5
  • opt: 1
• windows11-32-2009-qr: 6
  • opt: 4
  • debug: 2
• windows11-64-2009-shippable-qr: 3
  • opt: 3
• windows11-32-2009-shippable-qr: 7
  • opt: 7
• windows11-64-2009-ccov-qr: 1
  • opt: 1
• windows11-64-2009-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-05&endday=2023-06-11&tree=all

Comment 9

[Serban Stanca [:SerbanS]]

There have been 58 total failures in the last 7 days.
There are:

• 35 failures on Windows 11 x64 22H2 asan WebRender opt
• 5 failures on Windows 11 x64 22H2 WebRender Shippable opt
• 5 failures on Windows 11 x64 22H2 WebRender debug
• 4 failures on Windows 11 x86 22H2 WebRender Shippable opt
• 4 failures on Windows 11 x86 22H2 WebRender debug
• 3 failures on Windows 11 x86 22H2 WebRender opt
• 1 failure on Windows 11 x64 22H2 WebRender opt
• 1 failure on Windows 11 x64 22H2 CCov WebRender opt

Recent failure log.

[task 2023-06-18T01:05:43.450Z] 01:05:43     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.pliCount is a sane number for a short video test. value=0 
[task 2023-06-18T01:05:43.450Z] 01:05:43     INFO - Buffered messages finished
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.qpSum is at least 0 video test. value=0 
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:424:16
[task 2023-06-18T01:05:43.451Z] 01:05:43     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:498:13
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:353:10
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html:105:19
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:503:11
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html:19:17
[task 2023-06-18T01:05:43.453Z] 01:05:43     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | outbound-rtp.packetsSent is a sane number for a short video test. value=79 

Comment 10

[Intermittent Failures Robot]

63 failures in 4079 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #13 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 17
• autoland: 38
• try: 5
• mozilla-beta: 2
• mozilla-esr115: 1

Platform and build breakdown:

• windows11-64-2009-asan-qr: 35
  • opt: 35
• windows11-32-2009-qr: 7
  • debug: 3
  • opt: 4
• windows11-32-2009-shippable-qr: 7
  • opt: 7
• windows11-64-2009-qr: 6
  • debug: 5
  • opt: 1
• windows11-64-2009-ccov-qr: 1
  • opt: 1
• windows11-64-2009-shippable-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-12&endday=2023-06-18&tree=all

Comment 11

[Intermittent Failures Robot]

15 failures in 776 pushes (0.019 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 6
• autoland: 8
• try: 1

Platform and build breakdown:

• windows11-64-2009-asan-qr: 11
  • opt: 11
• windows11-64-2009-qr: 1
  • debug: 1
• windows11-64-2009-shippable-qr: 1
  • opt: 1
• windows11-32-2009-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-20&endday=2023-06-20&tree=all

Comment 12

[Cosmin Sabou [:CosminS]]

John, any updates on this one? It is on the disable recommended list with 183 total failures, all on windows: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2023-05-24&endday=2023-06-23&tree=trunk&failurehash=all&bug=1831695

Comment 13

[Serban Stanca [:SerbanS]]

Attachment: Bug 1831695 - disable test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html on win for causing frequent failures. r=#intermittent-reviewers

Comment 14

[Serban Stanca [:SerbanS]]

This bug has 194 total failures in the last 30 days and made a disable patch until there's a fix in place.

Comment 15

[Intermittent Failures Robot]

15 failures in 606 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 2

Platform and build breakdown:

• windows11-64-2009-qr: 5
  • debug: 4
  • opt: 1
• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-64-2009-asan-qr: 7
  • opt: 7
• windows11-32-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-23&endday=2023-06-23&tree=all

Comment 16

[Intermittent Failures Robot]

67 failures in 3880 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #13 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 47
• try: 5
• mozilla-central: 15

Platform and build breakdown:

• windows11-64-2009-asan-qr: 39
  • opt: 39
• windows11-64-2009-qr: 11
  • debug: 7
  • opt: 4
• windows11-32-2009-qr: 7
  • opt: 7
• windows11-32-2009-shippable-qr: 8
  • opt: 8
• windows11-64-2009-shippable-qr: 1
  • opt: 1
• windows11-64-2009-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-19&endday=2023-06-25&tree=all

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7c2054186233
disable test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html on win for causing frequent failures. r=intermittent-reviewers,MasterWayZ

Comment 18

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/7c2054186233

Comment 19

[Intermittent Failures Robot]

28 failures in 3594 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #50 most frequent failure this week.

Repository breakdown:

• autoland: 17
• mozilla-central: 11

Platform and build breakdown:

• windows11-32-2009-qr: 3
  • debug: 2
  • opt: 1
• windows11-64-2009-asan-qr: 18
  • opt: 18
• windows11-64-2009-qr: 3
  • debug: 3
• windows11-64-2009-shippable-qr: 2
  • opt: 2
• windows11-32-2009-shippable-qr: 1
  • opt: 1
• windows11-64-2009-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-06-26&endday=2023-07-02&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 2956 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-07-03&endday=2023-07-09&tree=all

Comment 21

[Byron Campen [:bwc]]

If this is just because of bug 1847093, we ought to be able to re-enable this test if we pref off the platform encoder.

Comment 22

[Natalia Csoregi [:nataliaCs]]

Update

There have been 33 total failures wihtin the last 7 days:

• 14 failures on OS X 10.15 WebRender debug
• 7 failures on Linux 18.04 x64 WebRender Shippable opt
• 9 failures on Linux 18.04 x64 WebRender opt
• 1 failure on Linux 18.04 x64 CCov WebRender opt
• 2 failures on Linux 18.04 x64 WebRender asan opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=441301885&repo=autoland&lineNumber=75389

[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Buffered messages logged at 14:44:00
[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Drawing color 0,255,0,1
[task 2023-12-24T14:44:01.158Z] 14:44:01     INFO - Drawing color 255,0,0,1
[task 2023-12-24T14:44:01.159Z] 14:44:01     INFO - Buffered messages finished
[task 2023-12-24T14:44:01.159Z] 14:44:01     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | Test timed out. - 
[task 2023-12-24T14:44:01.592Z] 14:44:01     INFO - Drawing color 0,255,0,1
[task 2023-12-24T14:44:02.206Z] 14:44:02     INFO - GECKO(4560) | MEMORY STAT | vsize 6890MB | residentFast 191MB | heapAllocated 21MB
[task 2023-12-24T14:44:02.207Z] 14:44:02     INFO - Drawing color 255,0,0,1
[task 2023-12-24T14:44:02.287Z] 14:44:02     INFO - TEST-OK | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_lowResFirst_oldSetParameters.html | took 318035ms

John, are there any updates?
Thank you.

Comment 23

[Intermittent Failures Robot]

39 failures in 3349 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 24
• mozilla-central: 9
• try: 6

Platform and build breakdown:

• macosx1015-64-qr: 19
  • debug: 19
• linux1804-64-qr: 10
  • opt: 10
• linux1804-64-shippable-qr: 7
  • opt: 7
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-12-18&endday=2023-12-24&tree=all

Comment 24

[Intermittent Failures Robot]

31 failures in 1162 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 17
• mozilla-central: 11
• try: 3

Platform and build breakdown:

• linux1804-64-asan-qr: 3
  • opt: 3
• macosx1015-64-qr: 13
  • debug: 13
• linux1804-64-qr: 10
  • opt: 10
• linux1804-64-shippable-qr: 4
  • opt: 4
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2023-12-25&endday=2023-12-31&tree=all

Comment 25

[Intermittent Failures Robot]

5 failures in 2274 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-qr: 3
  • opt: 3
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2024-01-01&endday=2024-01-07&tree=all

Comment 27

[John Lin [:jhlin][:jolin]]

No intermittent failures for a while. Clearing needinfo.

Comment 28

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 29

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Table

	!fission	no_variant	socketprocess_e10s	socketprocess_e10s+!fission	spi	swgl	swgl+!fission
linux2404-x86_64/opt					1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831695&startday=2025-06-23&endday=2025-06-29&tree=all