1842122 - High freq dom/media/webrtc/tests/mochitests/test_peerConnection_simulcast<random> | outbound-rtp.qpSum is at least 0 video test. value=0

Status: RESOLVED FIXED

(Core :: WebRTC: Audio/Video, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=421824146&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SZ6oUtKVTmuQyAfjG_OZbA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-07-07T00:54:10.520Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | remoteId e5434a7b exists in report. 
[task 2023-07-07T00:54:10.521Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | remote ssrc and local ssrc match. 
[task 2023-07-07T00:54:10.521Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | remote object has local object as it's own local object. 
[task 2023-07-07T00:54:10.522Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.firCount is a sane number for a short video test. value=0 
[task 2023-07-07T00:54:10.522Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.pliCount is a sane number for a short video test. value=0 
[task 2023-07-07T00:54:10.523Z] 00:54:10     INFO - Buffered messages finished
[task 2023-07-07T00:54:10.523Z] 00:54:10     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.qpSum is at least 0 video test. value=0 
[task 2023-07-07T00:54:10.523Z] 00:54:10     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:424:16
[task 2023-07-07T00:54:10.523Z] 00:54:10     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:497:13
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:352:10
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html:105:19
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:503:11
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-07-07T00:54:10.524Z] 00:54:10     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html:19:17
[task 2023-07-07T00:54:10.525Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.packetsSent is a sane number for a short video test. value=94 
[task 2023-07-07T00:54:10.525Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.bytesSent is a sane number for a short video test. value=1773 
[task 2023-07-07T00:54:10.525Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.headerBytesSent is a sane number for a short video test. value=21228 
[task 2023-07-07T00:54:10.525Z] 00:54:10     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_simulcastAnswer_oldSetParameters.html | outbound-rtp.retransmittedPacketsSent is a sane number for a short video test. value=0 

Comment 1

[Norisz Fay [:noriszfay]]

Hello, could this be a regression caused by the latest webrtc changes landed on central (Bug 1839451)? It only started failing on autoland once the merge back from central (with Bug 1839451) was done. Thank you!

Comment 2

[Michael Froman [:mjf]]

Looks like this has existed for a while (see Bug 1833967), but the new libwebrtc merge may be provoking it more often. At any rate, it looks like the test was written incorrectly. See here where we're testing for stat.qpSum > 0, but the test message says "at least 0".

Comment 3

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

Attachment: Bug 1842122 - fix test of stats.qpSum to match assert message: that it is "at least 0", i.e. 0 is allowed. r?mjf

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e81905d4d194
fix test of stats.qpSum to match assert message: that it is "at least 0", i.e. 0 is allowed. r=mjf

Comment 5

[Intermittent Failures Robot]

32 failures in 625 pushes (0.051 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 24
• mozilla-central: 7
• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 6
  • debug: 3
  • opt: 3
• windows11-64-2009-asan-qr: 17
  • opt: 17
• windows11-32-2009-qr: 5
  • debug: 2
  • opt: 3
• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-64-2009-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1842122&startday=2023-07-07&endday=2023-07-07&tree=all

Comment 6

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/e81905d4d194

Comment 7

[Intermittent Failures Robot]

34 failures in 2956 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• autoland: 24
• try: 1

Platform and build breakdown:

• windows11-64-2009-asan-qr: 18
  • opt: 18
• windows11-64-2009-qr: 6
  • debug: 3
  • opt: 3
• windows11-32-2009-qr: 5
  • debug: 2
  • opt: 3
• windows11-64-2009-shippable-qr: 3
  • opt: 3
• windows11-32-2009-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1842122&startday=2023-07-03&endday=2023-07-09&tree=all