Closed Bug 1777082 Opened 3 years ago Closed 4 months ago

Intermittent dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | single tracking bug

Categories

(Core :: WebRTC: Audio/Video, defect, P3)

defect

Tracking

()

RESOLVED INCOMPLETE

People

(Reporter: jmaher, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, intermittent-testcase, regression)

Attachments

(1 file, 2 obsolete files)

No description provided.

Additional information about this bug failures and frequency patterns can be found by running: ./mach test-info failure-report --bug 1777082

There are 71 total failures in the last 7 days on

[task 2022-09-02T15:57:53.330Z] 15:57:53     INFO - TEST-START | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html
[task 2022-09-02T15:57:53.355Z] 15:57:53     INFO - GECKO(2389) | TEST DEVICES: No test device found in media.audio_loopback_dev, using fake audio streams.
[task 2022-09-02T15:57:53.356Z] 15:57:53     INFO - GECKO(2389) | TEST DEVICES: No test device found in media.video_loopback_dev, using fake video streams.
[task 2022-09-02T15:57:53.376Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:367: PeerConnectionImpl: PeerConnectionImpl constructor for
[task 2022-09-02T15:57:53.377Z] 15:57:53     INFO - GECKO(2389) | [Parent 2389: Socket Thread]: D/mtransport NrIceCtx static call to find local stun addresses
[task 2022-09-02T15:57:53.377Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:367: PeerConnectionImpl: PeerConnectionImpl constructor for
[task 2022-09-02T15:57:53.377Z] 15:57:53     INFO - GECKO(2389) | [Parent 2389: Socket Thread]: D/mtransport NrIceCtx static call to find local stun addresses
[task 2022-09-02T15:57:53.380Z] 15:57:53     INFO - GECKO(2389) | TEST DEVICES: No test device found in media.audio_loopback_dev, using fake audio streams.
[task 2022-09-02T15:57:53.380Z] 15:57:53     INFO - GECKO(2389) | TEST DEVICES: No test device found in media.video_loopback_dev, using fake video streams.
[task 2022-09-02T15:57:53.380Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:3302: OnStunAddrsAvailable: receiving (9) stun addrs
[task 2022-09-02T15:57:53.380Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:3302: OnStunAddrsAvailable: receiving (9) stun addrs
[task 2022-09-02T15:57:53.381Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Socket Thread]: I/mtransport NrIceCtx(PC:{c1048cf9-db63-4161-94a7-438f7e4838a6} 1662134273376325 (id=8589934851 url=https://example.com/tests/dom/media/webrtc/tests/moc): SetStunServers
[task 2022-09-02T15:57:53.381Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Socket Thread]: I/mtransport NrIceCtx(PC:{c1048cf9-db63-4161-94a7-438f7e4838a6} 1662134273376325 (id=8589934851 url=https://example.com/tests/dom/media/webrtc/tests/moc): SetTurnServers
[task 2022-09-02T15:57:53.381Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Socket Thread]: I/mtransport NrIceCtx(PC:{48e8833b-f394-49e7-ad9b-e46d8016a6d5} 1662134273376624 (id=8589934851 url=https://example.com/tests/dom/media/webrtc/tests/moc): SetStunServers
[task 2022-09-02T15:57:53.381Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Socket Thread]: I/mtransport NrIceCtx(PC:{48e8833b-f394-49e7-ad9b-e46d8016a6d5} 1662134273376624 (id=8589934851 url=https://example.com/tests/dom/media/webrtc/tests/moc): SetTurnServers
[task 2022-09-02T15:57:53.385Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|sdp_config] sdp_config.c:86: SDP: Initialized config pointer: 11f209750
[task 2022-09-02T15:57:53.385Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/jsep [{c1048cf9-db63-4161-94a7-438f7e4838a6} 1662134273376325 (id=8589934851 url=https://example.com/tests/dom/media/webrtc/tests/moc]: stable -> have-local-offer
[task 2022-09-02T15:57:53.386Z] 15:57:53     INFO - GECKO(2389) | [Child 2394: Main Thread]: I/signaling [main|sdp_config] sdp_config.c:86: SDP: Initialized config pointer: 11f208e20
[task 2022-09-02T15:57:53.386Z] 15:57:53     INFO - GECKO(2389) | (generic/INFO) Exit UDP socket connected

task 2022-09-02T15:57:54.538Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.id is the same as the report key. 
[task 2022-09-02T15:57:54.538Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.timestamp is not less than 0 
[task 2022-09-02T15:57:54.538Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.timestamp is relative to current time, date=Fri Sep 02 2022 15:57:54 GMT+0000 (Greenwich Mean Time) 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.ssrc has a value 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.kind is 'audio' or 'video' 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.mediaType is 'audio' or 'video' 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | kind equals legacy mediaType 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.codecId has a value 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | codecId 5ef9de51 exists in report 
[task 2022-09-02T15:57:54.539Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | codecId 5ef9de51 in report is codec type 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | codecId 5ef9de51 in report is for a mimeType of the same media type as the referencing rtp stream stat 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | remoteId 24a8ae9f exists in report. 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | remote ssrc and local ssrc match. 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | remote object has local object as it's own local object. 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.firCount is a sane number for a short video test. value=0 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.pliCount is a sane number for a short video test. value=0 
[task 2022-09-02T15:57:54.540Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.packetsReceived is a sane number for a short video test. value=8 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.packetsDiscarded is sane number for a short test. value=0 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.bytesReceived is a sane number for a short video test. value=3283 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.packetsLost is a sane number for a short video test. value=0 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitter is sane number for a video local only test. value=0.0010777777777777778 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - Buffered messages finished
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short video test. value=7 
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:414:16
[task 2022-09-02T15:57:54.541Z] 15:57:54     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:503:9
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:314:10
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - PC_REMOTE_TEST_REMOTE_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1384:19
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferDelay is a sane number for a short video test. value=0.145/7=0.020714285714285713 
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp does not have field totalSamplesReceived when kind is not 'audio' 
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp does not have field concealedSamples when kind is not 'audio' 
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp does not have field silentConcealedSamples when kind is not 'audio' 
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field firCount when kind is video 
[task 2022-09-02T15:57:54.542Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field pliCount when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field framesDecoded when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field discardedPackets when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field framesPerSecond when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field frameWidth when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field frameHeight when kind is video 
[task 2022-09-02T15:57:54.543Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp has field framesReceived when kind is video 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.discardedPackets is a sane number for a short test. value=0 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.framesPerSecond is a sane number for a short video test. value=10 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.framesDecoded is a sane number for a short video test. value=7 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.frameWidth is a sane number for a short video test. value=undefined 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.frameHeight is a sane number for a short video test. value=240 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.framesReceived is a sane number for a short video test. value=8 
[task 2022-09-02T15:57:54.544Z] 15:57:54     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.id was tested. 

Jib, can you please take a look?

Flags: needinfo?(jib)
Whiteboard: [stockwell needswork:owner]
Assignee: nobody → apavel
Status: NEW → ASSIGNED
Assignee: apavel → nobody
Status: ASSIGNED → NEW
Keywords: leave-open
Whiteboard: [stockwell needswork:owner] → [stockwell needswork:owner][stockwell disabled]
Pushed by apavel@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/d449e6c138f4 disable test_peerConnection_videoCodecs.html to reduce failure rate r=intermittent-reviewers,jmaher DONTBUILD
Whiteboard: [stockwell disabled][stockwell disable-recommended] → [stockwell disabled]

[task 2022-09-02T15:57:54.541Z] 15:57:54 INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short video test. value=7

This seems like an inherently racy tests. Log contains values of 4 and 6 presumably passing, and 7 which does not. Should we just raise the ceiling here?

Flags: needinfo?(jib) → needinfo?(jmuizelaar)

There have been 30 total failures in the last 7 days.
There are:

  • 4 failures on Windows 11 x64 22H2 WebRender Shippable opt
  • 13 failures on Windows 11 x64 22H2 WebRender debug
  • 9 failures on Windows 11 x86 22H2 WebRender opt
  • 1 failure on Windows 11 x86 22H2 WebRender Shippable opt
  • 1 failure on OS X 10.15 WebRender Shippable opt
  • 1 failure on OS X 10.15 WebRender opt
  • 1 failure on Linux 18.04 x64 WebRender opt

Recent failure log.


[task 2023-11-06T00:08:02.877Z] 00:08:02     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short video test. value=43 
[task 2023-11-06T00:08:02.877Z] 00:08:02     INFO - Buffered messages finished
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferDelay is a sane number for a short video test. value=0.039088/43=0.0009090232558139535 
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:426:16
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:588:9
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:352:10
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - PC_REMOTE_TEST_REMOTE_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1637:19
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - promise callback*PC_REMOTE_TEST_REMOTE_STATS@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1635:47
[task 2023-11-06T00:08:02.880Z] 00:08:02     INFO - execute/</<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1086:32
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - promise callback*execute/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1084:21
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - execute@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1079:8
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - PeerConnectionTest.prototype.run@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:556:22
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - testVideoCodec@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html:91:16
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html:128:15
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:502:11
[task 2023-11-06T00:08:02.881Z] 00:08:02     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-11-06T00:08:02.882Z] 00:08:02     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html:104:17
[task 2023-11-06T00:08:02.882Z] 00:08:02     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp does not have field totalSamplesReceived when kind is not 'audio' 

Hello Jan-Ivar, any chance you could help us assign this to someone?

Thank you!

Flags: needinfo?(jib)
Whiteboard: [stockwell disabled] → [stockwell disabled][stockwell needswork:owner]

(In reply to Serban Stanca [:SerbanS] from comment #84)

[task 2023-11-06T00:08:02.880Z] 00:08:02 INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_videoCodecs.html | inbound-rtp.jitterBufferDelay is a sane number for a short video test. value=0.039088/43=0.0009090232558139535

That is juuust shy of avgJitterBufferDelay > 0.001. Dan, should we expand the goal post a bit more?

Flags: needinfo?(jib) → needinfo?(dbaker)
Attachment #9362256 - Attachment is obsolete: true

Changes landed over in bug 1780717 that should fix this.

Flags: needinfo?(dbaker)
Flags: needinfo?(jmuizelaar)
Keywords: leave-open
Whiteboard: [stockwell disabled][stockwell needswork:owner]
Attachment #9387700 - Attachment is obsolete: true
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 1 year ago11 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 11 months ago7 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 7 months ago5 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 5 months ago4 months ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: