Closed Bug 1876517 Opened 2 years ago Closed 2 years ago

[wpt-sync] Sync PR 44202 - webrtc wpt: modernize RTCRtpReceiver/RTCRtpSender getStats tests

Categories

(Core :: WebRTC, task, P4)

Product:
Core
Component:
WebRTC
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
124 Branch
Tracking Flags:
Tracking Status
firefox124 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 44202 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/44202
Details from upstream follow.

Philipp Hancke <phancke@microsoft.com> wrote:

webrtc wpt: modernize RTCRtpReceiver/RTCRtpSender getStats tests

Bug: chromium:1395574
Change-Id: Iabb2ce9e81f44ed5fd43a3ba58783b9894f03abe
Reviewed-on: https://chromium-review.googlesource.com/5233703
WPT-Export-Revision: a2a42386f546245739e98d37e2f789c41ffb552e

Component: web-platform-tests → WebRTC
Product: Testing → Core

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 3 tests and 265 subtests

Status Summary

Firefox

OK : 3
PASS : 155
FAIL : 105
PRECONDITION_FAILED: 15

Chrome

OK : 3
PASS : 254
FAIL : 6
PRECONDITION_FAILED: 15

Safari

OK : 1
PASS : 218
FAIL : 32
PRECONDITION_FAILED: 15
TIMEOUT : 4
NOTRUN : 8

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /webrtc-stats/supported-stats.https.html [wpt.fyi]
    • inbound-rtp's mid: FAIL
    • inbound-rtp's keyFramesDecoded: FAIL
    • inbound-rtp's pauseCount: FAIL
    • inbound-rtp's totalPausesDuration: FAIL
    • inbound-rtp's freezeCount: FAIL
    • inbound-rtp's totalFreezesDuration: FAIL
    • inbound-rtp's jitterBufferTargetDelay: FAIL
    • inbound-rtp's jitterBufferMinimumDelay: FAIL
    • inbound-rtp's framesAssembledFromMultiplePackets: FAIL
    • inbound-rtp's totalAssemblyTime: FAIL
    • inbound-rtp's retransmittedPacketsReceived: FAIL
    • inbound-rtp's retransmittedBytesReceived: FAIL
    • inbound-rtp's transportId: FAIL
    • outbound-rtp's mid: FAIL
    • outbound-rtp's mediaSourceId: FAIL
    • outbound-rtp's targetBitrate: FAIL
    • outbound-rtp's keyFramesEncoded: FAIL
    • outbound-rtp's totalPacketSendDelay: FAIL
    • outbound-rtp's qualityLimitationReason: FAIL
    • outbound-rtp's qualityLimitationDurations: FAIL
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL
    • outbound-rtp's active: FAIL
    • outbound-rtp's transportId: FAIL
    • remote-inbound-rtp's transportId: FAIL
    • remote-outbound-rtp's reportsSent: FAIL
    • remote-outbound-rtp's totalRoundTripTime: FAIL
    • remote-outbound-rtp's roundTripTimeMeasurements: FAIL
    • remote-outbound-rtp's transportId: FAIL
    • media-source's audioLevel: FAIL
    • media-source's totalAudioEnergy: FAIL
    • media-source's totalSamplesDuration: FAIL
    • transport's packetsSent: FAIL
    • transport's packetsReceived: FAIL
    • transport's bytesSent: FAIL
    • transport's bytesReceived: FAIL
    • transport's iceRole: FAIL
    • transport's iceLocalUsernameFragment: FAIL
    • transport's dtlsState: FAIL
    • transport's iceState: FAIL
    • transport's selectedCandidatePairId: FAIL
    • transport's localCertificateId: FAIL
    • transport's remoteCertificateId: FAIL
    • transport's tlsVersion: FAIL
    • transport's dtlsCipher: FAIL
    • transport's dtlsRole: FAIL
    • transport's srtpCipher: FAIL
    • transport's selectedCandidatePairChanges: FAIL
    • transport's timestamp: FAIL
    • transport's type: FAIL
    • transport's id: FAIL
    • candidate-pair's packetsSent: FAIL
    • candidate-pair's packetsReceived: FAIL
    • candidate-pair's totalRoundTripTime: FAIL
    • candidate-pair's currentRoundTripTime: FAIL
    • candidate-pair's availableOutgoingBitrate: FAIL
    • candidate-pair's requestsReceived: FAIL
    • candidate-pair's requestsSent: FAIL
    • candidate-pair's responsesReceived: FAIL
    • candidate-pair's responsesSent: FAIL
    • candidate-pair's consentRequestsSent: FAIL
    • candidate-pair's packetsDiscardedOnSend: FAIL
    • candidate-pair's bytesDiscardedOnSend: FAIL
    • local-candidate's transportId: FAIL
    • remote-candidate's transportId: FAIL
    • certificate's fingerprint: FAIL
    • certificate's fingerprintAlgorithm: FAIL
    • certificate's base64Certificate: FAIL
    • certificate's timestamp: FAIL
    • certificate's type: FAIL
    • certificate's id: FAIL

New Tests That Don't Pass

  • /webrtc/RTCRtpReceiver-getStats.https.html [wpt.fyi]
    • receiver.getStats() via addTransceiver should return stats report containing inbound-rtp stats: FAIL (Chrome: PASS, Safari: TIMEOUT)
    • receiver.getStats() via addTrack should return stats report containing inbound-rtp stats: FAIL (Chrome: PASS, Safari: NOTRUN)
    • receiver.getStats() should work on a stopped transceiver but not have inbound-rtp objects: FAIL (Chrome: FAIL, Safari: NOTRUN)
    • receiver.getStats() should work with a closed PeerConnection but not have inbound-rtp objects: FAIL (Chrome: PASS, Safari: NOTRUN)
  • /webrtc/RTCRtpSender-getStats.https.html [wpt.fyi]
    • sender.getStats() via addTransceiver should return stats report containing outbound-rtp stats: FAIL (Chrome: PASS, Safari: TIMEOUT)
    • sender.getStats() via addTrack should return stats report containing outbound-rtp stats: FAIL (Chrome: PASS, Safari: NOTRUN)
    • sender.getStats() should work on a stopped transceiver but not have outbound-rtp stats: FAIL (Chrome: PASS, Safari: NOTRUN)
    • sender.getStats() should work with a closed PeerConnection but not have outbound-rtp objects: FAIL (Chrome: PASS, Safari: NOTRUN)
  • /webrtc-stats/supported-stats.https.html [wpt.fyi]
    • inbound-rtp's mid: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's keyFramesDecoded: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's framesRendered: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's qpSum: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's pauseCount: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's totalPausesDuration: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's freezeCount: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's totalFreezesDuration: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's fecBytesReceived: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's estimatedPlayoutTimestamp: FAIL (Chrome: FAIL, Safari: PASS)
    • inbound-rtp's jitterBufferTargetDelay: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's jitterBufferMinimumDelay: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's decoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's playoutId: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's powerEfficientDecoder: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's framesAssembledFromMultiplePackets: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's totalAssemblyTime: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's retransmittedPacketsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's retransmittedBytesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's rtxSsrc: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's fecSsrc: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's mid: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's mediaSourceId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's rid: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • outbound-rtp's rtxSsrc: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's targetBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's keyFramesEncoded: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's totalPacketSendDelay: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's qualityLimitationReason: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's qualityLimitationDurations: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's encoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's powerEfficientEncoder: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's active: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's scalabilityMode: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's reportsSent: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's roundTripTime: FAIL (Chrome: FAIL, Safari: FAIL)
    • remote-outbound-rtp's totalRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's roundTripTimeMeasurements: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's audioLevel: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's totalAudioEnergy: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's totalSamplesDuration: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's echoReturnLoss: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • media-source's echoReturnLossEnhancement: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • media-playout's kind: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's synthesizedSamplesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's synthesizedSamplesEvents: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's totalSamplesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's totalPlayoutDelay: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's totalSamplesCount: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's timestamp: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's type: FAIL (Chrome: PASS, Safari: FAIL)
    • media-playout's id: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's packetsSent: FAIL (Chrome: PASS, Safari: PASS)
    • transport's packetsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • transport's bytesSent: FAIL (Chrome: PASS, Safari: PASS)
    • transport's bytesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceRole: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceLocalUsernameFragment: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsState: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceState: FAIL (Chrome: PASS, Safari: PASS)
    • transport's selectedCandidatePairId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's localCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's remoteCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's tlsVersion: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsRole: FAIL (Chrome: PASS, Safari: PASS)
    • transport's srtpCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's selectedCandidatePairChanges: FAIL (Chrome: PASS, Safari: PASS)
    • transport's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • transport's type: FAIL (Chrome: PASS, Safari: PASS)
    • transport's id: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's packetsSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's packetsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's totalRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's currentRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableOutgoingBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableIncomingBitrate: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • candidate-pair's requestsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's requestsSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's consentRequestsSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's packetsDiscardedOnSend: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's bytesDiscardedOnSend: FAIL (Chrome: PASS, Safari: PASS)
    • local-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • local-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's tcpType: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's tcpType: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's fingerprint: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's fingerprintAlgorithm: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's base64Certificate: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's issuerCertificateId: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's type: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's id: FAIL (Chrome: PASS, Safari: PASS)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/5a1c5b30da45 [wpt PR 44202] - webrtc wpt: modernize RTCRtpReceiver/RTCRtpSender getStats tests, a=testonly https://hg.mozilla.org/integration/autoland/rev/86a9c3d574a1 [wpt PR 44202] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/5a1c5b30da45
https://hg.mozilla.org/mozilla-central/rev/86a9c3d574a1

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox124: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 124 Branch
You need to log in before you can comment on or make changes to this bug.