Closed Bug 1799296 Opened 3 years ago Closed 3 years ago

[wpt-sync] Sync PR 36832 - webrtc stats: mark two more stats as not testable

Categories

(Core :: WebRTC, task, P4)

Product:
Core
Component:
WebRTC
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
108 Branch
Tracking Flags:
Tracking Status
firefox108 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 36832 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/36832
Details from upstream follow.

phancke@microsoft.com <phancke@microsoft.com> wrote:

webrtc stats: mark two more stats as not testable

availableIncomingBitrate which requires and REMB-only receiver
and issuerCertificateId which requires a certificate chain

BUG=chromium:1379861

Change-Id: I3d77adc3479f4f0ee8cb5178bea0c13d5d33d648
Reviewed-on: https://chromium-review.googlesource.com/4006139
WPT-Export-Revision: 58e36190eff8b91066a209dc8e46654ecac54f73

PR 36832 applied with additional changes from upstream: 0d1ad75e126ec1a7eb37adaedb4655f106f1c21f, f546f53c61c8ec788955a581b9da3b7084d15c20
Component: web-platform-tests → WebRTC
Product: Testing → Core

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 1 tests and 260 subtests

Status Summary

Firefox

OK : 1
PASS : 136
FAIL : 112
PRECONDITION_FAILED: 12

Chrome

OK : 1
PASS : 226
FAIL : 22
PRECONDITION_FAILED: 12

Safari

OK : 1
PASS : 161
FAIL : 87
PRECONDITION_FAILED: 12

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /webrtc-stats/supported-stats.html [wpt.fyi]
    • inbound-rtp's keyFramesDecoded: FAIL
    • inbound-rtp's framesDropped: FAIL
    • inbound-rtp's transportId: FAIL
    • outbound-rtp's mediaSourceId: FAIL
    • outbound-rtp's targetBitrate: FAIL
    • outbound-rtp's framesPerSecond: FAIL
    • outbound-rtp's keyFramesEncoded: FAIL
    • outbound-rtp's totalPacketSendDelay: FAIL
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL
    • outbound-rtp's transportId: FAIL
    • remote-inbound-rtp's transportId: FAIL
    • peer-connection's dataChannelsOpened: FAIL
    • peer-connection's dataChannelsClosed: FAIL
    • peer-connection's timestamp: FAIL
    • peer-connection's type: FAIL
    • peer-connection's id: FAIL
    • media-source's trackIdentifier: FAIL
    • media-source's kind: FAIL
    • media-source's timestamp: FAIL
    • media-source's type: FAIL
    • media-source's id: FAIL
    • transport's bytesSent: FAIL
    • transport's bytesReceived: FAIL
    • transport's dtlsState: FAIL
    • transport's selectedCandidatePairId: FAIL
    • transport's localCertificateId: FAIL
    • transport's remoteCertificateId: FAIL
    • transport's tlsVersion: FAIL
    • transport's dtlsCipher: FAIL
    • transport's srtpCipher: FAIL
    • transport's timestamp: FAIL
    • transport's type: FAIL
    • transport's id: FAIL
    • candidate-pair's totalRoundTripTime: FAIL
    • candidate-pair's currentRoundTripTime: FAIL
    • candidate-pair's availableOutgoingBitrate: FAIL
    • candidate-pair's requestsReceived: FAIL
    • candidate-pair's requestsSent: FAIL
    • candidate-pair's responsesReceived: FAIL
    • candidate-pair's responsesSent: FAIL
    • local-candidate's transportId: FAIL
    • remote-candidate's transportId: FAIL
    • certificate's fingerprint: FAIL
    • certificate's fingerprintAlgorithm: FAIL
    • certificate's base64Certificate: FAIL
    • certificate's timestamp: FAIL
    • certificate's type: FAIL
    • certificate's id: FAIL

New Tests That Don't Pass

  • /webrtc-stats/supported-stats.html [wpt.fyi]
    • inbound-rtp's trackIdentifier: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's mid: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's keyFramesDecoded: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's framesDropped: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's qpSum: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's pauseCount: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalPausesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's freezeCount: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalFreezesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's estimatedPlayoutTimestamp: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's jitterBufferTargetDelay: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's jitterBufferMinimumDelay: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's decoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's playoutId: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's powerEfficientDecoder: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's framesAssembledFromMultiplePackets: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalAssemblyTime: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's mid: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's mediaSourceId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's rid: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • outbound-rtp's targetBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's framesPerSecond: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's keyFramesEncoded: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's totalPacketSendDelay: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's qualityLimitationReason: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's qualityLimitationDurations: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's encoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's powerEfficientEncoder: FAIL (Chrome: FAIL, Safari: FAIL)
    • outbound-rtp's active: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's reportsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's roundTripTime: FAIL (Chrome: FAIL, Safari: FAIL)
    • remote-outbound-rtp's totalRoundTripTime: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's roundTripTimeMeasurements: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: FAIL)
    • peer-connection's dataChannelsOpened: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's dataChannelsClosed: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's type: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's id: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's audioLevel: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's totalAudioEnergy: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's totalSamplesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's echoReturnLoss: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's echoReturnLossEnhancement: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's droppedSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's droppedSamplesEvents: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's totalCaptureDelay: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's totalSamplesCaptured: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's width: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's height: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's frames: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's framesPerSecond: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's trackIdentifier: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's kind: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's type: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's id: FAIL (Chrome: PASS, Safari: PASS)
    • media-playout's synthesizedSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's synthesizedSamplesEvents: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalPlayoutDelay: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalSamplesCount: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's timestamp: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's type: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's id: FAIL (Chrome: FAIL, Safari: FAIL)
    • transport's packetsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's packetsReceived: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's bytesSent: FAIL (Chrome: PASS, Safari: PASS)
    • transport's bytesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceRole: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's iceLocalUsernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's dtlsState: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceState: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's selectedCandidatePairId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's localCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's remoteCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's tlsVersion: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsRole: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's srtpCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's selectedCandidatePairChanges: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • transport's type: FAIL (Chrome: PASS, Safari: PASS)
    • transport's id: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's packetsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's packetsReceived: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's totalRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's currentRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableOutgoingBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableIncomingBitrate: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • candidate-pair's requestsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's requestsSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's consentRequestsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's packetsDiscardedOnSend: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's bytesDiscardedOnSend: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • local-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's tcpType: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's tcpType: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's fingerprint: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's fingerprintAlgorithm: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's base64Certificate: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's issuerCertificateId: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's type: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's id: FAIL (Chrome: PASS, Safari: PASS)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/db0ee37ab0f6 [wpt PR 36832] - webrtc stats: mark two more stats as not testable, a=testonly https://hg.mozilla.org/integration/autoland/rev/38d6c1a37ca3 [wpt PR 36832] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/db0ee37ab0f6
https://hg.mozilla.org/mozilla-central/rev/38d6c1a37ca3

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox108: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 108 Branch
You need to log in before you can comment on or make changes to this bug.