Closed Bug 1798327 Opened 3 years ago Closed 3 years ago

[wpt-sync] Sync PR 36738 - Allow supported-stats.html access to hardware caps stats

Categories

(Core :: WebRTC, task, P4)

Product:
Core
Component:
WebRTC
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
108 Branch
Tracking Flags:
Tracking Status
firefox108 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 36738 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/36738
Details from upstream follow.

Evan Shrubsole <eshr@google.com> wrote:

Allow supported-stats.html access to hardware caps stats

These stats require gUM to be active, which requires the stat test to be
run with HTTPS, so the files needed to be renamed.

Tested: Ran with https://webrtc-review.googlesource.com/c/src/+/279960
and confirmed passing.
Bug: 1369050
Change-Id: I933e1981bef7a050aa1ff50e366180d8021d37b8
Reviewed-on: https://chromium-review.googlesource.com/3991352
WPT-Export-Revision: c020615a66fec60448231d2f74305a581ac59965

PR 36738 applied with additional changes from upstream: 0d1ad75e126ec1a7eb37adaedb4655f106f1c21f
Component: web-platform-tests → WebRTC
Product: Testing → Core
PR 36738 applied with additional changes from upstream: f546f53c61c8ec788955a581b9da3b7084d15c20, 4800158e986c1e7e05489f0a949e8429575415e2

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 1 tests and 260 subtests

Status Summary

Firefox

OK : 1
PASS : 136
FAIL : 110
PRECONDITION_FAILED: 14

Chrome

OK : 1
PASS : 226
FAIL : 20
PRECONDITION_FAILED: 14

Safari

OK : 1
PASS : 158
FAIL : 88
PRECONDITION_FAILED: 14

Links

GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /webrtc-stats/supported-stats.https.html [wpt.fyi]
    • inbound-rtp's keyFramesDecoded: FAIL
    • inbound-rtp's framesDropped: FAIL
    • inbound-rtp's transportId: FAIL
    • outbound-rtp's mediaSourceId: FAIL
    • outbound-rtp's targetBitrate: FAIL
    • outbound-rtp's keyFramesEncoded: FAIL
    • outbound-rtp's totalPacketSendDelay: FAIL
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL
    • outbound-rtp's transportId: FAIL
    • remote-inbound-rtp's transportId: FAIL
    • peer-connection's dataChannelsOpened: FAIL
    • peer-connection's dataChannelsClosed: FAIL
    • peer-connection's timestamp: FAIL
    • peer-connection's type: FAIL
    • peer-connection's id: FAIL
    • media-source's trackIdentifier: FAIL
    • media-source's kind: FAIL
    • media-source's timestamp: FAIL
    • media-source's type: FAIL
    • media-source's id: FAIL
    • transport's bytesSent: FAIL
    • transport's bytesReceived: FAIL
    • transport's dtlsState: FAIL
    • transport's selectedCandidatePairId: FAIL
    • transport's localCertificateId: FAIL
    • transport's remoteCertificateId: FAIL
    • transport's tlsVersion: FAIL
    • transport's dtlsCipher: FAIL
    • transport's srtpCipher: FAIL
    • transport's timestamp: FAIL
    • transport's type: FAIL
    • transport's id: FAIL
    • candidate-pair's totalRoundTripTime: FAIL
    • candidate-pair's currentRoundTripTime: FAIL
    • candidate-pair's availableOutgoingBitrate: FAIL
    • candidate-pair's requestsReceived: FAIL
    • candidate-pair's requestsSent: FAIL
    • candidate-pair's responsesReceived: FAIL
    • candidate-pair's responsesSent: FAIL
    • local-candidate's transportId: FAIL
    • remote-candidate's transportId: FAIL
    • certificate's fingerprint: FAIL
    • certificate's fingerprintAlgorithm: FAIL
    • certificate's base64Certificate: FAIL
    • certificate's timestamp: FAIL
    • certificate's type: FAIL
    • certificate's id: FAIL

New Tests That Don't Pass

  • /webrtc-stats/supported-stats.https.html [wpt.fyi]
    • inbound-rtp's trackIdentifier: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's mid: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's keyFramesDecoded: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's framesDropped: FAIL (Chrome: PASS, Safari: PASS)
    • inbound-rtp's qpSum: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's pauseCount: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalPausesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's freezeCount: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalFreezesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's estimatedPlayoutTimestamp: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's jitterBufferTargetDelay: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's jitterBufferMinimumDelay: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's decoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's playoutId: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's powerEfficientDecoder: FAIL (Chrome: FAIL, Safari: FAIL)
    • inbound-rtp's framesAssembledFromMultiplePackets: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's totalAssemblyTime: FAIL (Chrome: PASS, Safari: FAIL)
    • inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's mid: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's mediaSourceId: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's rid: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • outbound-rtp's targetBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's framesPerSecond: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's keyFramesEncoded: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's totalPacketSendDelay: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's qualityLimitationReason: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's qualityLimitationDurations: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's qualityLimitationResolutionChanges: FAIL (Chrome: PASS, Safari: PASS)
    • outbound-rtp's encoderImplementation: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's powerEfficientEncoder: FAIL (Chrome: FAIL, Safari: FAIL)
    • outbound-rtp's active: FAIL (Chrome: PASS, Safari: FAIL)
    • outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-inbound-rtp's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-outbound-rtp's reportsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's roundTripTime: FAIL (Chrome: FAIL, Safari: FAIL)
    • remote-outbound-rtp's totalRoundTripTime: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's roundTripTimeMeasurements: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-outbound-rtp's transportId: FAIL (Chrome: PASS, Safari: FAIL)
    • peer-connection's dataChannelsOpened: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's dataChannelsClosed: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's type: FAIL (Chrome: PASS, Safari: PASS)
    • peer-connection's id: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's audioLevel: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's totalAudioEnergy: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's totalSamplesDuration: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's echoReturnLoss: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • media-source's echoReturnLossEnhancement: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • media-source's droppedSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's droppedSamplesEvents: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's totalCaptureDelay: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's totalSamplesCaptured: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-source's width: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's height: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's frames: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's framesPerSecond: FAIL (Chrome: PASS, Safari: FAIL)
    • media-source's trackIdentifier: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's kind: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's type: FAIL (Chrome: PASS, Safari: PASS)
    • media-source's id: FAIL (Chrome: PASS, Safari: PASS)
    • media-playout's synthesizedSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's synthesizedSamplesEvents: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalSamplesDuration: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalPlayoutDelay: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's totalSamplesCount: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's timestamp: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's type: FAIL (Chrome: FAIL, Safari: FAIL)
    • media-playout's id: FAIL (Chrome: FAIL, Safari: FAIL)
    • transport's packetsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's packetsReceived: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's bytesSent: FAIL (Chrome: PASS, Safari: PASS)
    • transport's bytesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceRole: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's iceLocalUsernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's dtlsState: FAIL (Chrome: PASS, Safari: PASS)
    • transport's iceState: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's selectedCandidatePairId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's localCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's remoteCertificateId: FAIL (Chrome: PASS, Safari: PASS)
    • transport's tlsVersion: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's dtlsRole: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's srtpCipher: FAIL (Chrome: PASS, Safari: PASS)
    • transport's selectedCandidatePairChanges: FAIL (Chrome: PASS, Safari: FAIL)
    • transport's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • transport's type: FAIL (Chrome: PASS, Safari: PASS)
    • transport's id: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's packetsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's packetsReceived: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's totalRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's currentRoundTripTime: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableOutgoingBitrate: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's availableIncomingBitrate: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • candidate-pair's requestsReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's requestsSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesReceived: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's responsesSent: FAIL (Chrome: PASS, Safari: PASS)
    • candidate-pair's consentRequestsSent: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's packetsDiscardedOnSend: FAIL (Chrome: PASS, Safari: FAIL)
    • candidate-pair's bytesDiscardedOnSend: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • local-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • local-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • local-candidate's tcpType: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's transportId: FAIL (Chrome: PASS, Safari: PASS)
    • remote-candidate's url: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relayProtocol: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's foundation: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's relatedAddress: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's relatedPort: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • remote-candidate's usernameFragment: FAIL (Chrome: PASS, Safari: FAIL)
    • remote-candidate's tcpType: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's fingerprint: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's fingerprintAlgorithm: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's base64Certificate: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's issuerCertificateId: PRECONDITION_FAILED (Chrome: PRECONDITION_FAILED, Safari: PRECONDITION_FAILED)
    • certificate's timestamp: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's type: FAIL (Chrome: PASS, Safari: PASS)
    • certificate's id: FAIL (Chrome: PASS, Safari: PASS)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/dcac8385c90a [wpt PR 36738] - Allow supported-stats.html access to hardware caps stats, a=testonly https://hg.mozilla.org/integration/autoland/rev/4d3ac8619b17 [wpt PR 36738] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/dcac8385c90a
https://hg.mozilla.org/mozilla-central/rev/4d3ac8619b17

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox108: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 108 Branch
Regressions: 1800325
You need to log in before you can comment on or make changes to this bug.