Open Bug 1951180 Opened 26 days ago Updated 3 hours ago

[wpt-sync] Sync PR 51029 - Add test cases to the 'webrtc' type for decoding and encoding.

Categories

(Core :: CSS Parsing and Computation, task, P4)

Product:
Core
Component:
CSS Parsing and Computation
Type:
task

Tracking

()

People

(Reporter: wpt-sync, Unassigned)

References

(Depends on 1 open bug,
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 51029 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/51029
Details from upstream follow.

mark a. foltz <mfoltz@chromium.org> wrote:

Add test cases to the 'webrtc' type for decoding and encoding.

This PR adds test cases for webrtc encoding and decoding types to bring them to parity with test cases for file decoding and record encoding types.

Whiteboard: [wptsync downstream] → [wptsync downstream error]
Component: web-platform-tests → CSS Parsing and Computation
Product: Testing → Core
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 7 tests and 17 subtests

Status Summary

Firefox

OK : 7
PASS: 124
FAIL: 52

Chrome

OK : 7
PASS: 153
FAIL: 34

Safari

OK : 7
PASS: 146
FAIL: 34

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /media-capabilities/decodingInfo-webrtc.any.worker.html [wpt.fyi]
    • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
    • Test that decodingInfo returns supported true for the codec audio/opus: FAIL
    • Test that decodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL
  • /media-capabilities/decodingInfo-webrtc.any.html [wpt.fyi]
    • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
    • Test that decodingInfo returns supported true for the codec audio/opus returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec audio/G722 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpReceiver.getCapabilities(): FAIL
  • /media-capabilities/encodingInfo-webrtc.any.html [wpt.fyi]
    • Test that encodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
    • Test that encodingInfo returns supported true for the codec audio/opus returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec audio/G722 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpSender.getCapabilities(): FAIL
  • /media-capabilities/encodingInfo-webrtc.any.worker.html [wpt.fyi]
    • Test that encodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
    • Test that encodingInfo returns supported true for the codec audio/opus: FAIL
    • Test that encodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL

New Tests That Don't Pass

  • /media-capabilities/decodingInfo-webrtc.any.worker.html [wpt.fyi]
    • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec audio/opus: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo rejects for type 'webrtc' if HDR members are set: FAIL (Chrome: FAIL, Safari: FAIL)
  • /media-capabilities/decodingInfo-webrtc.any.html [wpt.fyi]
    • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec audio/opus returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec audio/G722 returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that decodingInfo returns supported true for the codec video/VP8; max-fs=12288;max-fr=60 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/VP9; max-fs=12288;max-fr=60 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
    • Test that decodingInfo returns supported true for the codec video/AV1 returned by RTCRtpReceiver.getCapabilities(): FAIL (Safari: PASS)
    • Test that decodingInfo rejects for type 'webrtc' if HDR members are set: FAIL (Chrome: FAIL, Safari: FAIL)
  • /media-capabilities/decodingInfo.any.html [wpt.fyi]
    • Test that decodingInfo rejects if the audio configuration contentType is of type video: FAIL (Chrome: FAIL, Safari: PASS)
    • Test that decodingInfo rejects if the video configuration contentType has more than one parameter: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType is not a valid MIME type string: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType has more than one parameter: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType has a codecs parameter that indicates both an audio and a video codec: FAIL (Chrome: FAIL, Safari: PASS)
    • Test that decodingInfo with mismatched codec color space is unsupported: FAIL (Chrome: PASS, Safari: FAIL)
  • /media-capabilities/decodingInfo.any.worker.html [wpt.fyi]
    • Test that decodingInfo rejects if the audio configuration contentType is of type video: FAIL (Chrome: FAIL, Safari: PASS)
    • Test that decodingInfo rejects if the video configuration contentType has more than one parameter: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType is not a valid MIME type string: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType has more than one parameter: FAIL (Chrome: PASS, Safari: FAIL)
    • Test that decodingInfo rejects if the audio configuration contentType has a codecs parameter that indicates both an audio and a video codec: FAIL (Chrome: FAIL, Safari: PASS)
    • Test that decodingInfo with mismatched codec color space is unsupported: FAIL (Chrome: PASS, Safari: FAIL)
  • /media-capabilities/encodingInfo-webrtc.any.html [wpt.fyi]
    • Test that encodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec audio/opus returned by RTCRtpSender.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec audio/G722 returned by RTCRtpSender.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpSender.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpSender.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec video/VP8; max-fs=12288;max-fr=60 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/VP9; max-fs=12288;max-fr=60 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1 returned by RTCRtpSender.getCapabilities(): FAIL
    • Test that encodingInfo returns supported true for the codec video/AV1 returned by RTCRtpSender.getCapabilities(): FAIL (Safari: PASS)
  • /media-capabilities/encodingInfo-webrtc.any.worker.html [wpt.fyi]
    • Test that encodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec audio/opus: FAIL (Chrome: PASS, Safari: PASS)
    • Test that encodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL (Chrome: PASS, Safari: PASS)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/5b93d53b3cda [wpt PR 51029] - Add test cases to the 'webrtc' type for decoding and encoding., a=testonly https://hg.mozilla.org/integration/autoland/rev/8fd1c199e5e1 [wpt PR 51029] - Update wpt metadata, a=testonly
You need to log in before you can comment on or make changes to this bug.