1825286 - Implement MediaDecodingType/MediaEncodingType "webrtc"

Status: ASSIGNED

(Core :: WebRTC: Audio/Video, task)

Description

[Byron Campen [:bwc]]

We don't support these yet:

https://www.w3.org/TR/media-capabilities/#dom-mediadecodingtype-webrtc

https://www.w3.org/TR/media-capabilities/#dom-mediaencodingtype-webrtc

Comment 1

[Jim Mathies [:jimm]]

Currently tracked in our webcompat todo list.

Comment 2

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 1: Add MediaCapabilitiesValidation.{h,cpp} to validate MediaCapabilities API types per spec.

Comment 3

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 2: Add WebRTC type to IDL and corresponding checks to MediaCapabilitiesValidation.

Comment 4

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 3: Use MediaCapabilitiesValidation to check DecodingInfo.

Comment 5

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 4: Use MediaCapabilitiesValidation to check EncodingInfo.

Comment 6

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 5: Add CheckTypeForWebRTC{Encode,Decode} helpers for use creating {Encoding,Decoding}Info.

Comment 7

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 6: Add WebRTC-specific checks to DecodingInfo creation.

Comment 8

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 7: Update MediaCapabilities WPT test expectations.

Comment 9

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 8: Add WebRTCCodecInfo code to detect WebRTC codec information and WebRTCCodecInfoExport to use outside of WebRTC code.

Comment 10

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 9: Overhaul MediaCapabilities EncodeInfo creation and validation.

Comment 11

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 10: Add MediaCapabilities color gamut / transfer function validation.

Comment 12

[az [:az]]

Attachment: WIP: Bug 1825286 - Step 11: Update WPT expectations with passing tests.

Comment 13

[az [:az]]

Attachment: WIP: Bug 1825286 - Step __ - Modify WebRTC source to expose GetDefaultCodecPreferences

Comment 14

[az [:az]]

Attachment: WIP: Bug 1825286 - Step __ - Remove PeerConnectionImpl dependency and directly use DefaultCodecPreferences (needs to run on main)

Comment 15

[az [:az]]

Attachment: WIP: Bug 1825286 - Step __ - Check codec support with async support requests in MediaCapabilities.cpp

Comment 16

[Phabricator Automation]

Comment on attachment 9511387 [details]
WIP: Bug 1825286 - Step 1: Add MediaCapabilitiesValidation.{h,cpp} to validate MediaCapabilities API types per spec.

Revision D263717 was moved to bug 1993541. Setting attachment 9511387 [details] to obsolete.

Comment 17

[Phabricator Automation]

Comment on attachment 9511389 [details]
WIP: Bug 1825286 - Step 3: Use MediaCapabilitiesValidation to check DecodingInfo.

Revision D263719 was moved to bug 1993541. Setting attachment 9511389 [details] to obsolete.

Comment 18

[Phabricator Automation]

Comment on attachment 9511390 [details]
WIP: Bug 1825286 - Step 4: Use MediaCapabilitiesValidation to check EncodingInfo.

Revision D263720 was moved to bug 1993541. Setting attachment 9511390 [details] to obsolete.

Comment 19

[Phabricator Automation]

Comment on attachment 9511393 [details]
WIP: Bug 1825286 - Step 7: Update MediaCapabilities WPT test expectations.

Revision D263723 was moved to bug 1993541. Setting attachment 9511393 [details] to obsolete.

Comment 20

[az [:az]]

Attachment: Bug 1825286 - Part 1: Add webrtc type to MediaCapabilities IDL and remove transmission type. r=pehrsons

Comment 21

[az [:az]]

Attachment: Bug 1825286 - Part 2: Add WebRTC exception to the Media Capabilities MIME type validity check. r=pehrsons

Comment 22

[az [:az]]

Attachment: Bug 1825286 - Part 3: Add video/mpeg and audio/mpeg to container list for Media Capabilities validation. r=pehrsons

Comment 23

[az [:az]]

Attachment: Bug 1825286 - Part 4: Add WebRTC-specific scalabilityMode check to Media Capabilities video configuration validation. r=pehrsons

Comment 24

[az [:az]]

Attachment: Bug 1825286 - Part 5: Add colorGamut and transferFunction validation functions to be used in MediaCapabilities MIME type support check. r=pehrsons

Comment 25

[az [:az]]

Attachment: Bug 1825286 - Part 6: Add WebRTC and colorGamut/transferFunction support checks to CheckMIMETypeSupport. r=pehrsons

Comment 26

[az [:az]]

Attachment: Bug 1825286 - Part 7: Add functions to expose default WebRTC audio/video codecs. r=pehrsons

Comment 27

[az [:az]]

Attachment: Bug 1825286 - Part 8: Add WebRTCCodecInfo.{cpp,h} to parse and export WebRTC codec information for use with Media Capabilities support checks. r=pehrsons

Comment 28

[az [:az]]

Attachment: Bug 1825286 - Part 10: Add GetThreadForAsyncRequesthelper to use when checking Media Capabilities support information. r=pehrsons

Comment 29

[az [:az]]

Attachment: Bug 1825286 - Part 12: Add GetSingleSupportPromise and helpers to check support information for MediaCapabilities encode/decode, audio/video, in a unified manner for all types (webrtc, file, media-source, and record). r=pehrsons

Comment 30

[az [:az]]

Attachment: WIP: Bug 1825286 - Part 11: Add encode/decode hardware acceleration support checks to Media Capabilities.

Comment 31

[az [:az]]

Attachment: Bug 1825286 - Part 14: Update Media Capabilities DecodingInfo creation to use unified support checks and add WebRTC support. r=pehrsons

Comment 32

[az [:az]]

Attachment: Bug 1825286 - Part 15: Overhaul Media Capabilities EncodingInfo creation to use unified support checks and add WebRTC support. r=pehrsons

Comment 33

[az [:az]]

Attachment: Bug 1825286 - Part 17: Update Media Capabilities WPT expectations. r=pehrsons

Comment 34

[az [:az]]

Attachment: Bug 1825286 - Part 13: Add encode/decode hardware acceleration support checks to Media Capabilities. r=pehrsons

Comment 35

[az [:az]]

Attachment: Bug 1825286 - Part 18: Add GTests for WebRTCCodecInfo. r=pehrsons

Comment 36

[az [:az]]

Attachment: Bug 1825286 - Part 16: Return a promise rejected with a TypeError if EncodingInfo is not a valid MediaConfiguration. r=pehrsons

Comment 37

[az [:az]]

Attachment: Bug 1825286 - Part 9: Add fmt::formatters for Media Capabilities video/audio encode/decode configurations and info. r=pehrsons

Comment 38

[az [:az]]

Attachment: Bug 1825286 - Part 11: Update CheckTypeFor* functions to use MediaExtendedMIMEType and add CheckTypeForWebRTC* r=pehrsons

Comment 39

[az [:az]]

Attachment: Bug 1825286 - Part 19: Add Media Capabilities colorGamut, scalabilityMode, and transferFunction WPTs. r=pehrsons