1179084 - Implement MediaStreamTrack::getCapabilities() and MediaTrackCapabilities

Status: RESOLVED FIXED

(Core :: WebRTC: Audio/Video, enhancement, P2)

Description

[Mathieu Hofman]

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36

Steps to reproduce:

Call MediaStreamTrack::getCapabilities()


Actual results:

Method doesn't exist


Expected results:

Method returns a MediaTrackCapabilities object.

Comment 1

[Mathieu Hofman]

Request to implement MediaStreamCapabilities (http://w3c.github.io/mediacapture-main/getusermedia.html#media-track-capabilities)

Comment 2

[Bulk Bug Changes for mreavy's org]

Mass change P2->P3 to align with new Mozilla triage process.

Comment 3

[tuomasaho91]

Any chance this feature will come in near future?

Comment 4

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

Reminder to check the privacy.resistFingerprinting pref as well as bug 1528042 when implementing this feature.

Comment 5

[frangarciasalomon]

Any chance this feature will come in near future?

It's been 2 years. Any news?

Comment 6

[Dennis Schubert [:denschub]]

This is currently breaking Facebook Messenger Calls, see the linked WebCompat bug. I've already reached out to them to see if they can fix it, but I'm setting a webcompat-priority here for now so that this is on our radar.

Comment 7

[Dennis Schubert [:denschub]]

... aaaand they fixed it. :)

Comment 8

[Raul Bucata]

Not sure how QA can test this. Should I run MediaStreamTrack::getCapabilities() in the Console of the browser, exact string? Or is there another place to run this?

Comment 9

[BugBot [:suhaib / :marco/ :calixte]]

Redirect a needinfo that is pending on an inactive user to the triage owner.
:jib, since the bug has recent activity, could you have a look please?

For more information, please visit BugBot documentation.

Comment 10

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

This is covered by automated WPT tests so there should be no need for QA to test this. Except maybe to verify facingMode is present on mobile devices perhaps?

That said, you can type the following into web console to test it:

(await navigator.mediaDevices.getUserMedia({video:true, audio:true})).getTracks().map(t => t.getCapabilities())

Comment 11

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

This was highlighted as a Web Compat risk recently, which seems fair.

Our earlier (media team) assessment of it as low priority is based on its usefulness (it's not super useful at all imho).

But looking at websites that don't test with Firefox, a different standard is needed. Some websites appear to be in the habit of using this pattern:

const amIOnMobile = !!mst.getCapabilities().facingMode;

...which is easily fixed by using this instead:

const amIOnMobile = !!mst.getSettings().facingMode;

Simply testing with Firefox should help address this, but if they're not doing so this advice doesn't help, and we should up-prioritize a fix, despite its overall low value add otherwise.

Comment 12

[Dan Baker[:dbaker]]

Attachment: Bug 1179084 - Implement MediaTrackCapabilities. r=#webrtc-reviewers

Comment 13

[Dan Baker[:dbaker]]

Attachment: Bug 1179084 - Implement getting camera and microphone capabilities from MediaStreamTrack. r=#webrtc-reviewers

Depends on D219117

Comment 14

[Dan Baker[:dbaker]]

Attachment: Bug 1179084 - Update WPT to support adding MediaStreamStrack::getCapabilities(). r=#webrtc-reviewers

Depends on D220338

Comment 15

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/40da10b9a99d
Implement MediaTrackCapabilities. r=webidl,webrtc-reviewers,jib,smaug
https://hg.mozilla.org/integration/autoland/rev/3b73074ef93b
Implement getting camera and microphone capabilities from MediaStreamTrack. r=webrtc-reviewers,jib
https://hg.mozilla.org/integration/autoland/rev/a086565fa15a
Update WPT to support adding MediaStreamStrack::getCapabilities(). r=webrtc-reviewers,jib

Comment 16

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/40da10b9a99d
https://hg.mozilla.org/mozilla-central/rev/3b73074ef93b
https://hg.mozilla.org/mozilla-central/rev/a086565fa15a

Comment 17

[Dan Baker[:dbaker]]

Release Note Request (optional, but appreciated)
[Why is this notable]: WebRTC applications will now be able to query the capabilities of the live media track to gather capabilities. This does not implement bug 1213422 and is only for the live track.
[Affects Firefox for Android]: Yes
[Suggested wording]: The getCapabilities method allows applications to gather the media capabilities supported for the live MediaStreamTrack.
[Links (documentation, blog post, etc)]: https://www.w3.org/TR/mediacapture-streams/#dom-mediastreamtrack-getcapabilities

Comment 18

[Ryan VanderMeulen [:RyanVM]]

Added to the Fx132 relnotes.