1393069 - Support W3C Media Capture Depth Stream Extensions

Status: NEW

(Core :: WebRTC: Audio/Video, defect, P4)

Description

[Florian Traverse]

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:57.0) Gecko/20100101 Firefox/57.0
Build ID: 20170823100553

Steps to reproduce:

Tried some basic example from https://www.w3.org/wiki/Media_Capture_Depth_Stream_Extension, which I have updated to have the latest `getUserMedia` API location ( `navigator.mediaDevices` instead of `navigator` ), providing a failure callback, like this :

https://rawgit.com/temsa/mediacapture-depth/master/index.html


Actual results:

Nothing displays


Expected results:

RGB camera video stream should appear in my `#video` element, and the depth camera stream should appear in `depthVideo` element

Comment 1

[Alex Chronopoulos [:achronop]]

Your script fails with error:
failure! 
MediaStreamError { name: "OverconstrainedError", message: "Constraints could be not satisfied.", constraint: "facingMode", stack: "" }

This is because facingMode is specified as exact constraint. If you remove the exact keyword the first part of the script will work, like:
navigator.mediaDevices.getUserMedia({
  video: { facingMode: "environment" },
  depth: { facingMode: "environment" }
})

However second part of the script will fail with error:
failure! 
TypeError: s.getDepthTracks is not a function

This is because getDepthTracks method is not supported.

I am not sure what is the plan to support that.
jib: do you have any idea?

Comment 2

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

Thanks for filing the issue!

Implementing https://w3c.github.io/mediacapture-depth/ is not on our short-term roadmap, but we may consider it in the future, so I'll leave this open for consideration.

Comment 3

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

> TypeError: s.getDepthTracks is not a function

Note the spec is still under development and getDepthTracks is obsolete. See videoKind [1].

[1] https://w3c.github.io/mediacapture-depth/#def-constraint-videoKind

Comment 4

[Bulk Bug Changes for mreavy's org]

Mass change P3->P4 to align with new Mozilla triage process.