937460 - Media Recording - Change opus encoder to use Opus Multistream API

Status: NEW

(Core :: Audio/Video: Recording, defect, P3)

Description

[Randy Lin [:rlin] - Be Mozillian on 2015/01/26]

If we want to record multi audio channels media stream, we should use this API to pruoduce multistream opus.

Comment 1

[Ralph Giles (:rillian)]

Note that Opus only supports up to 8 channels in fixed surround configurations. We need to figure how to pass surround mapping information from media streams.

Comment 2

[Ralph Giles (:rillian)]

Summary of a brief conversation with roc:

MediaStreams have tracks. Each track can have more than one channel.

I suggested mixing _tracks_ together inside the MediaEncoder object. Roc things we should encode multi-track media streams as multi-track opus files. We can do that, but it depends on the use case which you want.

In any case, we can't currently make multi-track media streams so we don't have to support this now.

WebAudio has a 'speakers' vs 'discrete' property describing how the _channels_ are to be interpreted. Opus can handle up to 6 (or 8) channels in the 'speakers' case, and up to 255 in the 'discrete' case. To support multichannel, we need to pass this flag through the MediaStream to the encoder so it can mark the files correctly.

Comment 3

[Randy Lin [:rlin] - Be Mozillian on 2015/01/26]

Free this if anyone wants.

Comment 4

[Bulk Bug Changes for mreavy's org]

Mass change P2->P3 to align with new Mozilla triage process.