1325491 - [MSE] Investigate ability to use raw data with appendBuffer

Status: NEW

(Core :: Audio/Video: Playback, defect, P3)

Description

[Jean-Yves Avenard [:jya]]

Currently MSE, only supports adding new data to a source buffer that is contained in a known container type (mpeg-ts, mp4, webm, mp3, adts etc)

Firefox only supports two containers at this stage: mp4 and webm.

Projects such as HLS.js must remux the content into MP4 before being able to use MSE.
This is ineficient and prone to errors.

The idea would be instead to allow a way to use a container-less format, such XML or JSON that would allow to add raw content.

One can imagine that we have an init block that describe the stream content (such as duration, sampling rate, channel number, resolution, stream id etc) followed by packets that would only provide the start time and the raw content.

It would be much easier to mux such data, and faster to process (and also less security troubling).

Aim of this bug is to look into such implementation and propose it to W3C