2075095 - EME test failures with native MediaCodec and with AImageReader on Android

Status: RESOLVED WORKSFORME

(Core :: Audio/Video: Playback, defect, P3)

Description

[Sotaro Ikeda [:sotaro]]

When native MediaCodec was used, some EME test failed.

Comment 1

[Sotaro Ikeda [:sotaro]]

https://treeherder.mozilla.org/jobs?repo=try&revision=f9aded1ffd2fea6ecc11a8a8dc398717ab6e994f

Comment 2

[Andrew Osmond [:aosmond] (he/him)]

I have them passing:
https://treeherder.mozilla.org/jobs?repo=try&searchStr=android%2Ceme&revision=213b3a47be30be86ff819a513dacfbeae21fe4d5

Comment 3

[Sotaro Ikeda [:sotaro]]

Attachment: WIP: Bug 2075095 - Add CDM support with AImageReader in GPU process

Comment 4

[Sotaro Ikeda [:sotaro]]

When AImageReader is used, AImageReader and FFmpegVideoDecoder are allocated in GPU process. But with EME, audio decoder and video decoder needs to be in same process. Current gecko does not expect to allocate audio decoder in GPU process.

To be efficient video rendering, AImageReader and FFmpegVideoDecoder needs to be in GPU process.

Comment 5

[media-triaging-bot]

Analysis

The source tree agrees with comment 4. On Android, the native MediaCodec path creates the CDM in the RDD process. A decoder with a CDM can only run in the RDD process. But AImageReader runs only in the GPU process, and the GPU process decodes video only, not audio.

Affected code:

• MediaKeys.cpp: the CDM is created with RemoteMediaIn::RddProcess.
• RemoteDecoderModule.cpp: on Android, a decoder with a CDM gets no support outside the RDD process.
• RemoteMediaManagerChild.cpp: the GPU process gets TrackSupport::DecodeVideo only.
• FFmpegVideoDecoder.cpp: AImageReader is used only when XRE_IsGPUProcess() is true.

Next steps

The fix direction is to create the CDM in the GPU process when AImageReader is on. Then the GPU process must also accept the audio decoder and the video decoder with a CDM. The WIP patch D331496 follows this direction. This bug now blocks meta bug 1980764 (Android Media Codec NDK).

---

To give feedback on this comment, add a thumbs-up or thumbs-down reaction.

Comment 6

[Sotaro Ikeda [:sotaro]]

The failure does not happen with latest m-c.