1827597 - Local media resource resources/clip.mp4 could not be decoded, cannot autoplay or crashes

Status: NEW

(GeckoView :: Media, defect, P3)

Description

[Oana Horvath [:ohorvath]]

While writing and running some autoplay UI tests for Fenix, I ran into issues with the local mp4 video resource not playing, sometimes crashing the app.
I will attach the html and mp4 files used.

Example 1: Block audio & video autoplay setting on a muted video
See video recording here.

04-12 02:34:37.240: E/GeckoProcessManager(8030): java.util.concurrent.TimeoutException
04-12 02:34:37.240: E/GeckoProcessManager(8030): 	at org.mozilla.geckoview.GeckoResult.poll(GeckoResult.java:870)
04-12 02:34:37.240: E/GeckoProcessManager(8030): 	at org.mozilla.gecko.process.GeckoProcessManager.getSurfaceAllocator(GeckoProcessManager.java:79)
04-12 02:34:37.240: E/GeckoProcessManager(8030): 	at org.mozilla.gecko.process.IProcessManager$Stub.onTransact(IProcessManager.java:80)
04-12 02:34:37.240: E/GeckoProcessManager(8030): 	at android.os.Binder.execTransactInternal(Binder.java:1154)
04-12 02:34:37.240: E/GeckoProcessManager(8030): 	at android.os.Binder.execTransact(Binder.java:1123)
04-12 02:34:37.268: W/SurfaceAllocator(8304): Failed to connect to RemoteSurfaceAllocator
04-12 02:34:37.268: W/SurfaceAllocator(8304): Failed to acquire GeckoSurface: not connected
04-12 02:34:37.279: I/Gecko(8304): [Child 8304, Unnamed thread 7726cb7bd0] WARNING: Decoder=7726ce4400 Decode error: NS_ERROR_DOM_MEDIA_FATAL_ERR (0x806e0005): file /builds/worker/checkouts/gecko/dom/media/MediaDecoderStateMachineBase.cpp:164
04-12 02:34:37.287: W/Web Content(8304): [JavaScript Warning: "Media resource http://localhost:39441/resources/clip.mp4 could not be decoded." {file: "http://localhost:39441/pages/mutedVideoPage.html" line: 0}]
04-12 02:34:37.289: W/Web Content(8304): [JavaScript Warning: "All candidate resources failed to load. Media load paused." {file: "http://localhost:39441/pages/mutedVideoPage.html" line: 0}]

Example 2: Block audio & video autoplay, test crashed after pressing the Play button.

04-12 01:16:49.050: I/Gecko(8340): [Child 8340, Unnamed thread 772e8b7ac0] WARNING: Decoder=7729c5f600 Decode error: NS_ERROR_DOM_MEDIA_FATAL_ERR (0x806e0005): file /builds/worker/checkouts/gecko/dom/media/MediaDecoderStateMachineBase.cpp:164
04-12 01:16:49.089: W/Web Content(8340): [JavaScript Warning: "Media resource http://localhost:53857/resources/clip.mp4 could not be decoded." {file: "http://localhost:53857/pages/videoMediaPage.html" line: 0}]
04-12 01:16:49.148: W/Web Content(8340): [JavaScript Warning: "All candidate resources failed to load. Media load paused." {file: "http://localhost:53857/pages/videoMediaPage.html" line: 0}]

Example 3: Autoplay allowed on all videos

04-12 02:32:32.944: W/System.err(7835): java.lang.NullPointerException: Attempt to invoke virtual method 'int java.lang.Integer.intValue()' on a null object reference
04-12 02:32:32.945: W/System.err(7835): 	at android.media.MediaFormat.getInteger(MediaFormat.java:1283)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.CodecProxy$NativeCallbacks.onOutputFormatChanged(Native Method)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.CodecProxy$CallbacksForwarder.onOutputFormatChanged(CodecProxy.java:96)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.ICodecCallbacks$Stub.onTransact(ICodecCallbacks.java:91)
04-12 02:32:32.945: W/System.err(7835): 	at android.os.Binder.execTransactInternal(Binder.java:1159)
04-12 02:32:32.945: W/System.err(7835): 	at android.os.Binder.execTransact(Binder.java:1123)
04-12 02:32:32.945: W/System.err(7835): java.lang.NullPointerException: Attempt to invoke virtual method 'int java.lang.Integer.intValue()' on a null object reference
04-12 02:32:32.945: W/System.err(7835): 	at android.media.MediaFormat.getInteger(MediaFormat.java:1283)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.CodecProxy$NativeCallbacks.onOutputFormatChanged(Native Method)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.CodecProxy$CallbacksForwarder.onOutputFormatChanged(CodecProxy.java:96)
04-12 02:32:32.945: W/System.err(7835): 	at org.mozilla.gecko.media.ICodecCallbacks$Stub.onTransact(ICodecCallbacks.java:91)
04-12 02:32:32.945: W/System.err(7835): 	at android.os.Binder.execTransactInternal(Binder.java:1159)
04-12 02:32:32.945: W/System.err(7835): 	at android.os.Binder.execTransact(Binder.java:1123)
04-12 02:32:32.946: W/Web Content(7835): [JavaScript Warning: "Autoplay is only allowed when approved by the user, the site is activated by the user, or media is muted." {file: "http://localhost:39153/pages/mutedVideoPage.html" line: 0}]

Comment 1

[Oana Horvath [:ohorvath]]

Attachment: videoMediaPage.html

Comment 2

[Oana Horvath [:ohorvath]]

Attachment: mutedVideoPage.html

Comment 3

[Oana Horvath [:ohorvath]]

Attachment: clip.mp4

Comment 4

[Oana Horvath [:ohorvath]]

Because I can't yet reproduce the issue manually, I set the severity S3.

Comment 5

[Meichthys]

I can reproduce this on an M1 Mac running firefox v118 on Asahi linux.
Are other people able to play the attached video in Firefox?
https://bugzilla.mozilla.org/attachment.cgi?id=9328121

Comment 6

[Makoto Kato [:m_kato]]

(In reply to Meichthys from comment #5)

I can reproduce this on an M1 Mac running firefox v118 on Asahi linux.
Are other people able to play the attached video in Firefox?
https://bugzilla.mozilla.org/attachment.cgi?id=9328121

This issue is Firefox for Android. So If this occurs on Firefox Desktop, please file a new issue.

Comment 7

[Meichthys]

Ok, This WFM on Firefox for android v119.1.0
I will file a separate issue for desktop.