1427280 - Firefox fails to open mp4 3D-4K videos by returning error messages in the console

Status: NEW

(Core :: Audio/Video: Playback, defect, P2)

Description

[Bogdan Maris, Desktop QA]

[Affected versions]:
- Nightly 59.0a1
- Firefox 58.0b13
- Firefox 57.0.3

[Affected platforms]:
- Mac OS X 10.11 (graphics: Intel Iris Pro 1536 MB)
- Win 8.1 x64

[Unaffected platforms]:
- macOS 10.13 (graphics: AMD Radeon HD 6750M 512 MB)

[Steps to reproduce]:
1. Go to any of the following mp4 samples:
 - 60fps: http://distribution.bbb3d.renderfarming.net/video/mp4/bbb_sunflower_2160p_60fps_stereo_abl.mp4
 - 30fps: http://distribution.bbb3d.renderfarming.net/video/mp4/bbb_sunflower_2160p_30fps_stereo_abl.mp4

[Expected result]:
- The video is loaded and played back correctly.

[Actual result]:
- The page is loaded only after several minutes, when the audio starts to play, while the screen remains black.

[Regression range]:
- This is not a recent regression, I was able to reproduce this issue back to build 52.0.2.

[Additional notes]:  
The error messages displayed in the console are not the same: 
- NS_ERROR_DOM_MEDIA_DEMUXER_ERR (0x806e000c) on macOs 10.11 - 58.0b13
- NS_ERROR_DOM_MEDIA_FATAL_ERR (0x806e0005) on Win 8.1 x64 - 58.0b13

Comment 1

[Blake Wu [:bwu][:blakewu]]

On my windows 10 laptop, Firefox cannot play it. Chrome can play those links although the playback is not smooth. 

The errors shows on my concole:
Error Code: NS_ERROR_DOM_MEDIA_FATAL_ERR (0x806e0005)
Details: class mozilla::MediaResult __cdecl mozilla::WMFVideoMFTManager::ValidateVideoInfo(void): Can't decode H.264 stream because its resolution is out of the maximum limitation

Comment 2

[Alfredo Yang (:alfredo)]

For unsmooth playback problem, VideoSink tries to play the displayed frames all the time.


[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 100000 (id=2) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 133333 (id=3) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 166666 (id=4) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 200000 (id=5) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 233333 (id=6) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 266666 (id=7) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 300000 (id=8) (vq-queued=8)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 333333 (id=9) (vq-queued=8)
[Unnamed thread 0x116a042e0]: V/MediaDecoder AudioSink=0x110051000 playing audio at time=96000 offset=965 length=187
[Unnamed thread 0x116a042e0]: V/MediaDecoder AudioSink=0x110051000 playing audio at time=120000 offset=0 length=371
[MediaPlayback #2]: V/MediaDecoder AudioSink=0x110051000 AudioStream has used an audio packet.
[MediaPlayback #2]: V/MediaDecoder MediaDecoderStateMachine[0x112561000] Decoder=11184cc00 Queueing audio task - queued=69, decoder-queued=2
[MediaPlayback #2]: V/MediaDecoder MediaDecoderStateMachine[0x112561000] Decoder=11184cc00 OnAudioDecoded [2112000,2136000]
[MediaPlayback #2]: V/MediaDecoder AudioSink=0x110051000 One new audio packet available.
[Unnamed thread 0x116a042e0]: V/MediaDecoder AudioSink=0x110051000 playing audio at time=120000 offset=371 length=557
[Unnamed thread 0x116a042e0]: V/MediaDecoder AudioSink=0x110051000 playing audio at time=120000 offset=928 length=224
[Unnamed thread 0x116a042e0]: V/MediaDecoder AudioSink=0x110051000 playing audio at time=144000 offset=0 length=333
[MediaPlayback #1]: V/MediaDecoder MediaDecoderStateMachine[0x112561000] Decoder=11184cc00 UpdatePlaybackPositionInternal(139333)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 133333 (id=3) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 166666 (id=4) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 200000 (id=5) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 233333 (id=6) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 266666 (id=7) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 300000 (id=8) (vq-queued=7)
[MediaPlayback #1]: V/MediaDecoder VideoSink=0x1120b5f50 playing video frame 333333 (id=9) (vq-queued=7)

Comment 3

[JW Wang [:jwwang] [:jw_wang]]

There is nothing wrong about the VideoSink which always sends multiple frames to the compositor in each render loop.

loop 1: id=2 ~ id=9
loop 2: id=3 ~ id=9

As you can see id=10 is missing in loop 2 which is a sign of slow video decoding and stuttering.

Comment 4

[Tzuhao Kuo [:kaku]]

On Windows, we cannot play this video because it exceeds the resolution limit (4092 x 2304 pixels). 
MS spec: https://msdn.microsoft.com/en-us/library/windows/desktop/dd797815(v=vs.85).aspx

Chrome uses FFmpeg to decode it, but we don't use ffmpeg on Windows.
However, it's interesting that Microsoft Edge can play this video. I wonder if they have some tricks on their Media Foundation.

BTW, I tried to ignore the resolution check and ask Media Foundation to decode it anyway; it seems that Media Foundation can decode it, but the decoded frames are not displayed smoothly.

Comment 5

[Catalin Sasca, Desktop QA [:csasca]]

The issue is still reproducing under Firefox 66.0b6 under macOS 10.11. 3D 4k videos are not loading at all.

Comment 6

[Timea Cernea [:tbabos][inactive]]

Reproducible on latest Beta 67 on Windows 10 x64. The "Video can't be played because the file is corrupt" message is displayed. Also checked the videos on Chrome, they do work there.

Comment 7

[Liviu Seplecan]

The same results encountered as described on comment 6 - testing environment: Windows 7 x64 / latest Nightly 69.0a1.

Comment 8

[Alin Ilea, Desktop QA]

The same result like in comment 6 in latest Nightly build 70.0a1 (2019-07-16) on Windows 8.

Comment 9

[Timea Cernea [:tbabos][inactive]]

Updating flags for affected builds.

Comment 10

[aeioudev]

The bug is still present in Firefox 90.0.2 with this video: https://www.solasta-game.com/storage/337/ta-banner-animation-2021-6.mp4

Comment 11

[Melissa Gilbreth]

Attachment: same problem

Thanks from zansimatze1980.