1418761 - video image freezes for a few seconds (maybe video decoding bug)

Status: RESOLVED INVALID

(Core :: Audio/Video: Playback, defect, P2)

Description

[Djfe]

Attachment: example.mp4

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:59.0) Gecko/20100101 Firefox/59.0
Build ID: 20171118220429

Steps to reproduce:

I played a video on Telegram, that I had uploaded earlier from my smartphone. (attached)
(I also played it in a new tab using a fresh profile to be sure)


Actual results:

The first few seconds of video of all those videos aren't decoded properly (audio is)
Or atleast the image doesn't update.

the amount of time that the image freezes seems to be of the same duration regardless of total video length, so I'll upload a short video.


Expected results:

It should've shown the full video.

Comment 1

[Djfe]

I'm using Firefox Nightly 64bit on Win 10 Education Edition
Latest updates are installed (OS and nightly)

Comment 2

[Blake Wu [:bwu][:blakewu]]

This problem can be seen on my windows laptop with Firefox 57, 58, and 59. 
Chrome can play the video well.

Comment 3

[Alfredo Yang (:alfredo)]

Hi,

this video has an invalid keyframe at the beginning so the first few seconds can't be decoded. (depending on error handle of the decoder. In Safari, it can't be played at all.)
I'll see anything we can do here.
BTW, which device you use to record this video?

Comment 4

[Djfe]

Hi Alfredo,

well that explains it, and why why this bug occured consistenly across all videos, that I encoded this way. :)
FFmpeg's decoder doesn't seem to give a **** and decodes that frame without a warning (I wasn't using verbose logging though)

I used the telegram android app back then to send videos and it automatically reencoded the video to save some space (Opt-out).
After that I was wondering, why it had playback issues on Firefox (accessing the messages from the Telegram Web app) but not in VLC.

I'll retest, if this issue still exists in current versions of the app and send them another bug report if that's the case.

Until then: Is this fixable? should this be fixed or not? what do you think?
(EDGE hat issues with the video, too)

Comment 5

[Alfredo Yang (:alfredo)]

(In reply to Djfe from comment #4)
> Until then: Is this fixable? should this be fixed or not? what do you think?
> (EDGE hat issues with the video, too)

Thanks for the info.

I tried to ignore the error, even it could play smoothly but there are broken frames at the beginning, you could see some strange green block in the attachment. For this case, I think it is a video content error.

We knew FFmpeg has better error handle than most decoders. We can't use FFmpeg due to patent issue. Instead, Firefox uses system platform decoder, it is WMF on Windows. That explains why Edge has issues to play it.

A keyframe its first NALUnit type should be IDR (5) or SEI (6) with recovery point. In this video, it has SEI type but no recovery point, so Firefox marks it non-keyframe and then following frames couldn't be decoded until the real keyframe arrives.

Comment 6

[Alfredo Yang (:alfredo)]

Attachment: invalid_keyframe.jpeg