1763720 - VAAPI decoding fails, says video is corrupt

Status: RESOLVED DUPLICATE of bug 1761217

(Core :: Audio/Video: Playback, defect, P3)

Description

[benjamin.j.grant]

Attachment: information collected by about:support

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:99.0) Gecko/20100101 Firefox/99.0

Steps to reproduce:

I opened a video file that can be hardware decoded (H.264 or VP9) in Firefox. Software-decoded codecs like AV1 work fine. about:support JSON dump is attached.

Actual results:

The first frame of video appears, but an overlaid error message says "Video can't be played because the file is corrupt." See attached log (collected with MOZ_LOG='PlatformDecoderModule:5'). The errors look similar to bug 1705940, but this occurs on all hardware decoded files, not just 10-bit VP9.

Expected results:

The video should have played normally.

Comment 1

[benjamin.j.grant]

Attachment: Log output playing an H.264 video (also attached) with VAAPI

Comment 2

[benjamin.j.grant]

Attachment: H.264 video which fails to play

Comment 3

[benjamin.j.grant]

Some additional info:

• The part of the log that reminded me of bug 1705940 is Decode error: NS_ERROR_OUT_OF_MEMORY.
• Playback fails when I view that file from my own disk (file:///path/to/Hinox with roundabout.mp4). Somehow the embedded version on this bug works. I've also encountered intermittent failures on YouTube, but there are many more variables there and sometimes it's able to start playing after several attempts. I can collect logs from either of those cases if it would help.

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Core::Audio/Video: Playback' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 5

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

Thanks for the report. Is this something that used to work and started failing in Firefox 99?

Comment 6

[benjamin.j.grant]

It worked the same way across several versions until Firefox 98. On 98 I had to disable the RDD sandbox (environment variable MOZ_DISABLE_RDD_SANDBOX=1) to restore VAAPI decoding. On 99, it doesn't work even with that setting.

Comment 7

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

(In reply to benjamin.j.grant from comment #6)

It worked the same way across several versions until Firefox 98. On 98 I had to disable the RDD sandbox (environment variable MOZ_DISABLE_RDD_SANDBOX=1) to restore VAAPI decoding. On 99, it doesn't work even with that setting.

Thanks!

Martin, any idea what could be causing this?

Comment 8

[Martin Stránský [:stransky] (ni? me)]

Yes, according the log it's dupe of Bug 1761217.

Please try latest nightly and if VA-API fails attach MOZ_LOG='PlatformDecoderModule:5 MediaFormatReader:5' log here.
Thanks.

Comment 9

[benjamin.j.grant]

It does work on Nightly, thank you! Tested with various VP9 and H.264 files. Sorry I couldn't find bug 1761217. It seems to even work without disabling the RDD process now.