1945371 - Some HEVC decoding issue on Firefox 136.0a1 (2025-02-01) (aarch64)

Status: NEW

(Core :: Audio/Video: Playback, defect, P3)

Description

[Sida Zhu]

I'm really glad to see that Firefox is making efforts to enable support for macOS HEVC!

When testing the latest version of Firefox 136.0a1 (2025-02-01) (aarch64), I've found some bugs related to HEVC decoding and rendering.

Here is a summary:

These HEVC video can't play:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-10
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-8
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hlg-sample-2
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-dv-p5-sample-1
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-dv-p8-1-sample-1
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-4
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-5
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-hdr10-sample-1

These HEVC video can't seek:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-6
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-11

Incorrect duration and Can't seek:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-mv-sample-1

Incorrect 4:2:2/4:4:4 rendering
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-9
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-10

Incorrect HDR rendering:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-2
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-pq10-sample-1

Lost Alpha Channel:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-alpha-sample-1
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-alpha-sample-2

These bugs don't exist in Chrome, hope Firefox could fix them before launch.

(My computer configuration: M1 Pro + macOS 15.3 FYI)

Comment 1

[Alastor Wu [:alwu]]

(In reply to Sida Zhu from comment #0)

These HEVC video can't play:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-10

I can play this on my M1 Max.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-8

Got kVTVideoDecoderReferenceMissing error, need investigation.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hlg-sample-2

Got kVTVideoDecoderBadDataErr error, need investigation.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-dv-p5-sample-1

We don't support Dolby Vision.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-dv-p8-1-sample-1

We don't support Dolby Vision.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-4

Failed to parse extradata, Incorrect extra-data size 0, need investigation.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-5

Failed to parse extradata, Incorrect extra-data size 0, need investigation.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-hdr10-sample-1

Failed to parse extradata, Incorrect extra-data size 0, need investigation.

These HEVC video can't seek:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-6

I can seek, but the seeking is kinda slow. In addition, no audio playback, need investigation.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-11

I can seek, but the seeking is a little slow.

Incorrect duration and Can't seek:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-mv-sample-1

I can seek, but the duration is indeed wrong, need investigation.

Incorrect 4:2:2/4:4:4 rendering
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-9

Looks exact same as Chrome.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-10

The right part of the image isn't displayed in the correct color format, need investigation.

Incorrect HDR rendering:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-2
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-pq10-sample-1

The color does seem not bright enough, but I only got white frame when playing those videos on Chrome.

Lost Alpha Channel:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-alpha-sample-1
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-alpha-sample-2

Indeed, need investigation.

Comment 2

[Sida Zhu]

Thanks for the quick response!

These HEVC video can't play:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-10

I can play this on my M1 Max.
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-8

Sorry, this video indeed can play but fail to seek, that's the problem.

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main-bt709-sample-11

I can seek, but the seeking is a little slow.

From my side, the seek operation always gets stuck with the message: "No videos with supported format and MIME type found".

https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-dv-p8-1-sample-1

We don't support Dolby Vision.

It's reasonable that dolby vision profile 5 is not supported, but for dolby vision profile 8.1 and 8.4, they should be designed to be backward downgrade compatible and can be treated as normal HDR10/HLG HEVC main10 video. bilibili.com has a variety of videos encoded as dolby vision profile 8.1/8.4.

Incorrect 4:2:2/4:4:4 rendering
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#rext-bt709-sample-9

Looks exact same as Chrome.

Please try to switch between those 4:2:0/4:2:2/4:4:4 videos by clicking the panels on the left side. You can see the chroma sampling differences in Safari and Chrome. However, in Firefox, it seems all the videos are downgraded to 4:2:0.

Incorrect HDR rendering:
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-hdr10-sample-2
https://lf-tk-sg.ibytedtos.com/obj/tcs-client-sg/resources/video_demo_hevc.html#main10-pq10-sample-1

The color does seem not bright enough, but I only got white frame when playing those videos on Chrome.

You could try to download the videos, drag and drop them into the browser. Then it would be easier to reproduce the issue. Some of the videos can render HDR normally, but when you scroll the page, the HDR rendering is lost. Some don't show HDR at all.