1652945 - Add AV1 hardware decoding support

Status: RESOLVED FIXED

(Core :: Audio/Video: Playback, enhancement, P3)

Description

[GMA]

https://github.com/intel/media-driver/commit/9491998f40d496fc458d282f213c0e9e945b8062

"[Decode] This enables HW AV1 decode acceleration on Gen12"

Intel has AV1 fixed function hardware decoding in Gen12 integrated GPU shipping in Tiger Lake later this year and Rocket Lake whenever that is released, Mozilla should add AV1 hardware decoding support when possible.

https://bugzilla.mozilla.org/show_bug.cgi?id=1292374

Previous bug showing how VP9 fixed function hardware decoding support was added for reference.

Comment 1

[lolipopplus]

Just a bit more info: YouTube seems roll all video above 2K to av1 instead of VP8/9 once before.

Comment 2

[NVD]

https://www.nvidia.com/en-us/geforce/news/rtx-30-series-av1-decoding/

Nvidia Ampere GPUs have AV1 hardware decoding, please add AV1 hardware decoding support to Firefox.

Comment 3

[Darkspirit]

Nvidia: "Google has updated Chrome on Windows 10 to support AV1 hardware decoding"

• Secret issue 1073252 seems to have added AV1 to Chrome:
  https://source.chromium.org/chromium/chromium/src/+/04f859f75bcfa8df08769c5096b205673a3e22f6 (Github)
  https://source.chromium.org/chromium/chromium/src/+/8392abc78133214654bb0221836f8fdefa49c78d (Github)

• Issue 1115846: "Add AV1 decoding with D3D11VideoDecoder" "Currently the AV1 decoding hardware acceleration will be through DXVA."

Comment 4

[GMA]

https://newsroom.intel.com/news-releases/11th-gen-tiger-lake-evo/

"Support for the high-performance AV1 CODEC that enables power-efficient support for 4K, even in constrained bandwidth environments."

Comment 5

[GMA]

https://www.microsoft.com/en-us/download/details.aspx?id=101577

"This document is the specification for support of AV1 according to the AV1 video coding standard as published by the Alliance for Open Media within the Windows DirectX Video Acceleration (DXVA) API/DDI context. The document describes high-level design concepts and specific AV1 extensions to DXVA interfaces and data structures. This document specifies only off-host VLD profiles for AV1 decoding."

Comment 6

[lolipopplus]

Per NVIDIA press at https://www.nvidia.com/en-us/geforce/news/rtx-30-series-av1-decoding/
NVIDIA started supporting av1 on RTX 30 series.

Comment 7

[GMA]

https://techcommunity.microsoft.com/t5/media-at-microsoft/av1-hardware-accelerated-video-on-windows-10/ba-p/1765451

Here are the components required to experience hardware accelerated AV1 video on Windows 10:

One of these new GPUs or CPUs:
    11th Gen Intel Core processors with Intel Iris Xe Graphics 
    NVIDIA GeForce RTX 30 Series GPUs
    AMD Radeon™ RX 6000 Series Graphics (coming soon)
Windows 10 build 1909 or later
The AV1 Video Extension
A web browser or other application with hardware acceleration support for AV1, including apps built on top of Media Foundation
As is common with new features like this, you may need to update your graphics driver from time to time to get the latest features and improvements.

Comment 8

[Byron Campen [:bwc]]

Is this a dupe of bug 1652958, or is bug 1652958 a dependency of this bug?

Comment 9

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

This depends on bug 1652958. VAAPI support will be one of the ways we can support hardware AV1, but is unlikely to be the avenue we take of Windows and MacOS.

Comment 10

[Martin Stránský [:stransky] (ni? me)]

Windows HW media playback does not use VA-API / ffvpx so removing Bug 1652958.

Comment 11

[Jim Mathies [:jimm]]

Hardware support is still pretty limited, around 2% of the total ecosystem. Not a priority at this point.

Comment 12

[Zaggy1024]

Attachment: Bug 1652945 - Added support for the Windows Media Foundation AV1 decoder for hardware decoding. r=alwu

Comment 13

[Zaggy1024]

Attachment: Bug 1652945 - Added support for the Windows Media Foundation AV1 decoder for hardware decoding. r=alwu

The method of creating decoder MFTs was replaced with MFEnumEx queries in order to get an instance of the AV1 decoder.

https://phabricator.services.mozilla.com/D138884

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/90c92f9077fa
Added support for the Windows Media Foundation AV1 decoder for hardware decoding. r=alwu

Comment 15

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/90c92f9077fa

Comment 16

[Jeff Muizelaar [:jrmuizel]]

FWIW, AV1 support is now above 4%:
https://sql.telemetry.mozilla.org/embed/query/82613/visualization/204674?api_key=GvcRVsUEJjJ7AULKznCep2PsSFl3FNy6ICtYRPx6&

Comment 17

[Jeff Muizelaar [:jrmuizel]]

Release Note Request (optional, but appreciated)
[Why is this notable]: Windows users with new enough GPUs will get hardware decoded AV1 video.
[Affects Firefox for Android]: Nope
[Suggested wording]: Hardware accelerated AV1 video decoding enabled on Windows with supported GPUs (Intel Gen 11+, AMD RDNA 2 Excluding Navi 24, GeForce 30)
[Links (documentation, blog post, etc)]:

Comment 18

[Dianna Smith [:diannaS]]

Release note added, please see https://www.mozilla.org/firefox/100.0a1/releasenotes/