1868470 - Write talos glvideo/canvas2dvideo style tests for WebCodecs and DOM workers

Status: RESOLVED FIXED

(Core :: Graphics: Canvas2D, task, P3)

Description

[Andrew Osmond [:aosmond] (he/him)]

We should write new tests similar to glvideo/canvas2dvideo but:

1. Use WebCodecs VideoFrame as an input instead of HTMLVideoElement
2. Run on the DOM worker threads

Comment 1

[Andrew Osmond [:aosmond] (he/him)]

Attachment: Bug 1868470 - Add new OffscreenCanvas and WebCodecs talos tests.

This patch adds new variants of the glvideo/canvas2dvideo talos tests,
but this time focused on OffscreenCanvas and WebCodecs.

There are test variants for each:

• Execution thread (main thread or DOM worker)
• Canvas type (WebGL or 2D canvas)
• Codec type (H264, VP9 or AV1)

They are included as part of the existing webgl talos job.

Comment 2

[Andrew Osmond [:aosmond] (he/him)]

This is very similar, and shares code with, to https://w3c.github.io/webcodecs/samples/video-decode-display/.

Next on my agenda is improving the performance of these benchmarks, especially H264 + 2D canvas + Windows. Preliminary results show that it is abysmal compared to VP9 and AV1, because counter intuitively, we are slower on the accelerated path. This is due to readbacks we could easily avoid. I think we can also improve the performance of VP9 and AV1 by avoiding copies.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cb0fb07166b1
Add new OffscreenCanvas and WebCodecs talos tests. r=perftest-reviewers,sparky

Comment 4

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/cb0fb07166b1