Closed Bug 1709980 Opened 3 years ago Closed 3 years ago

[wpt-sync] Sync PR 28884 - [webcodecs] Add WPT H.264 VideoDecoder tests.

Tracking

(firefox90 fixed)

Status:

RESOLVED FIXED

Milestone:

90 Branch

Tracking Flags:

Tracking

Status

firefox90

---

fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Description

•

3 years ago

Sync web-platform-tests PR 28884 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/28884
Details from upstream follow.

b'Dan Sanders <sandersd@chromium.org>' wrote:

[webcodecs] Add WPT H.264 VideoDecoder tests.

Bug: 1117643
Change-Id: I1e98643716de1192db34efe803e86f6ecedc6a18
Reviewed-on: https://chromium-review.googlesource.com/2879161
WPT-Export-Revision: d5b4e03619ae44bd20059a5fdceafe3ad3176210

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

3 years ago

Whiteboard: [wptsync downstream] → [wptsync downstream error]

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

3 years ago

Whiteboard: [wptsync downstream error] → [wptsync downstream]

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Comment 1

•

3 years ago

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=405c9ae7cdd70e0bb8fc203f34a2bfd8ce2ddf07

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Comment 2

•

3 years ago

CI Results

Ran 15 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 10 tests and 16 subtests

Status Summary

Firefox

OK : 4
FAIL : 62
ERROR : 6
NOTRUN : 96

Chrome

OK : 6
PASS : 120
FAIL : 34
TIMEOUT: 8

Safari

OK : 4
FAIL : 62
ERROR : 6
NOTRUN : 96

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/webcodecs/audio-decoder.any.worker.html
Test that AudioDecoder.isConfigSupported() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Video codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Video codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder.isConfigSupported() with a valid config: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() returns a parsed configuration: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder construction: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder.configure(): FAIL (Chrome: PASS, Safari: FAIL)
Verify closed AudioDecoder operations: FAIL (Chrome: PASS, Safari: FAIL)
Verify unconfigured AudioDecoder operations: FAIL (Chrome: PASS, Safari: FAIL)
Test Opus decoding: FAIL (Chrome: PASS, Safari: FAIL)
Test Opus decoding with a negative timestamp: FAIL (Chrome: PASS, Safari: FAIL)
Test decoding after flush.: FAIL (Chrome: FAIL, Safari: FAIL)
Test reset during flush.: FAIL (Chrome: FAIL, Safari: FAIL)
/webcodecs/audio-decoder.any.html
Test that AudioDecoder.isConfigSupported() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Video codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Video codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.configure() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder.isConfigSupported() with a valid config: FAIL (Chrome: PASS, Safari: FAIL)
Test that AudioDecoder.isConfigSupported() returns a parsed configuration: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder construction: FAIL (Chrome: PASS, Safari: FAIL)
Test AudioDecoder.configure(): FAIL (Chrome: PASS, Safari: FAIL)
Verify closed AudioDecoder operations: FAIL (Chrome: PASS, Safari: FAIL)
Verify unconfigured AudioDecoder operations: FAIL (Chrome: PASS, Safari: FAIL)
Test Opus decoding: FAIL (Chrome: PASS, Safari: FAIL)
Test Opus decoding with a negative timestamp: FAIL (Chrome: PASS, Safari: FAIL)
Test decoding after flush.: FAIL (Chrome: FAIL, Safari: FAIL)
Test reset during flush.: FAIL (Chrome: FAIL, Safari: FAIL)
/webcodecs/video-decoder.any.worker.html
Test that VideoDecoder.isConfigSupported() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Audio codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Audio codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test VideoDecoder construction: FAIL (Chrome: PASS, Safari: FAIL)
/webcodecs/video-decoder.any.html
Test that VideoDecoder.isConfigSupported() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Audio codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.isConfigSupported() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Emtpy codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Unrecognized codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Audio codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Ambiguous codec: FAIL (Chrome: PASS, Safari: FAIL)
Test that VideoDecoder.configure() rejects invalid config:Codec with MIME type: FAIL (Chrome: PASS, Safari: FAIL)
Test VideoDecoder construction: FAIL (Chrome: PASS, Safari: FAIL)
/webcodecs/videoDecoder-codec-specific.any.html?vp9: ERROR (Chrome: OK, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: PASS, Safari: NOTRUN)
/webcodecs/videoDecoder-codec-specific.any.worker.html?h264_avc: ERROR (Chrome: TIMEOUT, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: TIMEOUT, Safari: NOTRUN)
/webcodecs/videoDecoder-codec-specific.any.html?h264_avc: ERROR (Chrome: TIMEOUT, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: TIMEOUT, Safari: NOTRUN)
/webcodecs/videoDecoder-codec-specific.any.worker.html?vp9: ERROR (Chrome: OK, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: PASS, Safari: NOTRUN)
/webcodecs/videoDecoder-codec-specific.any.html?h264_annexb: ERROR (Chrome: TIMEOUT, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: TIMEOUT, Safari: NOTRUN)
/webcodecs/videoDecoder-codec-specific.any.worker.html?h264_annexb: ERROR (Chrome: TIMEOUT, Safari: ERROR)
Test isConfigSupported(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test isConfigSupported() with 1080p crop: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test that isConfigSupported() returns a parsed configuration: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test invalid configs: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test configure(): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode a key frame: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Verify reset() suppresses outputs: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test unconfigured VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test closed VideoDecoder operations: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode empty frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Decode corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Close while decoding corrupt frame: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test decoding after flush: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test decoding a with negative timestamp: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Test reset during flush: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Test low-latency decoding: NOTRUN (Chrome: TIMEOUT, Safari: NOTRUN)

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

3 years ago

Depends on: 1711097

Pulsebot

Comment 3

•

3 years ago

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e4df6423d56b
[wpt PR 28884] - [webcodecs] Add WPT H.264 VideoDecoder tests., a=testonly
https://hg.mozilla.org/integration/autoland/rev/8e0b8d4b4068
[wpt PR 28884] - Update wpt metadata, a=testonly

Sandor Molnar[:smolnar]

Comment 4

•

3 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/e4df6423d56b
https://hg.mozilla.org/mozilla-central/rev/8e0b8d4b4068

Status: NEW → RESOLVED

Closed: 3 years ago

status-firefox90: --- → fixed

Resolution: --- → FIXED

Target Milestone: --- → 90 Branch

You need to log in before you can comment on or make changes to this bug.

Bugzilla

Quick Search

[wpt-sync] Sync PR 28884 - [webcodecs] Add WPT H.264 VideoDecoder tests.

Categories

(Testing :: web-platform-tests, task, P4)

Tracking

(firefox90 fixed)

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Crash Data

Security

(public)

User Story

Description

Updated

Updated

Comment 1

Comment 2

CI Results

Status Summary

Firefox

Chrome

Safari

Links

Details

New Tests That Don't Pass

Updated

Comment 3

Comment 4