1957132 - [wpt-sync] Sync PR 51692 - [media capabilities] Fix webrtc tests.

Status: RESOLVED FIXED

(Core :: CSS Parsing and Computation, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 51692 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/51692
Details from upstream follow.

mark a. foltz <[e-mail]> wrote:

[media capabilities] Fix webrtc tests.

A couple of small fixes:

• A webrtc decodingInfo test has an extra line that causes it to fail.
• Fix strings in media-capabilities/decodingInfoEncryptedMedia.http.html for consistency.

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=9c80e8294fc8ceffd8e6fb999cd913c8a6abb63c

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 3 tests and 1 subtests

Status Summary

Firefox

OK : 3
PASS: 33
FAIL: 19

Chrome

OK : 3
PASS: 50
FAIL: 10

Safari

OK : 3
PASS: 47
FAIL: 7

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

• /media-capabilities/decodingInfo-webrtc.any.html [wpt.fyi]
  • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
  • Test that decodingInfo returns supported true for the codec audio/opus returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec audio/G722 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpReceiver.getCapabilities(): FAIL
• /media-capabilities/decodingInfo-webrtc.any.worker.html [wpt.fyi]
  • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL
  • Test that decodingInfo returns supported true for the codec audio/opus: FAIL
  • Test that decodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL

New Tests That Don't Pass

• /media-capabilities/decodingInfo-webrtc.any.html [wpt.fyi]
  • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec audio/opus returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec audio/G722 returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec audio/PCMU returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec audio/PCMA returned by RTCRtpReceiver.getCapabilities(): FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec video/VP8; max-fs=12288;max-fr=60 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/VP9; max-fs=12288;max-fr=60 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42e01f;level-asymmetry-allowed=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1;packetization-mode=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/H264; profile-level-id=42001f;level-asymmetry-allowed=1 returned by RTCRtpReceiver.getCapabilities(): FAIL
  • Test that decodingInfo returns supported true for the codec video/AV1 returned by RTCRtpReceiver.getCapabilities(): FAIL (Safari: PASS)
• /media-capabilities/decodingInfo-webrtc.any.worker.html [wpt.fyi]
  • Test that decodingInfo returns a valid MediaCapabilitiesInfo objects: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc video content type.: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported, smooth, and powerEfficient set to false for non-webrtc audio content type.: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec audio/opus: FAIL (Chrome: PASS, Safari: PASS)
  • Test that decodingInfo returns supported true for the codec video/VP9; profile-level="0": FAIL (Chrome: PASS, Safari: PASS)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/143541f73de1
[wpt PR 51692] - [media capabilities] Fix webrtc tests., a=testonly
https://hg.mozilla.org/integration/autoland/rev/8dcc389327b7
[wpt PR 51692] - Update wpt metadata, a=testonly

Comment 4

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/143541f73de1
https://hg.mozilla.org/mozilla-central/rev/8dcc389327b7