1874427 - [wpt-sync] Sync PR 43969 - Move webrtc-encoded-transform tests that are not aligned with the spec to a tentative folder

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 43969 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/43969
Details from upstream follow.

Youenn Fablet <[e-mail]> wrote:

Move webrtc-encoded-transform tests that are not aligned with the spec to a tentative folder

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=13be85c07b76c2dc7061ddc373b4657376240401

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=3e95171b1144e3e7ef67e96d70278cc13e62f7d0

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 12 tests and 4 subtests

Status Summary

Firefox

OK : 12
FAIL: 27

Chrome

OK : 12
PASS: 19
FAIL: 8

Safari

OK : 12
FAIL: 27

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webrtc-encoded-transform/tentative/RTCEncodedAudioFrame-clone.https.html [wpt.fyi]
  • Cloning before sending works: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCEncodedAudioFrame-receive-cloned.https.html [wpt.fyi]
  • Cloning before sending works: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCEncodedAudioFrame-send-incoming.https.html [wpt.fyi]
  • Send endoded incoming frame: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCEncodedAudioFrame-serviceworker-failure.https.html [wpt.fyi]
  • RTCEncodedVideoFrame cannot cross agent clusters, service worker edition: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCEncodedVideoFrame-clone.https.html [wpt.fyi]
  • Cloning before sending works: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCEncodedVideoFrame-serviceworker-failure.https.html [wpt.fyi]
  • RTCEncodedVideoFrame cannot cross agent clusters, service worker edition: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-audio.https.html [wpt.fyi]
  • Frames flow correctly using insertable streams: FAIL (Chrome: FAIL, Safari: FAIL)
  • Frames flow correctly using insertable streams when receiver starts negotiation: FAIL (Chrome: FAIL, Safari: FAIL)
  • Frames flow correctly using insertable streams with param: FAIL (Chrome: PASS, Safari: FAIL)
  • Frames flow correctly using insertable streams when receiver starts negotiation with param: FAIL (Chrome: PASS, Safari: FAIL)
  • Enqueuing the same frame twice fails: FAIL (Chrome: PASS, Safari: FAIL)
  • Creating streams twice throws: FAIL (Chrome: PASS, Safari: FAIL)
  • Encoded frames serialize and deserialize into a deep clone: FAIL (Chrome: FAIL, Safari: FAIL)
  • Modifying rtp timestamp: FAIL (Chrome: FAIL, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-errors.https.html [wpt.fyi]
  • Enqueuing the same frame twice fails: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-simulcast.https.html [wpt.fyi]
  • Basic simulcast setup with three spatial layers: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-video-frames.https.html [wpt.fyi]
  • Key and Delta frames are sent and received: FAIL (Chrome: PASS, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-video.https.html [wpt.fyi]
  • Frames flow correctly using insertable streams: FAIL (Chrome: FAIL, Safari: FAIL)
  • Frames flow correctly using insertable streams when receiver starts negotiation: FAIL (Chrome: FAIL, Safari: FAIL)
  • Frames flow correctly using insertable streams with param: FAIL (Chrome: PASS, Safari: FAIL)
  • Frames flow correctly using insertable streams when receiver starts negotiation with param: FAIL (Chrome: PASS, Safari: FAIL)
  • Creating streams twice throws: FAIL (Chrome: FAIL, Safari: FAIL)
  • Encoded frames serialize and deserialize into a deep clone: FAIL (Chrome: FAIL, Safari: FAIL)
• /webrtc-encoded-transform/tentative/RTCPeerConnection-insertable-streams-worker.https.html [wpt.fyi]
  • RTCRtpSender readable stream transferred to a Worker and the Worker sends an RTCEncodedAudioFrame back: FAIL (Chrome: PASS, Safari: FAIL)
  • RTCRtpSender readable stream transferred to a Worker and the Worker sends an RTCEncodedVideoFrame back: FAIL (Chrome: PASS, Safari: FAIL)
  • Video RTCRtpSender insertable streams transferred to a worker, which tries to write an invalid frame: FAIL (Chrome: PASS, Safari: FAIL)
  • Audio RTCRtpSender insertable streams transferred to a worker, which tries to write an invalid frame: FAIL (Chrome: PASS, Safari: FAIL)

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1fdcfc1f124e
[wpt PR 43969] - Move webrtc-encoded-transform tests that are not aligned with the spec to a tentative folder, a=testonly
https://hg.mozilla.org/integration/autoland/rev/e26311618260
[wpt PR 43969] - Update wpt metadata, a=testonly

Comment 5

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/1fdcfc1f124e
https://hg.mozilla.org/mozilla-central/rev/e26311618260