Closed Bug 1665591 Opened 5 years ago Closed 5 years ago

[wpt-sync] Sync PR 25589 - wpt: add pointer about webrtc/h264 failures on buildbots

Categories

(Core :: WebRTC, task, P4)

Product:
Core
Component:
WebRTC
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
83 Branch
Tracking Flags:
Tracking Status
firefox83 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 25589 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/25589
Details from upstream follow.

b'Philipp Hancke <philipp.hancke@googlemail.com>' wrote:

wpt: add pointer about webrtc/h264 failures on buildbots

as buildbots missing H264 comes up frequently.

BUG=chromium:840659

Change-Id: I8db4bee8bbbc04d1227d957dcd6a73ee658ec829
Reviewed-on: https://chromium-review.googlesource.com/2414315
WPT-Export-Revision: a0061c660024fc68040f500d4797be331d3aa074

Component: web-platform-tests → WebRTC
Product: Testing → Core

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 3 tests and 1 subtests

Status Summary

Firefox

OK : 2[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 3[GitHub]
FAIL : 4[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 23[GitHub]

Chrome

OK : 3
PASS : 23

Safari

OK : 2
PASS : 11
FAIL : 11
TIMEOUT: 2

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

/webrtc/RTCRtpTransceiver-setCodecPreferences.html
setCodecPreferences() on audio transceiver with codecs returned from RTCRtpSender.getCapabilities('audio') should succeed: FAIL
setCodecPreferences() on video transceiver with codecs returned from RTCRtpReceiver.getCapabilities('video') should succeed: FAIL
setCodecPreferences() with both sender receiver codecs combined should succeed: FAIL
setCodecPreferences([]) should succeed: FAIL
setCodecPreferences() with reordered codecs should succeed: FAIL
setCodecPreferences() with only VP8 should succeed: FAIL
setCodecPreferences() with only H264 should succeed: FAIL
setCodecPreferences() should allow setting H264 as first codec: FAIL
/webrtc/protocol/video-codecs.https.html
H.264 and VP8 should be supported in initial offer: FAIL linked bug:Bug 1534688
H.264 and VP8 should be negotiated after handshake: FAIL linked bug:Bug 1534687
All H.264 codecs MUST include profile-level-id: FAIL linked bug:Bug 1534687

New Tests That Don't Pass

/webrtc/RTCRtpTransceiver-setCodecPreferences.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
setCodecPreferences() on audio transceiver with codecs returned from RTCRtpSender.getCapabilities('audio') should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() on video transceiver with codecs returned from RTCRtpReceiver.getCapabilities('video') should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() with both sender receiver codecs combined should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences([]) should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() with reordered codecs should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() with only VP8 should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() with only H264 should succeed: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() should allow setting H264 as first codec: FAIL (Chrome: PASS, Safari: PASS)
setCodecPreferences() should allow setting VP8 as first codec: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() on audio transceiver with codecs returned from getCapabilities('video') should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with user defined codec with invalid mimeType should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with user defined codec should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with user defined codec together with codecs returned from getCapabilities() should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with modified codec clock rate should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with modified codec channel count should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with modified codec parameters should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() with modified codecs returned from getCapabilities() should throw InvalidModificationError: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() modifies the order of audio codecs in createOffer: FAIL (Chrome: PASS, Safari: FAIL)
setCodecPreferences() modifies the order of video codecs in createOffer: FAIL (Chrome: PASS, Safari: FAIL)
/webrtc/protocol/video-codecs.https.html
H.264 and VP8 should be supported in initial offer: FAIL (Chrome: PASS, Safari: PASS)
H.264 and VP8 should be negotiated after handshake: FAIL (Chrome: PASS, Safari: PASS)
All H.264 codecs MUST include profile-level-id: FAIL (Chrome: PASS, Safari: PASS)
/webrtc/simulcast/h264.https.html
H264 simulcast setup with three spatial layers: FAIL (Chrome: PASS, Safari: TIMEOUT)

Tests Disabled in Gecko Infrastructure

/webrtc/RTCRtpTransceiver-setCodecPreferences.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/d5aa6ea73bc7 [wpt PR 25589] - wpt: add pointer about webrtc/h264 failures on buildbots, a=testonly

https://hg.mozilla.org/mozilla-central/rev/d5aa6ea73bc7

Status: NEW → RESOLVED
Closed: 5 years ago
status-firefox83: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 83 Branch
You need to log in before you can comment on or make changes to this bug.