Closed Bug 1791262 Opened 2 years ago Closed 2 years ago

Perma TEST-UNEXPECTED-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's qpSum - expected FAIL when Gecko merges to Beta on 2022-09-19

Categories

(Core :: WebRTC, defect)

Product:
Core
Component:
WebRTC
Type:
defect

Tracking

()

Status:
VERIFIED FIXED
Milestone:
107 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox105 --- unaffected
firefox106 --- unaffected
firefox107 + verified

People

(Reporter: apavel, Assigned: aryx)

References

(Regression)

Details

(Keywords: regression)

Attachments

(1 file)

Bug 1791262 - set webrtc-stats/supported-stats.html as passing outside Nightly on non-Linux OS
48 bytes, text/x-phabricator-request
Details | Review

Central-as-beta simulation
How to run these simulations
Failure log

[task 2022-09-17T11:32:14.298Z] 11:32:14     INFO - TEST-START | /webrtc-stats/supported-stats.html
[task 2022-09-17T11:32:14.305Z] 11:32:14     INFO - Closing window 178b8169-defa-46db-8bf6-710bd84e6d53
[task 2022-09-17T11:32:14.317Z] 11:32:14     INFO - PID 3316 | [Child 3334, Main Thread] WARNING: '!CanHandleWith(aPresContext)', file /builds/worker/checkouts/gecko/dom/events/IMEStateManager.cpp:498
[task 2022-09-17T11:32:14.356Z] 11:32:14     INFO - PID 3316 | [Child 3334, Main Thread] WARNING: '!CanHandleWith(aPresContext)', file /builds/worker/checkouts/gecko/dom/events/IMEStateManager.cpp:498
[task 2022-09-17T11:32:14.731Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:366: PeerConnectionImpl: PeerConnectionImpl constructor for
[task 2022-09-17T11:32:14.732Z] 11:32:14     INFO - PID 3316 | [Parent 3316: Socket Thread]: D/mtransport NrIceCtx static call to find local stun addresses
[task 2022-09-17T11:32:14.732Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:366: PeerConnectionImpl: PeerConnectionImpl constructor for
[task 2022-09-17T11:32:14.733Z] 11:32:14     INFO - PID 3316 | [Parent 3316: Socket Thread]: D/mtransport NrIceCtx static call to find local stun addresses
[task 2022-09-17T11:32:14.734Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Maximum message size (outgoing data): 2147483637 (set=no, enforced=yes)
[task 2022-09-17T11:32:14.735Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Calling usrsctp_init 11b5aeb40
[task 2022-09-17T11:32:14.735Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Registering connection 11aaf8e00 as ulp 1
[task 2022-09-17T11:32:14.736Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Setting number of SCTP streams to 256, was 10/2048
[task 2022-09-17T11:32:14.736Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel DC Open: label dummy/, type 0, inorder 1, prValue 0, listener 0, context 0, external: true, stream 0
[task 2022-09-17T11:32:14.737Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Inserting channel 0 : 11a376010
[task 2022-09-17T11:32:14.737Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Queuing channel 11a376010 (0) to finish open
[task 2022-09-17T11:32:14.738Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Init: origin = http://web-platform.test:8000
[task 2022-09-17T11:32:14.738Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: D/DataChannel Registered 1 within the SCTP stack.
[task 2022-09-17T11:32:14.739Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Maximum message size (outgoing data): 2147483637 (set=no, enforced=yes)
[task 2022-09-17T11:32:14.739Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Registering connection 11aaf9a00 as ulp 2
[task 2022-09-17T11:32:14.740Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Setting number of SCTP streams to 256, was 10/2048
[task 2022-09-17T11:32:14.741Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel DC Open: label dummy/, type 0, inorder 1, prValue 0, listener 0, context 0, external: true, stream 0
[task 2022-09-17T11:32:14.741Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Inserting channel 0 : 11a376230
[task 2022-09-17T11:32:14.742Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Queuing channel 11a376230 (0) to finish open
[task 2022-09-17T11:32:14.743Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: D/DataChannel Registered 2 within the SCTP stack.
[task 2022-09-17T11:32:14.743Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: D/DataChannel Init: origin = http://web-platform.test:8000
[task 2022-09-17T11:32:14.744Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:3301: OnStunAddrsAvailable: receiving (12) stun addrs
[task 2022-09-17T11:32:14.744Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: I/mtransport NrIceCtx(PC:{7a506260-757e-4255-a70d-9e2fa7b795d0} 1663414334730876 (id=10737418249 url=http://web-platform.test:8000/webrtc-stats/supporte): SetStunServers
[task 2022-09-17T11:32:14.745Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: I/mtransport NrIceCtx(PC:{7a506260-757e-4255-a70d-9e2fa7b795d0} 1663414334730876 (id=10737418249 url=http://web-platform.test:8000/webrtc-stats/supporte): SetTurnServers
[task 2022-09-17T11:32:14.746Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:3301: OnStunAddrsAvailable: receiving (12) stun addrs
[task 2022-09-17T11:32:14.746Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: I/mtransport NrIceCtx(PC:{ef37cd5c-233f-4adb-9391-7677e9b02987} 1663414334732169 (id=10737418249 url=http://web-platform.test:8000/webrtc-stats/supporte): SetStunServers
[task 2022-09-17T11:32:14.747Z] 11:32:14     INFO - PID 3316 | [Child 3334: Socket Thread]: I/mtransport NrIceCtx(PC:{ef37cd5c-233f-4adb-9391-7677e9b02987} 1663414334732169 (id=10737418249 url=http://web-platform.test:8000/webrtc-stats/supporte): SetTurnServers
[task 2022-09-17T11:32:14.748Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/signaling [main|sdp_config] sdp_config.c:86: SDP: Initialized config pointer: 10251fba0
[task 2022-09-17T11:32:14.748Z] 11:32:14     INFO - PID 3316 | [Child 3334: Main Thread]: I/jsep [{7a506260-757e-4255-a70d-9e2fa7b795d0} 1663414334730876 (id=10737418249 url=http://web-platform.test:8000/webrtc-stats/supporte]: stable -> have-local-offer
[task 2022-09-17T11:32:14.749Z] 11:32:14     INFO - PID 3316 | (generic/INFO) Exit UDP socket connected

[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's remoteId 
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's framesDecoded 
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-FAIL | /webrtc-stats/supported-stats.html | inbound-rtp's keyFramesDecoded - assert_true: Is keyFramesDecoded present expected true got false
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - @http://web-platform.test:8000/webrtc-stats/supported-stats.html:159:20
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2590:25
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - test@http://web-platform.test:8000/resources/testharness.js:628:30
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - @http://web-platform.test:8000/webrtc-stats/supported-stats.html:158:11
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's frameWidth 
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's frameHeight 
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's framesPerSecond 
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-UNEXPECTED-PASS | /webrtc-stats/supported-stats.html | inbound-rtp's qpSum - expected FAIL
[task 2022-09-17T11:32:18.170Z] 11:32:18     INFO - TEST-INFO | expected FAIL
[task 2022-09-17T11:32:18.281Z] 11:32:18     INFO - .................................................................................................................................................................................................................
[task 2022-09-17T11:32:18.281Z] 11:32:18     INFO - TEST-OK | /webrtc-stats/supported-stats.html | took 3908ms

Hi Nico, I believe this is a regression of bug 1790508, can you please take a look?
Thank you!

Flags: needinfo?(na-g)

Linux has the expected fail, only the other operating systems show the unexpected passes.

tracking-firefox107: ? → +

Michael, could you check what explains the different behavior and what is needed here?

Flags: needinfo?(mfroman)

Sebastian, qpSum is only implemented for H264 video. I believe that the failure on exactly Linux is expected, and your patch looks good, thanks.

Flags: needinfo?(na-g)
Flags: needinfo?(mfroman)
Severity: -- → S3
Pushed by archaeopteryx@coole-files.de:
https://hg.mozilla.org/integration/autoland/rev/bbf76654bc60
set webrtc-stats/supported-stats.html as passing outside Nightly on non-Linux OS DONTBUILD
Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/a18143a9423c
Update expectancy for inbound-rtp's qpSum. CLOSED TREE

https://hg.mozilla.org/mozilla-central/rev/bbf76654bc60
https://hg.mozilla.org/mozilla-central/rev/a18143a9423c

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox107: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 107 Branch
Assignee: nobody → aryx.bugmail

Verified fixed in today's central as beta simulation

Status: RESOLVED → VERIFIED
status-firefox107: fixed → verified
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: