Closed Bug 1834369 Opened 1 year ago Closed 11 months ago

Intermittent TVw /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | single tracking bug

Categories

(Core :: WebRTC, defect, P5)

Product:
Core
Component:
WebRTC
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
115 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox113 --- unaffected
firefox114 --- unaffected
firefox115 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: dbaker)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail)

Attachments

(1 file)

Bug 1834369 - Relax target values to improve test performance on slower machines.r?jib
48 bytes, text/x-phabricator-request
Details | Review

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=416613303&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Av6NVE13SeyiGGCg-M3dHw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Av6NVE13SeyiGGCg-M3dHw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2023-05-22T16:08:31.960Z] 16:08:31     INFO - PID 3935 | [Child 4123: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2608: Close: Closing PeerConnectionImpl {78c4353e-9a00-4d00-bb72-0c9b58d11d03}; ending call
[task 2023-05-22T16:08:31.961Z] 16:08:31     INFO - PID 3935 | [Child 4123: Main Thread]: I/jsep [{78c4353e-9a00-4d00-bb72-0c9b58d11d03} 1684771621467258 (id=6442450975 url=http://web-platform.test:8000/webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html)]: stable -> closed
[task 2023-05-22T16:08:31.973Z] 16:08:31     INFO - PID 3935 | [Child 4123: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2608: Close: Closing PeerConnectionImpl {406265c4-fe59-4658-906e-905bb5e630cb}; ending call
[task 2023-05-22T16:08:31.974Z] 16:08:31     INFO - PID 3935 | [Child 4123: Main Thread]: I/jsep [{406265c4-fe59-4658-906e-905bb5e630cb} 1684771621472991 (id=6442450975 url=http://web-platform.test:8000/webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html)]: stable -> closed
[task 2023-05-22T16:08:31.975Z] 16:08:31     INFO - PID 3935 | [Child 4123: WebrtcWorker #3]: I/signaling [WebrtcWorker #3|WebrtcVideoSessionConduit] VideoStreamFactory.cpp:188: CreateEncoderStreams Input frame 640x480, RID  scaling to 640x480
[task 2023-05-22T16:08:31.976Z] 16:08:31     INFO - PID 3935 | [Child 4123: WebrtcWorker #3]: I/signaling [WebrtcWorker #3|WebrtcVideoSessionConduit] VideoStreamFactory.cpp:209: CreateEncoderStreams Stream with RID  maxFps=60 (global max fps = 60)
[task 2023-05-22T16:08:31.991Z] 16:08:31     INFO - 
[task 2023-05-22T16:08:31.991Z] 16:08:31     INFO - TEST-PASS | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | measure raising video jitterBufferTarget to 250 
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - TEST-PASS | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | measure raising audio jitterBufferTarget to 250 
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - TEST-PASS | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | measure raising video jitterBufferTarget to 500 
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - TEST-PASS | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | measure raising audio jitterBufferTarget to 500 
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - TEST-UNEXPECTED-FAIL | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | measure lowering video jitterBufferTarget to 50 - assert_between_inclusive: video delay is within bounds expected a number greater than or equal to 35 and less than or equal to 65 but got 91.61904761904793
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - measureDelayFromStats/<@http://web-platform.test:8000/webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html:86:40
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2599:25
[task 2023-05-22T16:08:31.992Z] 16:08:31     INFO - measureDelayFromStats@http://web-platform.test:8000/webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html:86:5
[task 2023-05-22T16:08:31.993Z] 16:08:31     INFO - ...
[task 2023-05-22T16:08:31.994Z] 16:08:31     INFO - TEST-OK | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html | took 91434ms
[task 2023-05-22T16:08:32.008Z] 16:08:32     INFO - PID 3935 | 1684771712007	Marionette	INFO	Stopped listening on port 49830
[task 2023-05-22T16:08:32.955Z] 16:08:32     INFO - Browser exited with return code 0
[task 2023-05-22T16:08:32.957Z] 16:08:32     INFO - Closing logging queue
[task 2023-05-22T16:08:32.958Z] 16:08:32     INFO - queue closed
[task 2023-05-22T16:08:32.966Z] 16:08:32     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpskr45wz9
[task 2023-05-22T16:08:32.974Z] 16:08:32     INFO - Starting runner
[task 2023-05-22T16:08:32.992Z] 16:08:32     INFO - PID 4395 | *** You are running in chaos test mode. See ChaosMode.h. ***
[task 2023-05-22T16:08:33.800Z] 16:08:33     INFO - PID 4395 | ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2023-05-22T16:08:33.810Z] 16:08:33     INFO - PID 4395 | ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2023-05-22T16:08:33.842Z] 16:08:33     INFO - PID 4395 | 1684771713841	Marionette	INFO	Marionette enabled
[task 2023-05-22T16:08:33.928Z] 16:08:33     INFO - PID 4395 | 1684771713927	Marionette	INFO	Listening on port 43463
[task 2023-05-22T16:08:35.122Z] 16:08:35     INFO - PID 4395 | console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 399))
[task 2023-05-22T16:08:38.366Z] 16:08:38     INFO - PID 4395 | console.error: ({})
[task 2023-05-22T16:08:42.058Z] 16:08:42     INFO - TEST-START | /webrtc-extensions/RTCRtpReceiver-jitterBufferTarget-stats.html

:dbaker, since you are the author of the regressor, bug 1592988, could you take a look?

For more information, please visit BugBot documentation.

Flags: needinfo?(dbaker)
Assignee: nobody → dbaker
Status: NEW → ASSIGNED
Pushed by dbaker@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/b15de32be05d
Relax target values to improve test performance on slower machines.r=jib
Failed to create upstream wpt PR due to merge conflicts. This requires fixup from a wpt sync admin.

https://hg.mozilla.org/mozilla-central/rev/b15de32be05d

Status: ASSIGNED → RESOLVED
Closed: 11 months ago
status-firefox115: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 115 Branch

Set release status flags based on info from the regressing bug 1592988

status-firefox113: --- → unaffected
status-firefox114: --- → unaffected
status-firefox-esr102: --- → unaffected
Regressions: 1834531
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/40214 for changes under testing/web-platform/tests
Upstream PR merged by moz-wptsync-bot
Regressions: 1835047

My understanding is that test verify wont look at the metadata for a test. If this is true then this will continue to be an issue as something with the performance when running this test under the beta simulation fails intermittently on linux. There is hope that with some upstream libwebrtc improvements this test could pass consistently. I'm tracking to verify if this is the case here bug 1839229.

Flags: needinfo?(dbaker)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: