Closed Bug 1814244 Opened 1 year ago Closed 1 year ago

Intermittent TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpSender-replaceTrack.https.html | single tracking bug

Categories

(Core :: WebRTC, defect, P5)

Product:
Core
Component:
WebRTC
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox109 --- unaffected
firefox110 --- unaffected
firefox111 --- wontfix

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=404111437&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HXZVKHcURRC1zHLoc-Bc5g/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HXZVKHcURRC1zHLoc-Bc5g/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2023-01-31T18:58:22.708Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default): no FROZEN/WAITING pairs for PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r transport-id=transport_0 - a6ed61ec:60f2eb814f037b5674940cc31e8ad0d8
[task 2023-01-31T18:58:22.709Z] 18:58:22     INFO - PID 2375 | Exiting due to channel error.
[task 2023-01-31T18:58:22.709Z] 18:58:22     INFO - PID 2375 | Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: Receive IPC close with reason=AbnormalShutdown (t=3.82687) Exiting due to channel error.
[task 2023-01-31T18:58:22.710Z] 18:58:22     INFO - PID 2375 | Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: Receive IPC close with reason=AbnormalShutdown (t=1.83088) Exiting due to channel error.
[task 2023-01-31T18:58:22.711Z] 18:58:22     INFO - PID 2375 | Exiting due to channel error.
[task 2023-01-31T18:58:22.712Z] 18:58:22     INFO - PID 2375 | Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: Receive IPC close with reason=AbnormalShutdown (t=14.0247) Exiting due to channel error.
[task 2023-01-31T18:58:22.713Z] 18:58:22     INFO - IOError on command, setting status to CRASH
[task 2023-01-31T18:58:22.714Z] 18:58:22     INFO - TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpSender-replaceTrack.https.html | expected OK
[task 2023-01-31T18:58:22.714Z] 18:58:22     INFO - TEST-INFO took 2659ms
[task 2023-01-31T18:58:22.714Z] 18:58:22     INFO - No more tests
[task 2023-01-31T18:58:22.716Z] 18:58:22     INFO - PID 2375 | Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: Receive IPC close with reason=AbnormalShutdown (t=5.28154) Exiting due to channel error.
[task 2023-01-31T18:58:22.717Z] 18:58:22     INFO - PID 2375 | Exiting due to channel error.
[task 2023-01-31T18:58:22.734Z] 18:58:22     INFO - PID 2375 | [Child 2551: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2943: Passing local candidate to content: candidate:0 1 UDP 2122187007 172.17.0.4 43857 typ host
[task 2023-01-31T18:58:22.744Z] 18:58:22     INFO - PID 2375 | [Child 2551: Socket Thread]: I/mtransport NrIceCtx(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r)/STREAM(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r transport-id=transport_0) : parsing trickle candidate candidate:0 1 UDP 2122187007 172.17.0.4 43857 typ host
[task 2023-01-31T18:58:22.744Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default)/CAND-PAIR(kMas): setting pair to state FROZEN: kMas|IP4:172.17.0.4:46289/UDP|IP4:172.17.0.4:43857/UDP(host(IP4:172.17.0.4:46289/UDP)|candidate:0 1 UDP 2122187007 172.17.0.4 43857 typ host)
[task 2023-01-31T18:58:22.744Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r)/CAND-PAIR(kMas): Pairing candidate IP4:172.17.0.4:46289/UDP (7e7e00ff):IP4:172.17.0.4:43857/UDP (7e7e00ff) priority=9114723795305497087 (7e7e00fffcfc01ff)
[task 2023-01-31T18:58:22.744Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default)/ICE-STREAM(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r transport-id=transport_0 - a6ed61ec:60f2eb814f037b5674940cc31e8ad0d8): Starting check timer for stream.
[task 2023-01-31T18:58:22.744Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default)/CAND-PAIR(kMas): setting pair to state WAITING: kMas|IP4:172.17.0.4:46289/UDP|IP4:172.17.0.4:43857/UDP(host(IP4:172.17.0.4:46289/UDP)|candidate:0 1 UDP 2122187007 172.17.0.4 43857 typ host)
[task 2023-01-31T18:58:22.745Z] 18:58:22     INFO - PID 2375 | (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default)/CAND-PAIR(kMas): setting pair to state IN_PROGRESS: kMas|IP4:172.17.0.4:46289/UDP|IP4:172.17.0.4:43857/UDP(host(IP4:172.17.0.4:46289/UDP)|candidate:0 1 UDP 2122187007 172.17.0.4 43857 typ host)
[task 2023-01-31T18:58:22.745Z] 18:58:22     INFO - PID 2375 | [Child 2551: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2943: Passing local candidate to content: candidate:1 1 UDP 2122252543 fd15:4ba5:5a2b:100a:0:242:ac11:4 54912 typ host
[task 2023-01-31T18:58:22.746Z] 18:58:22     INFO - PID 2375 | [Child 2551: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2943: Passing local candidate to content: candidate:2 1 TCP 2105458943 172.17.0.4 9 typ host tcptype active
[task 2023-01-31T18:58:22.746Z] 18:58:22     INFO - PID 2375 | [Child 2551: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2943: Passing local candidate to content: candidate:3 1 TCP 2105524479 fd15:4ba5:5a2b:100a:0:242:ac11:4 9 typ host tcptype active
[task 2023-01-31T18:58:22.747Z] 18:58:22     INFO - PID 2375 | [Child 2551: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2943: Passing local candidate to content:
[task 2023-01-31T18:58:22.758Z] 18:58:22     INFO - PID 2375 | Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: Receive IPC close with reason=AbnormalShutdown (t=3.95672) (ice/INFO) ICE-PEER(PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r:default): no FROZEN/WAITING pairs for PC:{50ec8688-ba10-4614-9a6d-cc7c70cc32d6} 1675191502374667 (id=8589934598 url=https://web-platform.test:8443/webrtc/RTCRtpSender-r transport-id=transport_0 - a6ed61ec:60f2eb814f037b5674940cc31e8ad0d8
[task 2023-01-31T18:58:23.723Z] 18:58:23     INFO - Browser exited with return code -6
[task 2023-01-31T18:58:23.725Z] 18:58:23     INFO - Closing logging queue
[task 2023-01-31T18:58:23.725Z] 18:58:23     INFO - queue closed
[task 2023-01-31T18:58:23.731Z] 18:58:23     INFO - SUITE-END | took 21s
[task 2023-01-31T18:58:23.731Z] 18:58:23     INFO - Got 1 unexpected results, with 0 unexpected passes
[task 2023-01-31T18:58:23.732Z] 18:58:23     INFO - Repetition 3 / 5
[task 2023-01-31T18:58:23.733Z] 18:58:23     INFO - SUITE-START | Running 1 tests
[task 2023-01-31T18:58:23.745Z] 18:58:23     INFO - Setting up ssl
[task 2023-01-31T18:58:23.789Z] 18:58:23     INFO - certutil | b''
[task 2023-01-31T18:58:23.839Z] 18:58:23     INFO - certutil | b''
[task 2023-01-31T18:58:23.871Z] 18:58:23     INFO - certutil | b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
[task 2023-01-31T18:58:23.874Z] 18:58:23     INFO - INFO | runtests.py | TSan using symbolizer at /builds/worker/workspace/build/application/firefox/llvm-symbolizer
[task 2023-01-31T18:58:23.875Z] 18:58:23     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpvqv4gsto
[task 2023-01-31T18:58:23.880Z] 18:58:23     INFO - Starting runner
[task 2023-01-31T18:58:26.720Z] 18:58:26     INFO - PID 2665 | 1675191506719	Marionette	INFO	Marionette enabled
[task 2023-01-31T18:58:26.737Z] 18:58:26     INFO - PID 2665 | 1675191506736	Marionette	INFO	Listening on port 50827
[task 2023-01-31T18:58:34.887Z] 18:58:34     INFO - PID 2665 | console.error: ({})
[task 2023-01-31T18:58:35.166Z] 18:58:35     INFO - PID 2665 | console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /tmp/tmpvqv4gsto/search.json.mozlz4", (void 0)))
[task 2023-01-31T18:58:35.298Z] 18:58:35     INFO - PID 2665 | console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.jsm", 407))
[task 2023-01-31T18:58:39.709Z] 18:58:39     INFO - PID 2665 | console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.jsm", 407))
[task 2023-01-31T18:58:39.710Z] 18:58:39     INFO - PID 2665 | console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.jsm", 407))
[task 2023-01-31T18:58:39.712Z] 18:58:39     INFO - PID 2665 | console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.jsm", 407))
[task 2023-01-31T18:58:41.347Z] 18:58:41     INFO - TEST-START | /webrtc/RTCRtpSender-replaceTrack.https.html

Once again, it is impossible to tell whether this was a pre-existing problem. See https://bugzilla.mozilla.org/show_bug.cgi?id=1811948#c10

See Also: → 1811948

Set release status flags based on info from the regressing bug 1812293

status-firefox109: --- → unaffected
status-firefox110: --- → unaffected
status-firefox111: --- → affected
status-firefox-esr102: --- → unaffected

Whoops, got the platform wrong on that push. Here's another one:

https://treeherder.mozilla.org/jobs?repo=try&revision=d5108dfd2f777dfdf4b157f988a7ab0ecc5592b5

Not having any luck reproducing on the base revision, but it looks like it is extremely rare. Let's see if I can reproduce with the patches on bug 1812293:

https://treeherder.mozilla.org/jobs?repo=try&revision=5b90b81708917c8d7855e43640b9a788ce39d61c

Check back on retriggers.

Yeah, unable to get this to happen with or without the patches. We don't really know when this started happening.

Keywords: regression
No longer regressed by: 1812293

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox111: affected → wontfix
Resolution: --- → INCOMPLETE

This is happening again, this time is a tier 1 failure: https://treeherder.mozilla.org/logviewer?job_id=412396051&repo=autoland&lineNumber=105908

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Summary: Intermittent [tier 2] TVw TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpSender-replaceTrack.https.html | single tracking bug → Intermittent TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpSender-replaceTrack.https.html | single tracking bug

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 1 year ago → 1 year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.