Open Bug 2005868 Opened 11 months ago Updated 6 days ago

Frequent SUMMARY: ThreadSanitizer: SEGV /builds/worker/workspace/obj-build/dist/include/mozilla/Assertions.h:237:3 in MOZ_CrashSequence

Categories

(Core :: Audio/Video, defect, P5)

Product:
Core
Component:
Audio/Video
Type:
defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

References

Details

(Keywords: intermittent-failure)

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=539861749&repo=autoland&task=RVlFhgNUSb6fBaP2lFyQuQ.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RVlFhgNUSb6fBaP2lFyQuQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/default/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RVlFhgNUSb6fBaP2lFyQuQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

REFTEST TEST-PASS | layout/base/crashtests/378682.html | (LOAD ONLY)
[task 2025-12-13T05:17:11.767+00:00] 05:17:11     INFO - REFTEST TEST-END | layout/base/crashtests/378682.html
[task 2025-12-13T05:17:11.787+00:00] 05:17:11     INFO - ThreadSanitizer:DEADLYSIGNAL
[task 2025-12-13T05:17:11.787+00:00] 05:17:11     INFO - ==1753==ERROR: ThreadSanitizer: SEGV on unknown address 0x000000000000 (pc 0x7fec7ab50b18 bp 0x000000000003 sp 0x7ffd9f83a780 T1753)
[task 2025-12-13T05:17:11.788+00:00] 05:17:11     INFO - ==1753==The signal is caused by a WRITE memory access.
[task 2025-12-13T05:17:11.788+00:00] 05:17:11     INFO - ==1753==Hint: address points to the zero page.
[task 2025-12-13T05:17:12.430+00:00] 05:17:12     INFO -     #0 MOZ_CrashSequence /builds/worker/workspace/obj-build/dist/include/mozilla/Assertions.h:237:3 (libxul.so+0x8d50b18) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.431+00:00] 05:17:12     INFO -     #1 mozilla::dom::ContentChild::ProcessingError(mozilla::ipc::HasResultCodes::Result, char const*) /builds/worker/checkouts/gecko/dom/ipc/ContentChild.cpp:2323:3 (libxul.so+0x8d50b18)
[task 2025-12-13T05:17:12.431+00:00] 05:17:12     INFO -     #2 mozilla::ipc::IPCResult::FailImpl(mozilla::NotNull<mozilla::ipc::IProtocol*>, char const*, char const*) /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:61:39 (libxul.so+0x47e7f3f) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.432+00:00] 05:17:12     INFO -     #3 Fail<21UL, 26UL> /builds/worker/workspace/obj-build/dist/include/mozilla/ipc/ProtocolUtils.h:375:12 (libxul.so+0x8d4fc23) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.433+00:00] 05:17:12     INFO -     #4 mozilla::dom::ContentChild::RecvConstructBrowser(mozilla::ipc::ManagedEndpoint<mozilla::dom::PBrowserChild>&&, mozilla::ipc::ManagedEndpoint<mozilla::dom::PWindowGlobalChild>&&, mozilla::dom::IdType<mozilla::dom::BrowserParent> const&, mozilla::dom::IPCTabContext const&, mozilla::dom::WindowGlobalInit const&, unsigned int const&, mozilla::dom::IdType<mozilla::dom::ContentParent> const&, bool const&, bool const&) /builds/worker/checkouts/gecko/dom/ipc/ContentChild.cpp:1974:14 (libxul.so+0x8d4fc23)
[task 2025-12-13T05:17:12.434+00:00] 05:17:12     INFO -     #5 mozilla::dom::PContentChild::OnMessageReceived(IPC::Message const&) /builds/worker/workspace/obj-build/ipc/ipdl/PContentChild.cpp:8609:80 (libxul.so+0x8ecc39e) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.434+00:00] 05:17:12     INFO -     #6 mozilla::dom::ContentChild::OnMessageReceived(IPC::Message const&) /builds/worker/checkouts/gecko/dom/ipc/ContentChild.cpp:3702:25 (libxul.so+0x8d56ca0) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.435+00:00] 05:17:12     INFO -     #7 mozilla::ipc::MessageChannel::DispatchAsyncMessage(mozilla::ipc::ActorLifecycleProxy*, IPC::Message const&) /builds/worker/checkouts/gecko/ipc/glue/MessageChannel.cpp:1793:25 (libxul.so+0x47d99dd) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.436+00:00] 05:17:12     INFO -     #8 mozilla::ipc::MessageChannel::DispatchMessage(mozilla::ipc::ActorLifecycleProxy*, std::unique_ptr<IPC::Message, std::default_delete<IPC::Message>>) /builds/worker/checkouts/gecko/ipc/glue/MessageChannel.cpp:1719:9 (libxul.so+0x47d818b) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.437+00:00] 05:17:12     INFO -     #9 mozilla::ipc::MessageChannel::RunMessage(mozilla::ipc::ActorLifecycleProxy*, mozilla::ipc::MessageChannel::MessageTask&) /builds/worker/checkouts/gecko/ipc/glue/MessageChannel.cpp:1508:3 (libxul.so+0x47d87bf) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.437+00:00] 05:17:12     INFO -     #10 mozilla::ipc::MessageChannel::MessageTask::Run() /builds/worker/checkouts/gecko/ipc/glue/MessageChannel.cpp:1610:14 (libxul.so+0x47d91c7) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.438+00:00] 05:17:12     INFO -     #11 mozilla::RunnableTask::Run() /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:705:16 (libxul.so+0x3bfcfd2) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.438+00:00] 05:17:12     INFO -     #12 mozilla::TaskController::RunTask(mozilla::Task*) /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:196:19 (libxul.so+0x3bf3ae3) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.439+00:00] 05:17:12     INFO -     #13 mozilla::TaskController::DoExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex&> const&) /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:1325:20 (libxul.so+0x3bf7bbe) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.440+00:00] 05:17:12     INFO -     #14 mozilla::TaskController::ExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex&> const&) /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:1148:15 (libxul.so+0x3bf6796) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.440+00:00] 05:17:12     INFO -     #15 mozilla::TaskController::ProcessPendingMTTask(bool) /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:641:36 (libxul.so+0x3bf6acf) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.441+00:00] 05:17:12     INFO -     #16 operator() /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:333:37 (libxul.so+0x3c03994) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.441+00:00] 05:17:12     INFO -     #17 mozilla::detail::RunnableFunction<mozilla::TaskController::TaskController()::$_0>::Run() /builds/worker/checkouts/gecko/xpcom/threads/nsThreadUtils.h:549:5 (libxul.so+0x3c03994)
[task 2025-12-13T05:17:12.442+00:00] 05:17:12     INFO -     #18 nsThread::ProcessNextEvent(bool, bool*) /builds/worker/checkouts/gecko/xpcom/threads/nsThread.cpp:1164:16 (libxul.so+0x3c1704a) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.443+00:00] 05:17:12     INFO -     #19 NS_ProcessNextEvent(nsIThread*, bool) /builds/worker/checkouts/gecko/xpcom/threads/nsThreadUtils.cpp:461:10 (libxul.so+0x3c1d754) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.443+00:00] 05:17:12     INFO -     #20 mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate*) /builds/worker/checkouts/gecko/ipc/glue/MessagePump.cpp:85:21 (libxul.so+0x47ddcac) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.444+00:00] 05:17:12     INFO -     #21 mozilla::ipc::MessagePumpForChildProcess::Run(base::MessagePump::Delegate*) /builds/worker/checkouts/gecko/ipc/glue/MessagePump.cpp:267:30 (libxul.so+0x47de4ab) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.444+00:00] 05:17:12     INFO -     #22 RunInternal /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:368:10 (libxul.so+0x4758558) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.445+00:00] 05:17:12     INFO -     #23 RunHandler /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:361:3 (libxul.so+0x4758558)
[task 2025-12-13T05:17:12.445+00:00] 05:17:12     INFO -     #24 MessageLoop::Run() /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:343:3 (libxul.so+0x4758558)
[task 2025-12-13T05:17:12.446+00:00] 05:17:12     INFO -     #25 nsBaseAppShell::Run() /builds/worker/checkouts/gecko/widget/nsBaseAppShell.cpp:152:27 (libxul.so+0x9559283) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.446+00:00] 05:17:12     INFO -     #26 nsAppShell::Run() /builds/worker/checkouts/gecko/widget/gtk/nsAppShell.cpp:555:33 (libxul.so+0x966f96a) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.447+00:00] 05:17:12     INFO -     #27 XRE_RunAppShell() /builds/worker/checkouts/gecko/toolkit/xre/nsEmbedFunctions.cpp:656:20 (libxul.so+0xa7b88df) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.447+00:00] 05:17:12     INFO -     #28 mozilla::ipc::MessagePumpForChildProcess::Run(base::MessagePump::Delegate*) /builds/worker/checkouts/gecko/ipc/glue/MessagePump.cpp:235:9 (libxul.so+0x47de45a) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.448+00:00] 05:17:12     INFO -     #29 RunInternal /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:368:10 (libxul.so+0x4758558) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.448+00:00] 05:17:12     INFO -     #30 RunHandler /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:361:3 (libxul.so+0x4758558)
[task 2025-12-13T05:17:12.449+00:00] 05:17:12     INFO -     #31 MessageLoop::Run() /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:343:3 (libxul.so+0x4758558)
[task 2025-12-13T05:17:12.449+00:00] 05:17:12     INFO -     #32 XRE_InitChildProcess(int, char**, XREChildData const*) /builds/worker/checkouts/gecko/toolkit/xre/nsEmbedFunctions.cpp:594:34 (libxul.so+0xa7b7a1d) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.450+00:00] 05:17:12     INFO -     #33 mozilla::BootstrapImpl::XRE_InitChildProcess(int, char**, XREChildData const*) /builds/worker/checkouts/gecko/toolkit/xre/Bootstrap.cpp:60:12 (libxul.so+0xa7c21f2) (BuildId: e1192aef707c0868b4f13ae08e880d60bfc711f5)
[task 2025-12-13T05:17:12.450+00:00] 05:17:12     INFO -     #34 main /builds/worker/checkouts/gecko/browser/app/nsBrowserApp.cpp:465:22 (firefox-bin+0x148b3e) (BuildId: e634f930d6c88c7ef84e4205e39260d5643aa0ad)
[task 2025-12-13T05:17:12.451+00:00] 05:17:12     INFO -     #35 __libc_start_call_main csu/../sysdeps/nptl/libc_start_call_main.h:58:16 (libc.so.6+0x2a1c9) (BuildId: 282c2c16e7b6600b0b22ea0c99010d2795752b5f)
[task 2025-12-13T05:17:12.451+00:00] 05:17:12     INFO -     #36 __libc_start_main csu/../csu/libc-start.c:360:3 (libc.so.6+0x2a28a) (BuildId: 282c2c16e7b6600b0b22ea0c99010d2795752b5f)
[task 2025-12-13T05:17:12.452+00:00] 05:17:12     INFO -     #37 _start <null> (firefox-bin+0x92aa8) (BuildId: e634f930d6c88c7ef84e4205e39260d5643aa0ad)
[task 2025-12-13T05:17:12.452+00:00] 05:17:12     INFO - ==1753==Register values:
[task 2025-12-13T05:17:12.452+00:00] 05:17:12     INFO - rax = 0x0000000000000000  rbx = 0x000056229c4ab680  rcx = 0x0000000000000913  rdx = 0x000000002a48e5ff
[task 2025-12-13T05:17:12.453+00:00] 05:17:12     INFO - rdi = 0x00007fec883ea780  rsi = 0x00001c4538956d00  rbp = 0x0000000000000003  rsp = 0x00007ffd9f83a780
[task 2025-12-13T05:17:12.453+00:00] 05:17:12     INFO -  r8 = 0x000006229c4ab680   r9 = 0x0000100000000000  r10 = 0x00007febdc2daf68  r11 = 0x000000000456cbd8
[task 2025-12-13T05:17:12.454+00:00] 05:17:12     INFO - r12 = 0x0000726000065030  r13 = 0x0000000000000000  r14 = 0x0000726400017730  r15 = 0x000072100002fb88
[task 2025-12-13T05:17:12.454+00:00] 05:17:12     INFO - ThreadSanitizer can not provide additional info.
[task 2025-12-13T05:17:12.454+00:00] 05:17:12     INFO - SUMMARY: ThreadSanitizer: SEGV /builds/worker/workspace/obj-build/dist/include/mozilla/Assertions.h:237:3 in MOZ_CrashSequence
[task 2025-12-13T05:17:12.455+00:00] 05:17:12     INFO - ==1753==ABORTING
[task 2025-12-13T05:17:12.492+00:00] 05:17:12    ERROR - A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
[task 2025-12-13T05:17:15.458+00:00] 05:17:15     INFO - 1765603035457	Marionette	TRACE	Received observer notification quit-application
[task 2025-12-13T05:17:15.459+00:00] 05:17:15     INFO - 1765603035458	Marionette	INFO	Stopped listening on port 2828
[task 2025-12-13T05:17:15.562+00:00] 05:17:15     INFO - 1765603035560	Marionette	DEBUG	Marionette stopped listening
[task 2025-12-13T05:17:15.702+00:00] 05:17:15     INFO - [Parent 1425, IPC I/O Parent] WARNING: process 1753 exited on signal 6: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/process_watcher_posix_sigchld.cc:160
[task 2025-12-13T05:17:15.759+00:00] 05:17:15     INFO - !!! error running onStopped callback: TypeError: callback is not a function
[task 2025-12-13T05:17:18.473+00:00] 05:17:18     INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/base/crashtests/378682.html (finished) | application terminated with exit code 245
Component: Reftest → DOM: Content Processes
Product: Testing → Core

The recent spike seems to be caused by https://hg.mozilla.org/integration/autoland/rev/96c5619a38c8

Flags: needinfo?(alwu)
See Also: → 2014861
Summary: Intermittent SUMMARY: ThreadSanitizer: SEGV /builds/worker/workspace/obj-build/dist/include/mozilla/Assertions.h:237:3 in MOZ_CrashSequence → Frequent SUMMARY: ThreadSanitizer: SEGV /builds/worker/workspace/obj-build/dist/include/mozilla/Assertions.h:237:3 in MOZ_CrashSequence
Regressions: 2018116
No longer regressions: 2018116

Most of these crashes are in dom/media/test/crashtests/

2017511.html and maybe a few others are most frequent. It looks like recent bugs are causing spike?

Component: DOM: Content Processes → Audio/Video

padenot, as the author of bug 2017511, is there something we can do here to reduce the rate of these crashes? Maybe it is OOMy? Thanks.

Flags: needinfo?(padenot)

https://searchfox.org/firefox-main/source/dom/media/test/crashtests/2014861.html#8-26, probably a bit much. tnikkel had the right intuition here. Alastor, can you think how you can make this less expensive in terms of resources while keeping coverage? Worst case we can do a gtest to not rely on luck and force things to happen.

Flags: needinfo?(padenot)
Depends on: 2017517

The most recent crashes here are in mozilla::(anonymous namespace)::RunWatchdog(void*) /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:238:5 during shutdown, in the browser/components/contextualidentity/test/browser/ folder. So that looks a lot like the most common current issue tracked in bug 1358898.

See Also: → RunWatchdogShutdownhang
Depends on: 2046936
You need to log in before you can comment on or make changes to this bug.