Intermittent gtest | application crashed [@ webrtc::webrtc_repeating_task_impl::RepeatingTaskImpl<`lambda at /builds/worker/checkouts/gecko/third_party/libwebrtc/call/rtp_transport_controller_send.cc:614:55'>::RunClosure()]
Categories
(Core :: WebRTC, defect)
Tracking
()
People
(Reporter: intermittent-bug-filer, Unassigned)
References
Details
(4 keywords)
Crash Data
Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=359289174&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S0RXcJp1SZevPk1gle00pw/runs/0/artifacts/public/logs/live_backing.log
[task 2021-11-25T23:02:40.676Z] 23:02:40 WARNING - PROCESS-CRASH | gtest | application crashed [@ webrtc::webrtc_repeating_task_impl::RepeatingTaskImpl<`lambda at /builds/worker/checkouts/gecko/third_party/libwebrtc/call/rtp_transport_controller_send.cc:614:55'>::RunClosure()]
[task 2021-11-25T23:02:40.676Z] 23:02:40 INFO - Crash dump filename: Z:\task_163788003574684\build\tests\gtest\2ab0aea2-b707-402a-b693-95733545e039.dmp
[task 2021-11-25T23:02:40.676Z] 23:02:40 INFO - Operating system: Windows NT
[task 2021-11-25T23:02:40.677Z] 23:02:40 INFO - 10.0.19041
[task 2021-11-25T23:02:40.677Z] 23:02:40 INFO - CPU: x86
[task 2021-11-25T23:02:40.677Z] 23:02:40 INFO - GenuineIntel family 6 model 85 stepping 4
[task 2021-11-25T23:02:40.677Z] 23:02:40 INFO - 8 CPUs
[task 2021-11-25T23:02:40.677Z] 23:02:40 INFO - Crash reason: EXCEPTION_ACCESS_VIOLATION_READ
[task 2021-11-25T23:02:40.678Z] 23:02:40 INFO - Crash address: 0xffffffffe5e5e5e5
[task 2021-11-25T23:02:40.678Z] 23:02:40 INFO - Process uptime: 460 seconds
[task 2021-11-25T23:02:40.678Z] 23:02:40 INFO - Thread 64 WebrtcWorker #2 (crashed)
[task 2021-11-25T23:02:40.678Z] 23:02:40 INFO - 0 xul.dll!webrtc::webrtc_repeating_task_impl::RepeatingTaskImpl<`lambda at /builds/worker/checkouts/gecko/third_party/libwebrtc/call/rtp_transport_controller_send.cc:614:55'>::RunClosure() [repeating_task.h:0ede5360576f894d339e07c030964b1d3a3da636 : 68 + 0x3d]
[task 2021-11-25T23:02:40.679Z] 23:02:40 INFO - eip = 0x6b9fe59d esp = 0x16d1ef88 ebp = 0x16d1f03c ebx = 0x6b9fe560
[task 2021-11-25T23:02:40.679Z] 23:02:40 INFO - esi = 0x04bf6d00 edi = 0xe5e5e5e5 eax = 0xe5e5e5e5 ecx = 0x11040ec0
[task 2021-11-25T23:02:40.680Z] 23:02:40 INFO - edx = 0x00001000 efl = 0x00010282
[task 2021-11-25T23:02:40.680Z] 23:02:40 INFO - Found by: given as instruction pointer in context
[task 2021-11-25T23:02:40.680Z] 23:02:40 INFO - 1 xul.dll!webrtc::webrtc_repeating_task_impl::RepeatingTaskBase::Run() [repeating_task.cc:0ede5360576f894d339e07c030964b1d3a3da636 : 36 + 0x14]
[task 2021-11-25T23:02:40.680Z] 23:02:40 INFO - eip = 0x6bb72cf8 esp = 0x16d1f044 ebp = 0x16d1f098 ebx = 0x6b9fe560
[task 2021-11-25T23:02:40.681Z] 23:02:40 INFO - esi = 0x16d1f048 edi = 0x11040ec0
[task 2021-11-25T23:02:40.681Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.681Z] 23:02:40 INFO - 2 xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/dom/media/webrtc/libwebrtcglue/TaskQueueWrapper.h:72:35'>::Run() [nsThreadUtils.h:0ede5360576f894d339e07c030964b1d3a3da636 : 531 + 0x29]
[task 2021-11-25T23:02:40.683Z] 23:02:40 INFO - eip = 0x6812c3e6 esp = 0x16d1f0a0 ebp = 0x16d1f0b4 ebx = 0x6bb72cb0
[task 2021-11-25T23:02:40.683Z] 23:02:40 INFO - esi = 0x110d0c18 edi = 0x11040ec0
[task 2021-11-25T23:02:40.684Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.684Z] 23:02:40 INFO - 3 xul.dll!mozilla::DelayedRunnable::Notify(nsITimer*) [DelayedRunnable.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 63 + 0x17]
[task 2021-11-25T23:02:40.684Z] 23:02:40 INFO - eip = 0x68aeb223 esp = 0x16d1f0bc ebp = 0x16d1f0d0 ebx = 0x11018160
[task 2021-11-25T23:02:40.684Z] 23:02:40 INFO - esi = 0x0f0f73f4 edi = 0x111e2f40
[task 2021-11-25T23:02:40.685Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.685Z] 23:02:40 INFO - 4 xul.dll!nsTimerImpl::Fire(int) [nsTimerImpl.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 652 + 0x6c]
[task 2021-11-25T23:02:40.685Z] 23:02:40 INFO - eip = 0x68b0fca5 esp = 0x16d1f0d8 ebp = 0x16d1f244 ebx = 0x00000001
[task 2021-11-25T23:02:40.685Z] 23:02:40 INFO - esi = 0x0f3a2a20 edi = 0x0f3a2a5c
[task 2021-11-25T23:02:40.685Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.687Z] 23:02:40 INFO - 5 xul.dll!nsTimerEvent::Run() [TimerThread.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 265 + 0x7]
[task 2021-11-25T23:02:40.687Z] 23:02:40 INFO - eip = 0x68af7f1a esp = 0x16d1f24c ebp = 0x16d1f36c ebx = 0x00000000
[task 2021-11-25T23:02:40.687Z] 23:02:40 INFO - esi = 0x16d1f384 edi = 0x111286d0
[task 2021-11-25T23:02:40.688Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.688Z] 23:02:40 INFO - 6 xul.dll!mozilla::TaskQueue::Runner::Run() [TaskQueue.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 208 + 0xd]
[task 2021-11-25T23:02:40.689Z] 23:02:40 INFO - eip = 0x68af5603 esp = 0x16d1f374 ebp = 0x16d1f3b4 ebx = 0x00000000
[task 2021-11-25T23:02:40.689Z] 23:02:40 INFO - esi = 0x16d1f384 edi = 0x111286d0
[task 2021-11-25T23:02:40.689Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.689Z] 23:02:40 INFO - 7 xul.dll!nsThreadPool::Run() [nsThreadPool.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 305 + 0xd]
[task 2021-11-25T23:02:40.691Z] 23:02:40 INFO - eip = 0x68b03d69 esp = 0x16d1f3bc ebp = 0x16d1f514 ebx = 0x00000000
[task 2021-11-25T23:02:40.691Z] 23:02:40 INFO - esi = 0x16d1f490 edi = 0x0bf828e0
[task 2021-11-25T23:02:40.691Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.692Z] 23:02:40 INFO - 8 xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 1177 + 0xd]
[task 2021-11-25T23:02:40.692Z] 23:02:40 INFO - eip = 0x68afe837 esp = 0x16d1f51c ebp = 0x16d1f654 ebx = 0x1113da80
[task 2021-11-25T23:02:40.693Z] 23:02:40 INFO - esi = 0x0bf806d0 edi = 0x16d1f5d0
[task 2021-11-25T23:02:40.693Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.693Z] 23:02:40 INFO - 9 xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 467 + 0x18]
[task 2021-11-25T23:02:40.693Z] 23:02:40 INFO - eip = 0x68b02a7f esp = 0x16d1f65c ebp = 0x16d1f678 ebx = 0x68ff7000
[task 2021-11-25T23:02:40.694Z] 23:02:40 INFO - esi = 0x0bf806d0 edi = 0x16d1f714
[task 2021-11-25T23:02:40.694Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.695Z] 23:02:40 INFO - 10 xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 300 + 0x9]
[task 2021-11-25T23:02:40.695Z] 23:02:40 INFO - eip = 0x69030d51 esp = 0x16d1f680 ebp = 0x16d1f6a8 ebx = 0x68ff7090
[task 2021-11-25T23:02:40.695Z] 23:02:40 INFO - esi = 0x1117b550 edi = 0x16d1f714
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - 11 xul.dll!MessageLoop::RunHandler() [message_loop.cc:0ede5360576f894d339e07c030964b1d3a3da636 : 324 + 0x13]
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - eip = 0x68ff67e9 esp = 0x16d1f6b0 ebp = 0x16d1f6e0 ebx = 0x69030c90
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - esi = 0x16d1f714 edi = 0x1117b550
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - 12 xul.dll!MessageLoop::Run() [message_loop.cc:0ede5360576f894d339e07c030964b1d3a3da636 : 306 + 0x4]
[task 2021-11-25T23:02:40.697Z] 23:02:40 INFO - eip = 0x68ff6748 esp = 0x16d1f6e8 ebp = 0x16d1f700 ebx = 0x16d1f714
[task 2021-11-25T23:02:40.699Z] 23:02:40 INFO - esi = 0x110dc7d0 edi = 0x0bf806d0
[task 2021-11-25T23:02:40.701Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.701Z] 23:02:40 INFO - 13 xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 391 + 0x6]
[task 2021-11-25T23:02:40.701Z] 23:02:40 INFO - eip = 0x68afc3b4 esp = 0x16d1f708 ebp = 0x16d1f7e4 ebx = 0x16d1f714
[task 2021-11-25T23:02:40.701Z] 23:02:40 INFO - esi = 0x110dc7d0 edi = 0x0bf806d0
[task 2021-11-25T23:02:40.701Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.702Z] 23:02:40 INFO - 14 nss3.dll!_PR_NativeRunThread(void*) [pruthr.c:0ede5360576f894d339e07c030964b1d3a3da636 : 399 + 0xe]
[task 2021-11-25T23:02:40.702Z] 23:02:40 INFO - eip = 0x7212f605 esp = 0x16d1f7ec ebp = 0x16d1f80c ebx = 0x067d21f0
[task 2021-11-25T23:02:40.702Z] 23:02:40 INFO - esi = 0x110dc7d0 edi = 0x0bf80820
[task 2021-11-25T23:02:40.702Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.703Z] 23:02:40 INFO - 15 nss3.dll!pr_root(void*) [w95thred.c:0ede5360576f894d339e07c030964b1d3a3da636 : 139 + 0xe]
[task 2021-11-25T23:02:40.703Z] 23:02:40 INFO - eip = 0x721227b6 esp = 0x16d1f814 ebp = 0x16d1f81c ebx = 0x048caee0
[task 2021-11-25T23:02:40.703Z] 23:02:40 INFO - esi = 0x0bf80820 edi = 0x048caee0
[task 2021-11-25T23:02:40.703Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.704Z] 23:02:40 INFO - 16 ucrtbase.dll!thread_start<unsigned int (__stdcall*)(void *),1> + 0x3e
[task 2021-11-25T23:02:40.704Z] 23:02:40 INFO - eip = 0x75d04f9f esp = 0x16d1f824 ebp = 0x16d1f854 ebx = 0x048caee0
[task 2021-11-25T23:02:40.704Z] 23:02:40 INFO - esi = 0x721227a0 edi = 0x048caee0
[task 2021-11-25T23:02:40.704Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.704Z] 23:02:40 INFO - 17 kernel32.dll!BaseThreadInitThunk + 0x18
[task 2021-11-25T23:02:40.705Z] 23:02:40 INFO - eip = 0x7696fa29 esp = 0x16d1f85c ebp = 0x16d1f864 ebx = 0x048caee0
[task 2021-11-25T23:02:40.705Z] 23:02:40 INFO - esi = 0x721227a0 edi = 0x048caee0
[task 2021-11-25T23:02:40.705Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.705Z] 23:02:40 INFO - 18 mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:0ede5360576f894d339e07c030964b1d3a3da636 : 574 + 0xa]
[task 2021-11-25T23:02:40.706Z] 23:02:40 INFO - eip = 0x72725628 esp = 0x16d1f86c ebp = 0x16d1f8a0 ebx = 0x048caee0
[task 2021-11-25T23:02:40.706Z] 23:02:40 INFO - esi = 0x721227a0 edi = 0x048caee0
[task 2021-11-25T23:02:40.706Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.706Z] 23:02:40 INFO - 19 ntdll.dll!_RtlUserThreadStart + 0x2e
[task 2021-11-25T23:02:40.706Z] 23:02:40 INFO - eip = 0x77c17a9e esp = 0x16d1f8a8 ebp = 0x16d1f8fc ebx = 0x048caee0
[task 2021-11-25T23:02:40.707Z] 23:02:40 INFO - esi = 0x7696fa10 edi = 0x75d04f60
[task 2021-11-25T23:02:40.707Z] 23:02:40 INFO - Found by: call frame info
[task 2021-11-25T23:02:40.707Z] 23:02:40 INFO - 20 ntdll.dll!_RtlUserThreadStart + 0x1a
[task 2021-11-25T23:02:40.707Z] 23:02:40 INFO - eip = 0x77c17a6e esp = 0x16d1f904 ebp = 0x16d1f90c ebx = 0x048caee0
[task 2021-11-25T23:02:40.707Z] 23:02:40 INFO - esi = 0x7696fa10 edi = 0x75d04f60
[task 2021-11-25T23:02:40.708Z] 23:02:40 INFO - Found by: call frame info
Updated•3 years ago
|
Updated•3 years ago
|
![]() |
||
Updated•3 years ago
|
![]() |
||
Comment 1•3 years ago
|
||
We believe this was fixed through follow up work related to the webrtc lib update. Andreas will add a see also.
Comment 2•3 years ago
|
||
This looks like bug 1741118 in that the crashing thread is running a task that is accessing a destroyed object because the thread that destroyed this object should have been blocked until the crashing thread had been drained and shut down.
Bug 1741118 fixed the sec issue, although bug 1748333 is a remaining issue in this space (would cause a deadlock, perhaps a shutdown hang, but no sec issue).
![]() |
||
Updated•3 years ago
|
Updated•3 years ago
|
Updated•2 years ago
|
Description
•