Intermittent application crashed [@ mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure] | single tracking bug
Categories
(Core :: XPCOM, defect)
Tracking
()
People
(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)
Details
(Keywords: crash, intermittent-failure, intermittent-testcase)
Crash Data
Attachments
(1 obsolete file)
Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=439597385&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CHrTG1jLQ02VrChZTrpI1w/runs/0/artifacts/public/logs/live_backing.log
[task 2023-12-11T10:35:12.225Z] 10:35:12 INFO - IOError on command, setting status to CRASH
[task 2023-12-11T10:35:12.225Z] 10:35:12 INFO - mozcrash Copy/paste: Z:\task_170228699674071\fetches\minidump-stackwalk\minidump-stackwalk.exe --symbols-url=https://symbols.mozilla.org/ --cyborg=C:\Users\task_170228699674071\AppData\Local\Temp\tmpsz0lfwmh\51e3316f-3652-407e-a53b-140022d0ee9e.trace C:\Users\task_170228699674071\AppData\Local\Temp\tmppa1q5jdf\minidumps\51e3316f-3652-407e-a53b-140022d0ee9e.dmp Z:\task_170228699674071\build\symbols
[task 2023-12-11T10:35:23.339Z] 10:35:23 INFO - mozcrash Saved minidump as Z:\task_170228699674071\build\blobber_upload_dir\51e3316f-3652-407e-a53b-140022d0ee9e.dmp
[task 2023-12-11T10:35:23.347Z] 10:35:23 INFO - mozcrash Saved app info as Z:\task_170228699674071\build\blobber_upload_dir\51e3316f-3652-407e-a53b-140022d0ee9e.extra
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - PROCESS-CRASH | application crashed [@ mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure] | /editing/crashtests/insertAdjacentElement-with-DOMSubtreeModified.html
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Process type: main
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Process pid: 10184
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Crash dump filename: C:\Users\task_170228699674071\AppData\Local\Temp\tmppa1q5jdf\minidumps\51e3316f-3652-407e-a53b-140022d0ee9e.dmp
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Operating system: Windows NT
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - 10.0.22621
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - CPU: amd64
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - family 6 model 106 stepping 6
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - 8 CPUs
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO -
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Crash reason: EXCEPTION_STACK_OVERFLOW
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Crash address: 0x7ff925673115
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Crashing instruction: `push rdi`
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - No memory accessed by instruction
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Process uptime: 63 seconds
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO -
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Thread 17 Cache2 I/O (crashed)
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - 0 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 266 + 0x5]
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rax = 0x0000000000000001 rdx = 0x0000024718b62de0
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rcx = 0x000002470d019130 rbx = 0x0000024718aabcb0
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rsi = 0x0000024725278ae0 rdi = 0x000002470d019130
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rbp = 0x0000000000000000 rsp = 0x000000e7dd9e4000
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - r8 = 0x0000024725278ae0 r9 = 0x0000000000008000
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - r10 = 0x00000fff24ace61c r11 = 0x0000000151000000
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - r12 = 0x0000000000000000 r13 = 0xaaaaaaaaaaaaaaaa
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - r14 = 0x0000000000000001 r15 = 0x0000000000000001
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rip = 0x00007ff925673115
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - Found by: given as instruction pointer in context
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - 1 0x2470d01912f
[task 2023-12-11T10:35:24.767Z] 10:35:24 INFO - rbx = 0x0000000000000000 rsi = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rdi = 0x0000000000000000 rbp = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rsp = 0x000000e7dd9e4050 r12 = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - r15 = 0x000002470d003820 rip = 0x000002470d019130
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - 2 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rsp = 0x000000e7dd9e4070 rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - Found by: stack scanning
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - 3 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rbx = 0x000002472235cc80 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e40c0
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000001
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - 4 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rbx = 0x0000024722377880 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4110
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000003
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - 5 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rbx = 0x0000024722377400 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4160
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - 6 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rbx = 0x00000247223776c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e41b0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - 7 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rbx = 0x000002472235c800 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4200
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - 8 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rbx = 0x000002472207ecc0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4250
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - 9 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rbx = 0x0000024722062b80 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e42a0
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - 10 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24 INFO - rbx = 0x0000024722062280 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e42f0
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - 11 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rbx = 0x000002472200ff40 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4340
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - 12 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rbx = 0x000002472200f580 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4390
[task 2023-12-11T10:35:24.770Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000003
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - 13 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rbx = 0x0000024721eb8c80 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e43e0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - 14 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rbx = 0x0000024721e9b100 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4430
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - 15 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rbx = 0x0000024721e8fcc0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4480
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - 16 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rbx = 0x0000024721e5b980 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e44d0
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24 INFO - 17 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rbx = 0x0000024721e5b700 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4520
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - 18 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rbx = 0x0000024721e591c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4570
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - 19 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rbx = 0x0000024721e55dc0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e45c0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - 20 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rbx = 0x0000024721e55ec0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4610
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - 21 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rbx = 0x0000024721e554c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4660
[task 2023-12-11T10:35:24.772Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - 22 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rbx = 0x0000024721e53ac0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e46b0
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - 23 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rbx = 0x0000024721e537c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4700
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24 INFO - 24 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rbx = 0x0000024721e53440 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4750
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - 25 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rbx = 0x0000024721e49e00 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e47a0
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - 26 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rbx = 0x0000024721e49340 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e47f0
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24 INFO - 27 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rbx = 0x0000024721e49640 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4840
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - 28 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rbx = 0x0000024721e47640 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4890
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - 29 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rbx = 0x0000024721e458c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e48e0
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - 30 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rbx = 0x0000024721e45d00 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4930
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - 31 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rbx = 0x0000024721e452c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4980
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - 32 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rbx = 0x0000024721e44e00 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e49d0
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - 33 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rbx = 0x0000024721e44940 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4a20
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - 34 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rbx = 0x0000024721e44580 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4a70
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - 35 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rbx = 0x0000024721e3d840 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4ac0
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - 36 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rbx = 0x0000024721e3d340 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4b10
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - 37 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rbx = 0x0000024721e3d200 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4b60
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - 38 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rbx = 0x0000024721e3a300 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4bb0
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - 39 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rbx = 0x0000024721e39b00 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4c00
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24 INFO - Found by: call frame info
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - 40 xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - rbx = 0x0000024721e359c0 rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - rdi = 0x000002470d019130 rsp = 0x000000e7dd9e4c50
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - r14 = 0x0000000000000004 r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.779Z] 10:35:24 INFO - Found by: call frame info
<...>
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - 1400 xul.dll!nsTimerImpl::InitHighResolutionWithCallback(nsITimerCallback*, mozilla::BaseTimeDuration<mozilla::TimeDurationValueCalculator> const&, unsigned int) [nsTimerImpl.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 465 + 0x7]
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rbx = 0x0000024724b7d880 rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rdi = 0x000000e7dd9ff680 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff5b0 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x0000024724b7d8c0
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - r15 = 0x0000024718b36a20 rip = 0x00007ff92569eed2
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - 1401 xul.dll!nsTimerImpl::InitWithCallback(nsITimerCallback*, unsigned int, unsigned int) [nsTimerImpl.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 452]
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - 1402 xul.dll!nsTimer::InitWithCallback(nsITimerCallback*, unsigned int, unsigned int) [nsTimerImpl.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 199 + 0x2b]
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rbx = 0x0000024724b7d880 rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rdi = 0x0000024718b1f7f0 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff660 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x000000e7dd9ff6d8
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - r15 = 0x0000024718b36a20 rip = 0x00007ff92569d25b
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - 1403 xul.dll!mozilla::net::CacheStorageService::SchedulePurgeOverMemoryLimit() [CacheStorageService.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 1330 + 0x1c]
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - rbx = 0x0000024718b1f940 rsi = 0x0000024718b1f840
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - rdi = 0x0000024718b1f7f0 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff6b0 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x000000e7dd9ff6d8
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - r15 = 0x0000024718b36a20 rip = 0x00007ff925cab770
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - 1404 xul.dll!mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>::operator()() const [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1164]
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - 1405 xul.dll!std::invoke(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&) [type_traits : 1524]
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - 1406 xul.dll!std::_Apply_impl(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&, std::tuple<>&, std::integer_sequence<unsigned long long>) [tuple : 974]
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - 1407 xul.dll!std::apply(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&, std::tuple<>&) [tuple : 979]
[task 2023-12-11T10:35:25.234Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - 1408 xul.dll!mozilla::detail::RunnableMethodArguments<>::apply(mozilla::net::CacheStorageService*, void (mozilla::net::CacheStorageService::*)()) [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1162]
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - 1409 xul.dll!mozilla::detail::RunnableMethodImpl<mozilla::net::CacheStorageService *,void (mozilla::net::CacheStorageService::*)(),1,0>::Run() [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1213 + 0x8]
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rbx = 0x0000024718b36918 rsi = 0x0000024718b36900
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rdi = 0x000000e7dd9ff920 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff710 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x00000000ffffffff
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r15 = 0x0000024718b36a20 rip = 0x00007ff925cb28c1
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - 1410 xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 1192 + 0xc]
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rbx = 0x0000024718b36918 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff740 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r13 = 0xaaaaaaaaaaaaaaaa r14 = 0x00000000ffffffff
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r15 = 0x0000024718b36a20 rip = 0x00007ff92568d61d
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - 1411 xul.dll!mozilla::net::CacheIOThread::ThreadFunc() [CacheIOThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 412 + 0x14]
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rbx = 0x000000e7dd9ff920 rsi = 0x000002470d085d78
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rdi = 0x000002470d085d60 rbp = 0x00007ff94b3f4730
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff8c0 r12 = 0xaaaaaaaaaaaaaaaa
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x000002470d085dc8
[task 2023-12-11T10:35:25.235Z] 10:35:25 INFO - r15 = 0x00007ff92f368375 rip = 0x00007ff925c87593
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - 1412 xul.dll!mozilla::net::CacheIOThread::ThreadFunc(void*) [CacheIOThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 368 + 0x7]
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rbx = 0x00007ff94b38d9a4 rsi = 0x000002470d085d60
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rdi = 0x00007ff94b3f70e0 rbp = 0x00007ff94b3f4730
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rsp = 0x000000e7dd9ff980 r12 = 0x0000024718b72838
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - r13 = 0x0000024718b72848 r14 = 0x00007ff94b38d8c9
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - r15 = 0x00007ff94b38d985 rip = 0x00007ff925c86c98
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - 1413 nss3.dll!_PR_NativeRunThread(void*) [pruthr.c:bd5ca949886cdde37c181fccd3ec8070be726249 : 399 + 0xd]
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rbx = 0x00007ff94b38d9a4 rsi = 0x0000024718b72700
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rbp = 0x00007ff94b3f4730 rsp = 0x000000e7dd9ff9b0
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - r12 = 0x0000024718b72838 r13 = 0x0000024718b72848
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - r14 = 0x00007ff94b38d8c9 r15 = 0x00007ff94b38d985
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rip = 0x00007ff94b23f891
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - 1414 nss3.dll!pr_root(void*) [w95thred.c:bd5ca949886cdde37c181fccd3ec8070be726249 : 139 + 0xc]
[task 2023-12-11T10:35:25.236Z] 10:35:25 INFO - rbx = 0x000002470ed11710 rsi = 0x000002470ed11710
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - rdi = 0x00007ff96baf92d0 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - rsp = 0x000000e7dd9ffa30 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - r15 = 0x0000000000000000 rip = 0x00007ff94b2308f1
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - 1415 ucrtbase.dll!thread_start<unsigned int (__cdecl*)(void *),1> + 0x92
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - rbx = 0x000002470ed11710 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - rsp = 0x000000e7dd9ffa60 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - r15 = 0x0000000000000000 rip = 0x00007ff96baf9363
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - 1416 kernel32.dll!BaseThreadInitThunk + 0x1c
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - rbx = 0x000002470ed11710 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - rsp = 0x000000e7dd9ffa90 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - r15 = 0x0000000000000000 rip = 0x00007ff96d8c257d
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - 1417 mozglue.dll!mozilla::interceptor::FuncHook<mozilla::interceptor::WindowsDllInterceptor<mozilla::interceptor::VMSharingPolicyShared>,void (*)(int, void *, void *)>::operator()(int&, void*&, void*&) const [nsWindowsDllInterceptor.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 150]
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - Found by: inlining
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - 1418 mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 561 + 0x14]
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - rbx = 0x0000000000000000 rsi = 0x000002470ed11710
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - rdi = 0x00007ff96baf92d0 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - rsp = 0x000000e7dd9ffac0 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - r15 = 0x0000000000000000 rip = 0x00007ff94dddc5e5
[task 2023-12-11T10:35:25.238Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - 1419 ntdll.dll!RtlUserThreadStart + 0x27
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - rbx = 0x0000000000000000 rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - rdi = 0x0000000000000000 rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - rsp = 0x000000e7dd9ffb30 r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - r13 = 0x0000000000000000 r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - r15 = 0x0000000000000000 rip = 0x00007ff96e0caa78
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - Found by: call frame info
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO -
[task 2023-12-11T10:35:25.239Z] 10:35:25 INFO - Thread 0 MainThread
Comment hidden (Intermittent Failures Robot) |
Comment 2•10 months ago
|
||
Interesting, we crash with EXCEPTION_STACK_OVERFLOW
and in fact there are ~1400 frames of mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure
on the stack. This code is only active in DEBUG builds, and assuming that we see a problem with the Detector and not with how we use the mutex that is checked, I think this is quite low severity (from a user perspective). Something seems to form a cycle over instances in this array pointing back to where we started.
:mccr8, who would be interested in looking at this DeadlockDetector code ? A defensive fix might be to just record any visited instance in an additional array and check that before recursing, but there might be better ways ?
Comment 3•10 months ago
|
||
I don't know anything about the DeadlockDetector. Maybe Nika does? Or maybe nobody does.
Comment hidden (Intermittent Failures Robot) |
Comment 5•9 months ago
|
||
Something similar to this previously came up in bug 1761547 with the mojo::core::ports code, where we overwhelmed the deadlock detector code due to the complex relationships of port mutexes. We ended up moving those mutexes to not invoke the deadlock detector anymore, because their locking pattern despite being sound due to mutex locking being ordered, would produce extremely long chains.
In this case it appears that the issue is happening when trying to acquire a timer mutex (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/xpcom/threads/nsTimerImpl.cpp#465), from within https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheStorageService.cpp#1309. The second example in comment 4 occurs when acquiring a CacheFile
(https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheFile.cpp#2327) from within the CacheStorageService
lock (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheStorageService.cpp#2019,2030). Both of these point the finger at the CacheStorageService
lock.
Effectively what this code is doing is, before acquiring the timer or cache file mutex, it checks every single mutex which has ever been held while acquiring the CacheStorageService mutex to see if any of them are the mutex we're acquiring. It then does this check recursively on those mutexes, and so on. The stack exploding suggests there is an extremely long chain (at least 1400 long) of mutexes which are acquired before a mutex acquired before a mutex acquired before the (etc.) before the CacheStorageService mutex. This chain doesn't need to be acquired all at once, it can be built up over time. I don't know what chain of mutexes this would be, as I'm not familiar with the cache storage code. Given that this happened twice in the last month, I'd consider trying to look for recent changes to locking in code which invokes the CacheStorageService?
It shouldn't be possible for us to have a loop in the mOrderedLT
array making this be truly infinite, as the only way a new entry is added to the array is here (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/xpcom/threads/DeadlockDetector.h#254), which occurs after two InTransitiveClosure
checks to ensure that the newly added proposed
entry doesn't itself contain current
in the transitive closure.
Some scanning through the code to write this comment suggests that the deadlock detector could misbehave if a mutex/monitor's memory is freed without invoking the destructor, or if it is memmove
-ed around, but I don't think these should be able to cause an infinite loop like this unless we get very lucky with uninitialized memory so I don't expect them to be the cause here.
Updated•7 months ago
|
Comment hidden (Intermittent Failures Robot) |
Comment 8•6 months ago
|
||
As best I can tell, there's been little change in locking behavior in Cache2 itself in quite some time (and certainly not intentionally). It is possible other code that calls it might have changed.
Is there some way to cut off the verification chain at some known-safe point? (I don't know the internals of the lock-checking code)
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 11•5 months ago
|
||
:mccr8 says they can reproduce a crash like this one locally with a change to a test. Let's see if we can get a pernosco trace or similar so we can figure out what's going on here.
Description
•