Open Bug 1869272 Opened 10 months ago Updated 5 months ago

Intermittent application crashed [@ mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure] | single tracking bug

Categories

(Core :: XPCOM, defect)

defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

Details

(Keywords: crash, intermittent-failure, intermittent-testcase)

Crash Data

Attachments

(1 obsolete file)

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=439597385&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CHrTG1jLQ02VrChZTrpI1w/runs/0/artifacts/public/logs/live_backing.log


[task 2023-12-11T10:35:12.225Z] 10:35:12     INFO - IOError on command, setting status to CRASH
[task 2023-12-11T10:35:12.225Z] 10:35:12     INFO - mozcrash Copy/paste: Z:\task_170228699674071\fetches\minidump-stackwalk\minidump-stackwalk.exe --symbols-url=https://symbols.mozilla.org/ --cyborg=C:\Users\task_170228699674071\AppData\Local\Temp\tmpsz0lfwmh\51e3316f-3652-407e-a53b-140022d0ee9e.trace C:\Users\task_170228699674071\AppData\Local\Temp\tmppa1q5jdf\minidumps\51e3316f-3652-407e-a53b-140022d0ee9e.dmp Z:\task_170228699674071\build\symbols
[task 2023-12-11T10:35:23.339Z] 10:35:23     INFO - mozcrash Saved minidump as Z:\task_170228699674071\build\blobber_upload_dir\51e3316f-3652-407e-a53b-140022d0ee9e.dmp
[task 2023-12-11T10:35:23.347Z] 10:35:23     INFO - mozcrash Saved app info as Z:\task_170228699674071\build\blobber_upload_dir\51e3316f-3652-407e-a53b-140022d0ee9e.extra
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - PROCESS-CRASH | application crashed [@ mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure] | /editing/crashtests/insertAdjacentElement-with-DOMSubtreeModified.html 
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Process type: main
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Process pid: 10184
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Crash dump filename: C:\Users\task_170228699674071\AppData\Local\Temp\tmppa1q5jdf\minidumps\51e3316f-3652-407e-a53b-140022d0ee9e.dmp
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Operating system: Windows NT
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -                   10.0.22621
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - CPU: amd64
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      family 6 model 106 stepping 6
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      8 CPUs
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - 
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Crash reason:  EXCEPTION_STACK_OVERFLOW
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Crash address: 0x7ff925673115
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Crashing instruction: `push rdi`
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - No memory accessed by instruction
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Process uptime: 63 seconds
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - 
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO - Thread 17 Cache2 I/O (crashed)
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -  0  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 266 + 0x5]
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rax = 0x0000000000000001    rdx = 0x0000024718b62de0
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rcx = 0x000002470d019130    rbx = 0x0000024718aabcb0
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rsi = 0x0000024725278ae0    rdi = 0x000002470d019130
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rbp = 0x0000000000000000    rsp = 0x000000e7dd9e4000
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -       r8 = 0x0000024725278ae0     r9 = 0x0000000000008000
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      r10 = 0x00000fff24ace61c    r11 = 0x0000000151000000
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      r12 = 0x0000000000000000    r13 = 0xaaaaaaaaaaaaaaaa
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      r14 = 0x0000000000000001    r15 = 0x0000000000000001
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rip = 0x00007ff925673115
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -     Found by: given as instruction pointer in context
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -  1  0x2470d01912f
[task 2023-12-11T10:35:24.767Z] 10:35:24     INFO -      rbx = 0x0000000000000000    rsi = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rdi = 0x0000000000000000    rbp = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rsp = 0x000000e7dd9e4050    r12 = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x0000000000000000
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      r15 = 0x000002470d003820    rip = 0x000002470d019130
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -  2  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rsp = 0x000000e7dd9e4070    rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -     Found by: stack scanning
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -  3  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rbx = 0x000002472235cc80    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e40c0
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000001
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -  4  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rbx = 0x0000024722377880    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4110
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000003
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -  5  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rbx = 0x0000024722377400    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4160
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.768Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -  6  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rbx = 0x00000247223776c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e41b0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -  7  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rbx = 0x000002472235c800    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4200
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -  8  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rbx = 0x000002472207ecc0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4250
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -  9  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rbx = 0x0000024722062b80    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e42a0
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO - 10  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.769Z] 10:35:24     INFO -      rbx = 0x0000024722062280    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e42f0
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO - 11  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rbx = 0x000002472200ff40    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4340
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO - 12  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rbx = 0x000002472200f580    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4390
[task 2023-12-11T10:35:24.770Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000003
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO - 13  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rbx = 0x0000024721eb8c80    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e43e0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO - 14  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rbx = 0x0000024721e9b100    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4430
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO - 15  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rbx = 0x0000024721e8fcc0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4480
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO - 16  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rbx = 0x0000024721e5b980    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e44d0
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.771Z] 10:35:24     INFO - 17  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rbx = 0x0000024721e5b700    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4520
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO - 18  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rbx = 0x0000024721e591c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4570
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO - 19  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rbx = 0x0000024721e55dc0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e45c0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO - 20  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rbx = 0x0000024721e55ec0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4610
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO - 21  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rbx = 0x0000024721e554c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4660
[task 2023-12-11T10:35:24.772Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO - 22  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rbx = 0x0000024721e53ac0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e46b0
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO - 23  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rbx = 0x0000024721e537c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4700
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.773Z] 10:35:24     INFO - 24  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rbx = 0x0000024721e53440    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4750
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO - 25  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rbx = 0x0000024721e49e00    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e47a0
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO - 26  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rbx = 0x0000024721e49340    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e47f0
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.774Z] 10:35:24     INFO - 27  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rbx = 0x0000024721e49640    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4840
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO - 28  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rbx = 0x0000024721e47640    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4890
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO - 29  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rbx = 0x0000024721e458c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e48e0
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO - 30  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rbx = 0x0000024721e45d00    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.775Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4930
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO - 31  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rbx = 0x0000024721e452c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4980
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO - 32  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rbx = 0x0000024721e44e00    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e49d0
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO - 33  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rbx = 0x0000024721e44940    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4a20
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.776Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO - 34  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rbx = 0x0000024721e44580    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4a70
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO - 35  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rbx = 0x0000024721e3d840    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4ac0
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO - 36  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rbx = 0x0000024721e3d340    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4b10
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.777Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO - 37  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rbx = 0x0000024721e3d200    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4b60
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO - 38  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rbx = 0x0000024721e3a300    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4bb0
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO - 39  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rbx = 0x0000024721e39b00    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4c00
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.778Z] 10:35:24     INFO -     Found by: call frame info
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO - 40  xul.dll!mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure(mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*, mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::OrderingEntry const*) const [DeadlockDetector.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 277 + 0xe]
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO -      rbx = 0x0000024721e359c0    rsi = 0x0000024725278ae0
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO -      rdi = 0x000002470d019130    rsp = 0x000000e7dd9e4c50
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO -      r14 = 0x0000000000000004    r15 = 0x0000000000000004
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO -      rip = 0x00007ff92567319f
[task 2023-12-11T10:35:24.779Z] 10:35:24     INFO -     Found by: call frame info
<...>
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO - 1400  xul.dll!nsTimerImpl::InitHighResolutionWithCallback(nsITimerCallback*, mozilla::BaseTimeDuration<mozilla::TimeDurationValueCalculator> const&, unsigned int) [nsTimerImpl.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 465 + 0x7]
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rbx = 0x0000024724b7d880    rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rdi = 0x000000e7dd9ff680    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff5b0    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x0000024724b7d8c0
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      r15 = 0x0000024718b36a20    rip = 0x00007ff92569eed2
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO - 1401  xul.dll!nsTimerImpl::InitWithCallback(nsITimerCallback*, unsigned int, unsigned int) [nsTimerImpl.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 452]
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO - 1402  xul.dll!nsTimer::InitWithCallback(nsITimerCallback*, unsigned int, unsigned int) [nsTimerImpl.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 199 + 0x2b]
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rbx = 0x0000024724b7d880    rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rdi = 0x0000024718b1f7f0    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.233Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff660    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x000000e7dd9ff6d8
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      r15 = 0x0000024718b36a20    rip = 0x00007ff92569d25b
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO - 1403  xul.dll!mozilla::net::CacheStorageService::SchedulePurgeOverMemoryLimit() [CacheStorageService.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 1330 + 0x1c]
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      rbx = 0x0000024718b1f940    rsi = 0x0000024718b1f840
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      rdi = 0x0000024718b1f7f0    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff6b0    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x000000e7dd9ff6d8
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -      r15 = 0x0000024718b36a20    rip = 0x00007ff925cab770
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO - 1404  xul.dll!mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>::operator()() const [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1164]
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO - 1405  xul.dll!std::invoke(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&) [type_traits : 1524]
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO - 1406  xul.dll!std::_Apply_impl(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&, std::tuple<>&, std::integer_sequence<unsigned long long>) [tuple : 974]
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO - 1407  xul.dll!std::apply(mozilla::detail::RunnableMethodArguments<>::apply<mozilla::net::CacheStorageService,void (mozilla::net::CacheStorageService::*)()>::<lambda_1>&&, std::tuple<>&) [tuple : 979]
[task 2023-12-11T10:35:25.234Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO - 1408  xul.dll!mozilla::detail::RunnableMethodArguments<>::apply(mozilla::net::CacheStorageService*, void (mozilla::net::CacheStorageService::*)()) [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1162]
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO - 1409  xul.dll!mozilla::detail::RunnableMethodImpl<mozilla::net::CacheStorageService *,void (mozilla::net::CacheStorageService::*)(),1,0>::Run() [nsThreadUtils.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 1213 + 0x8]
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rbx = 0x0000024718b36918    rsi = 0x0000024718b36900
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rdi = 0x000000e7dd9ff920    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff710    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x00000000ffffffff
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r15 = 0x0000024718b36a20    rip = 0x00007ff925cb28c1
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO - 1410  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 1192 + 0xc]
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rbx = 0x0000024718b36918    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff740    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r13 = 0xaaaaaaaaaaaaaaaa    r14 = 0x00000000ffffffff
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r15 = 0x0000024718b36a20    rip = 0x00007ff92568d61d
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO - 1411  xul.dll!mozilla::net::CacheIOThread::ThreadFunc() [CacheIOThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 412 + 0x14]
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rbx = 0x000000e7dd9ff920    rsi = 0x000002470d085d78
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rdi = 0x000002470d085d60    rbp = 0x00007ff94b3f4730
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff8c0    r12 = 0xaaaaaaaaaaaaaaaa
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x000002470d085dc8
[task 2023-12-11T10:35:25.235Z] 10:35:25     INFO -      r15 = 0x00007ff92f368375    rip = 0x00007ff925c87593
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO - 1412  xul.dll!mozilla::net::CacheIOThread::ThreadFunc(void*) [CacheIOThread.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 368 + 0x7]
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rbx = 0x00007ff94b38d9a4    rsi = 0x000002470d085d60
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rdi = 0x00007ff94b3f70e0    rbp = 0x00007ff94b3f4730
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ff980    r12 = 0x0000024718b72838
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      r13 = 0x0000024718b72848    r14 = 0x00007ff94b38d8c9
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      r15 = 0x00007ff94b38d985    rip = 0x00007ff925c86c98
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO - 1413  nss3.dll!_PR_NativeRunThread(void*) [pruthr.c:bd5ca949886cdde37c181fccd3ec8070be726249 : 399 + 0xd]
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rbx = 0x00007ff94b38d9a4    rsi = 0x0000024718b72700
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rbp = 0x00007ff94b3f4730    rsp = 0x000000e7dd9ff9b0
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      r12 = 0x0000024718b72838    r13 = 0x0000024718b72848
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      r14 = 0x00007ff94b38d8c9    r15 = 0x00007ff94b38d985
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rip = 0x00007ff94b23f891
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO - 1414  nss3.dll!pr_root(void*) [w95thred.c:bd5ca949886cdde37c181fccd3ec8070be726249 : 139 + 0xc]
[task 2023-12-11T10:35:25.236Z] 10:35:25     INFO -      rbx = 0x000002470ed11710    rsi = 0x000002470ed11710
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      rdi = 0x00007ff96baf92d0    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ffa30    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      r15 = 0x0000000000000000    rip = 0x00007ff94b2308f1
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO - 1415  ucrtbase.dll!thread_start<unsigned int (__cdecl*)(void *),1> + 0x92
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      rbx = 0x000002470ed11710    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ffa60    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.237Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      r15 = 0x0000000000000000    rip = 0x00007ff96baf9363
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO - 1416  kernel32.dll!BaseThreadInitThunk + 0x1c
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      rbx = 0x000002470ed11710    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ffa90    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      r15 = 0x0000000000000000    rip = 0x00007ff96d8c257d
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO - 1417  mozglue.dll!mozilla::interceptor::FuncHook<mozilla::interceptor::WindowsDllInterceptor<mozilla::interceptor::VMSharingPolicyShared>,void (*)(int, void *, void *)>::operator()(int&, void*&, void*&) const [nsWindowsDllInterceptor.h:bd5ca949886cdde37c181fccd3ec8070be726249 : 150]
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -     Found by: inlining
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO - 1418  mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:bd5ca949886cdde37c181fccd3ec8070be726249 : 561 + 0x14]
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      rbx = 0x0000000000000000    rsi = 0x000002470ed11710
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      rdi = 0x00007ff96baf92d0    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ffac0    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -      r15 = 0x0000000000000000    rip = 0x00007ff94dddc5e5
[task 2023-12-11T10:35:25.238Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO - 1419  ntdll.dll!RtlUserThreadStart + 0x27
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -      rbx = 0x0000000000000000    rsi = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -      rdi = 0x0000000000000000    rbp = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -      rsp = 0x000000e7dd9ffb30    r12 = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -      r15 = 0x0000000000000000    rip = 0x00007ff96e0caa78
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO -     Found by: call frame info
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO - 
[task 2023-12-11T10:35:25.239Z] 10:35:25     INFO - Thread 0 MainThread

Interesting, we crash with EXCEPTION_STACK_OVERFLOW and in fact there are ~1400 frames of mozilla::DeadlockDetector<mozilla::BlockingResourceBase>::InTransitiveClosure on the stack. This code is only active in DEBUG builds, and assuming that we see a problem with the Detector and not with how we use the mutex that is checked, I think this is quite low severity (from a user perspective). Something seems to form a cycle over instances in this array pointing back to where we started.

:mccr8, who would be interested in looking at this DeadlockDetector code ? A defensive fix might be to just record any visited instance in an additional array and check that before recursing, but there might be better ways ?

Flags: needinfo?(continuation)

I don't know anything about the DeadlockDetector. Maybe Nika does? Or maybe nobody does.

Flags: needinfo?(continuation) → needinfo?(nika)

Something similar to this previously came up in bug 1761547 with the mojo::core::ports code, where we overwhelmed the deadlock detector code due to the complex relationships of port mutexes. We ended up moving those mutexes to not invoke the deadlock detector anymore, because their locking pattern despite being sound due to mutex locking being ordered, would produce extremely long chains.

In this case it appears that the issue is happening when trying to acquire a timer mutex (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/xpcom/threads/nsTimerImpl.cpp#465), from within https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheStorageService.cpp#1309. The second example in comment 4 occurs when acquiring a CacheFile (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheFile.cpp#2327) from within the CacheStorageService lock (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/netwerk/cache2/CacheStorageService.cpp#2019,2030). Both of these point the finger at the CacheStorageService lock.

Effectively what this code is doing is, before acquiring the timer or cache file mutex, it checks every single mutex which has ever been held while acquiring the CacheStorageService mutex to see if any of them are the mutex we're acquiring. It then does this check recursively on those mutexes, and so on. The stack exploding suggests there is an extremely long chain (at least 1400 long) of mutexes which are acquired before a mutex acquired before a mutex acquired before the (etc.) before the CacheStorageService mutex. This chain doesn't need to be acquired all at once, it can be built up over time. I don't know what chain of mutexes this would be, as I'm not familiar with the cache storage code. Given that this happened twice in the last month, I'd consider trying to look for recent changes to locking in code which invokes the CacheStorageService?

It shouldn't be possible for us to have a loop in the mOrderedLT array making this be truly infinite, as the only way a new entry is added to the array is here (https://searchfox.org/mozilla-central/rev/9137f80064364a41a1de394af4ce05dffdbf68e6/xpcom/threads/DeadlockDetector.h#254), which occurs after two InTransitiveClosure checks to ensure that the newly added proposed entry doesn't itself contain current in the transitive closure.

Some scanning through the code to write this comment suggests that the deadlock detector could misbehave if a mutex/monitor's memory is freed without invoking the destructor, or if it is memmove-ed around, but I don't think these should be able to cause an infinite loop like this unless we get very lucky with uninitialized memory so I don't expect them to be the cause here.

Flags: needinfo?(nika) → needinfo?(rjesup)
Attachment #9387775 - Attachment is obsolete: true

As best I can tell, there's been little change in locking behavior in Cache2 itself in quite some time (and certainly not intentionally). It is possible other code that calls it might have changed.

Is there some way to cut off the verification chain at some known-safe point? (I don't know the internals of the lock-checking code)

Flags: needinfo?(rjesup)

:mccr8 says they can reproduce a crash like this one locally with a change to a test. Let's see if we can get a pernosco trace or similar so we can figure out what's going on here.

Severity: -- → S3
Flags: needinfo?(continuation)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: