1647714 - Intermittent /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-process-frozen-array.https.html | application crashed [@ RtlpHeapFindListLookupEntry + 0x127] | @ _platform_memmove$VARIANT$Haswell + 0xf0]

Status: RESOLVED DUPLICATE of bug 1647750

(Core :: Web Audio, defect)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=307250754&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/O_-3VmRhRW2rOT7PFmPf6w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-06-23T13:33:16.353Z] 13:33:16 INFO - TEST-OK | /html/semantics/document-metadata/the-title-element/title.text-04.xhtml | took 448ms
[task 2020-06-23T13:33:16.353Z] 13:33:16 INFO - Restarting browser for new test group
[task 2020-06-23T13:33:16.373Z] 13:33:16 INFO - PID 8264 | 1592919196364 Marionette INFO Stopped listening on port 54627
[task 2020-06-23T13:33:16.756Z] 13:33:16 INFO - PID 8264 | [2020-06-23T13:33:16Z WARN xulstore::persist] tried to remove key that isn't in the store
[task 2020-06-23T13:33:16.756Z] 13:33:16 INFO - PID 8264 | [2020-06-23T13:33:16Z WARN xulstore::persist] tried to remove key that isn't in the store
[task 2020-06-23T13:33:16.761Z] 13:33:16 INFO - PID 8264 | [Child 3848, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp, line 3359
[task 2020-06-23T13:33:16.780Z] 13:33:16 INFO - PID 8264 | [Child 3444, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp, line 3359
[task 2020-06-23T13:33:16.810Z] 13:33:16 INFO - mozcrash Saved minidump as Z:\task_1592917197\build\blobber_upload_dir\bdf79fbe-aa4d-448f-a32a-82a7dc12b07e.dmp
[task 2020-06-23T13:33:16.810Z] 13:33:16 INFO - mozcrash Saved app info as Z:\task_1592917197\build\blobber_upload_dir\bdf79fbe-aa4d-448f-a32a-82a7dc12b07e.extra
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - PROCESS-CRASH | /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-process-frozen-array.https.html | application crashed [@ RtlpHeapFindListLookupEntry + 0x127]
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - Crash dump filename: c:\users\task_1592917197\appdata\local\temp\tmpwz9ma1\minidumps\bdf79fbe-aa4d-448f-a32a-82a7dc12b07e.dmp
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - Operating system: Windows NT
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - 10.0.17134
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - CPU: amd64
[task 2020-06-23T13:33:16.833Z] 13:33:16 INFO - family 6 model 85 stepping 4
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - 8 CPUs
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO -
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - GPU: UNKNOWN
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO -
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - Crash reason: EXCEPTION_ACCESS_VIOLATION_READ
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - Crash address: 0x0
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - Assertion: Unknown assertion type 0x00000000
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - Process uptime: 6 seconds
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO -
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - Thread 42 (crashed)
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - 0 VCRUNTIME140.dll!RtlpHeapFindListLookupEntry + 0x127
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - rax = 0x000001c671079820 rdx = 0xfffffe398ef867e0
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - rcx = 0x0000000000000200 rbx = 0x0000000000000000
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - rsi = 0x0000000000000000 rdi = 0x000001c671079820
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe5b8
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - r8 = 0x0000000000000000 r9 = 0x0000000000000003
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - r10 = 0x0000000000000000 r11 = 0x0000000000000000
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - r12 = 0x000001c668c12e20 r13 = 0x000001c671072d30
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - r14 = 0x0000000000000001 r15 = 0x0000000000000018
[task 2020-06-23T13:33:16.834Z] 13:33:16 INFO - rip = 0x00007ffc559fc887
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - Found by: given as instruction pointer in context
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - 1 0xaaaaaaaaaaaaaaaa
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - rbx = 0x0000000000000000 rbp = 0x000001c671072d90
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - rsp = 0x0000006de3ffe648 r12 = 0x000001c668c12e20
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - r13 = 0x000001c671072d30 r14 = 0x0000000000000001
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - r15 = 0x0000000000000018 rip = 0xaaaaaaaaaaaaaaaa
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - 2 xul.dll + 0x7b630
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe700
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - rip = 0x00007ffc2924b630
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - Found by: stack scanning
[task 2020-06-23T13:33:16.835Z] 13:33:16 INFO - 3 xul.dll!truncf + 0x1ced1f0
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe7a0
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rip = 0x00007ffc339b65b0
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - Found by: stack scanning
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - 4 xul.dll!truncf + 0x8ea96d
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe7a8
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rip = 0x00007ffc325b3d2d
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - Found by: stack scanning
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - 5 xul.dll!truncf + 0x8ed920
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe8e8
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rip = 0x00007ffc325b6ce0
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - Found by: stack scanning
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - 6 xul.dll!mozilla::dom::WorkletNodeEngine::ProcessBlock(mozilla::AudioNodeTrack*, long long, mozilla::AudioBlock const&, mozilla::AudioBlock*, bool*) [AudioWorkletNode.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 87 + 0xf]
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe920
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rip = 0x00007ffc2ce4a5f4
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - Found by: stack scanning
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - 7 xul.dll!mozilla::AudioNodeTrack::ProcessInput(long long, long long, unsigned int) [AudioNodeTrack.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 533 + 0x1b]
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffe990
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - rip = 0x00007ffc2ce2155c
[task 2020-06-23T13:33:16.836Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - 8 xul.dll!mozilla::MediaTrackGraphImpl::ProduceDataForTracksBlockByBlock(unsigned int, int) [MediaTrackGraph.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 1116 + 0x24]
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffea50
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rip = 0x00007ffc2cb8c74a
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - 9 xul.dll!mozilla::MediaTrackGraphImpl::Process(mozilla::AudioMixer*) [MediaTrackGraph.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 1282 + 0xa]
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffeab0
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rip = 0x00007ffc2cb8dffa
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - 10 xul.dll!mozilla::MediaTrackGraphImpl::OneIterationImpl(long long, long long, mozilla::AudioMixer*) [MediaTrackGraph.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 1409 + 0xb]
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffec60
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rip = 0x00007ffc2cb8e910
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - 11 xul.dll!mozilla::GraphRunner::Run() [GraphRunner.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 114 + 0xd]
[task 2020-06-23T13:33:16.837Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3ffef10
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - rip = 0x00007ffc2ca549dc
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - 12 xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 1234 + 0x6]
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff0e0
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - rip = 0x00007ffc293769cc
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - 13 xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 501 + 0xd]
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff6c0
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - rip = 0x00007ffc2937c93b
[task 2020-06-23T13:33:16.838Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 14 xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 332 + 0xa]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff710
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc29c03fc5
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 15 xul.dll!MessageLoop::RunHandler() [message_loop.cc:1620ceeb178952785531dc2855157fef8c4e3f60 : 308 + 0x8]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff780
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc29b9fd50
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 16 xul.dll!MessageLoop::Run() [message_loop.cc:1620ceeb178952785531dc2855157fef8c4e3f60 : 290 + 0x5]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff7d0
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc29b9fc02
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 17 xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:1620ceeb178952785531dc2855157fef8c4e3f60 : 447 + 0x8]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff820
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc29372bea
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 18 nss3.dll!PR_NativeRunThread(void*) [pruthr.c:1620ceeb178952785531dc2855157fef8c4e3f60 : 399 + 0x7]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fff9f0
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc5582c0eb
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 19 nss3.dll!pr_root(void*) [w95thred.c:1620ceeb178952785531dc2855157fef8c4e3f60 : 139 + 0x6]
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fffa70
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc5581ca4a
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - 20 ucrtbase.dll!RtlpHpSegPageRangeShrink + 0xda
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rbp = 0x000001c671072d90 rsp = 0x0000006de3fffaa0
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - rip = 0x00007ffc69afc4be
[task 2020-06-23T13:33:16.839Z] 13:33:16 INFO - Found by: call frame info

Comment 1

[Karl Tomlinson (:karlt)]

https://hg.mozilla.org/integration/autoland/annotate/1620ceeb178952785531dc2855157fef8c4e3f60/dom/media/webaudio/AudioWorkletNode.cpp#l87

The RtlUpcaseUnicodeToOemN stack for Windows x86 has the same AudioWorkletNode.cpp line number.

The _platform_memmove$VARIANT$Haswell macosx1014-64-shippable/opt stack identifies a child frame in ProcessBlocksOnPorts()/PodCopy() at https://hg.mozilla.org/integration/autoland/annotate/5431d962a10f33df15f35bc47e62b6740b61308e/mfbt/PodOperations.h#l108

The only use of PodCopy I see is at https://searchfox.org/mozilla-central/rev/46e3b1ce2cc120a188f6940b5c6eab6b24530e4f/dom/media/webaudio/AudioWorkletNode.cpp#582

Bug 1647750 has the same root cause with a better stack.

Comment 2

[Karl Tomlinson (:karlt)]

S3 because detaching the output buffers is not something sites are likely to want to do.

Comment 3

[Intermittent Failures Robot]

15 failures in 1020 pushes (0.015 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 1

Platform breakdown:

• windows10-64: 8
• windows7-32: 3
• macosx1014-64-shippable: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1647714&startday=2020-06-23&endday=2020-06-23&tree=all

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1644847

Comment 6

[Intermittent Failures Robot]

25 failures in 5252 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 20
• mozilla-central: 3
• try: 2

Platform breakdown:

• windows10-64: 13
• windows7-32: 3
• macosx1014-64-shippable: 6
• windows10-64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1647714&startday=2020-06-22&endday=2020-06-28&tree=all