Closed Bug 1785030 Opened 2 years ago Closed 2 years ago

Intermittent gtest | application crashed [@ RaiseException + 0x62]

Categories

(Core :: Audio/Video: GMP, defect)

defect

Tracking

()

RESOLVED FIXED
105 Branch
Tracking Status
firefox-esr91 --- unaffected
firefox-esr102 --- unaffected
firefox104 --- unaffected
firefox105 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: pehrsons)

References

Details

(Keywords: crash)

Crash Data

Attachments

(1 file)

I don't know what happened with the formatting of the description there. I'll repeat myself here.

GMP process (see plugin-container.exe 105.0.0.8255 (main) below) crashes on shutdown, after _exit(0).

This is observed on elm where we are ironing out the next libwebrtc update. It is close to permafail on windows x86, but there is a correlation between the number of oranges/number of crashed GMP processes and the number of TestCDMStorage gtests run.

[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - Operating system: Windows NT
[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - 10.0.19041
[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - CPU: x86
[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - GenuineIntel family 6 model 106 stepping 6
[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - 8 CPUs
[task 2022-08-08T21:27:36.474Z] 21:27:36 INFO - Crash reason: unknown 0x3228369022
[task 2022-08-08T21:27:36.475Z] 21:27:36 INFO - Crash address: 0x751db522
[task 2022-08-08T21:27:36.475Z] 21:27:36 INFO - Process uptime: 0 seconds
[task 2022-08-08T21:27:36.475Z] 21:27:36 INFO - Thread 0 MainThread (crashed)
[task 2022-08-08T21:27:36.476Z] 21:27:36 INFO - 0 KERNELBASE.dll!RaiseException + 0x62
[task 2022-08-08T21:27:36.476Z] 21:27:36 INFO - eip = 0x751db522 esp = 0x0500f368 ebp = 0x0500f3c4 ebx = 0x00000000
[task 2022-08-08T21:27:36.476Z] 21:27:36 INFO - esi = 0x00000000 edi = 0x00000000 eax = 0x0500f368 ecx = 0x00000001
[task 2022-08-08T21:27:36.476Z] 21:27:36 INFO - edx = 0x00000000 eflags = 0x00000212
[task 2022-08-08T21:27:36.476Z] 21:27:36 INFO - Found by: given as instruction pointer in context
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - 1 xul.dll!__delayLoadHelper2(ImgDelayDescr const*, int (**)()) [delayhlp.cpp : 312 + 0x11]
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - eip = 0x64299904 esp = 0x0500f3cc ebp = 0x0500f41c ebx = 0x00000000
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - esi = 0x00000000 edi = 0x00000000
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - 2 xul.dll!_tailMerge_oleaut32.dll + 0xc
[task 2022-08-08T21:27:36.477Z] 21:27:36 INFO - eip = 0x642fb931 esp = 0x0500f424 ebp = 0x0500f474 ebx = 0x00000000
[task 2022-08-08T21:27:36.478Z] 21:27:36 INFO - esi = 0x00000000 edi = 0x00000000
[task 2022-08-08T21:27:36.478Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.478Z] 21:27:36 INFO - 3 ucrtbase.dll!_crt_seh_guarded_call<int>::operator()<<lambda_69a2805e680e0e292e8ba93315fe43a8>,<lambda_f03950bc5685219e0bcd2087efbe011e> &,<lambda_03fcd07e894ec930e3f35da366ca99d6> > + 0x2f
[task 2022-08-08T21:27:36.478Z] 21:27:36 INFO - eip = 0x752fa9ac esp = 0x0500f47c ebp = 0x0500f4a8
[task 2022-08-08T21:27:36.478Z] 21:27:36 INFO - Found by: previous frame's frame pointer
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - 4 ucrtbase.dll!execute_onexit_table + 0x29
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - eip = 0x752fa97a esp = 0x0500f4b0 ebp = 0x0500f4c8
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - 5 xul.dll!scrt_dllmain_uninitialize_c() [utility.cpp : 398 + 0x9]
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - eip = 0x642982f6 esp = 0x0500f4d0 ebp = 0x0500f504
[task 2022-08-08T21:27:36.479Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.480Z] 21:27:36 INFO - 6 xul.dll!tailMerge_d3dcompiler_47.dll + 0xe530fa
[task 2022-08-08T21:27:36.480Z] 21:27:36 INFO - eip = 0x6514fb08 esp = 0x0500f4d4 ebp = 0x0500f504
[task 2022-08-08T21:27:36.480Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.480Z] 21:27:36 INFO - 7 xul.dll!dllmain_crt_dispatch(HINSTANCE* const, const unsigned long, void* const) [dll_dllmain.cpp : 139 + 0xf]
[task 2022-08-08T21:27:36.480Z] 21:27:36 INFO - eip = 0x6429939e esp = 0x0500f50c ebp = 0x0500f510
[task 2022-08-08T21:27:36.481Z] 21:27:36 INFO - Found by: previous frame's frame pointer
[task 2022-08-08T21:27:36.481Z] 21:27:36 INFO - 8 xul.dll!dllmain_dispatch(HINSTANCE* const, const unsigned long, void* const) [dll_dllmain.cpp : 212 + 0x9]
[task 2022-08-08T21:27:36.482Z] 21:27:36 INFO - eip = 0x6429947d esp = 0x0500f518 ebp = 0x0500f550
[task 2022-08-08T21:27:36.482Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.482Z] 21:27:36 INFO - 9 xul.dll!DllMainCRTStartup(HINSTANCE* const, const unsigned long, void* const) [dll_dllmain.cpp : 253 + 0xd]
[task 2022-08-08T21:27:36.482Z] 21:27:36 INFO - eip = 0x642994fc esp = 0x0500f558 ebp = 0x0500f564
[task 2022-08-08T21:27:36.483Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.483Z] 21:27:36 INFO - 10 ntdll.dll!LdrxCallInitRoutine + 0x15
[task 2022-08-08T21:27:36.483Z] 21:27:36 INFO - eip = 0x77262996 esp = 0x0500f56c ebp = 0x0500f584
[task 2022-08-08T21:27:36.483Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.483Z] 21:27:36 INFO - 11 ntdll.dll!LdrpCallInitRoutine + 0x50
[task 2022-08-08T21:27:36.484Z] 21:27:36 INFO - eip = 0x7723dd42 esp = 0x0500f58c ebp = 0x0500f5d0
[task 2022-08-08T21:27:36.484Z] 21:27:36 INFO - Found by: previous frame's frame pointer
[task 2022-08-08T21:27:36.484Z] 21:27:36 INFO - 12 ntdll.dll!LdrShutdownProcess + 0xf4
[task 2022-08-08T21:27:36.484Z] 21:27:36 INFO - eip = 0x7724d7e5 esp = 0x0500f5d8 ebp = 0x0500f668
[task 2022-08-08T21:27:36.484Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.485Z] 21:27:36 INFO - 13 ntdll.dll!RtlExitUserProcess + 0xb4
[task 2022-08-08T21:27:36.485Z] 21:27:36 INFO - eip = 0x7724d6d5 esp = 0x0500f670 ebp = 0x0500f73c
[task 2022-08-08T21:27:36.485Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.485Z] 21:27:36 INFO - 14 kernel32.dll!ExitProcessImplementation + 0x12
[task 2022-08-08T21:27:36.485Z] 21:27:36 INFO - eip = 0x75c14e23 esp = 0x0500f744 ebp = 0x0500f750
[task 2022-08-08T21:27:36.486Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.486Z] 21:27:36 INFO - 15 0x77e8f3af
[task 2022-08-08T21:27:36.486Z] 21:27:36 INFO - eip = 0x77e8f3b0 esp = 0x0500f74c ebp = 0x0500f750
[task 2022-08-08T21:27:36.486Z] 21:27:36 INFO - Found by: call frame info
[task 2022-08-08T21:27:36.486Z] 21:27:36 INFO - 16 ucrtbase.dll!exit_or_terminate_process + 0x20
[task 2022-08-08T21:27:36.487Z] 21:27:36 INFO - eip = 0x7531451d esp = 0x0500f758 ebp = 0x0500f784
[task 2022-08-08T21:27:36.487Z] 21:27:36 INFO - Found by: previous frame's frame pointer
[task 2022-08-08T21:27:36.487Z] 21:27:36 INFO - Loaded modules:
[task 2022-08-08T21:27:36.487Z] 21:27:36 INFO - 0x00460000 - 0x004a9fff plugin-container.exe 105.0.0.8255 (main)
[task 2022-08-08T21:27:36.487Z] 21:27:36 INFO - 0x5f0f0000 - 0x5f152fff fake.dll 105.0.0.8255
[task 2022-08-08T21:27:36.488Z] 21:27:36 INFO - 0x5f160000 - 0x5f17bfff dxva2.dll 10.0.19041.1
[task 2022-08-08T21:27:36.488Z] 21:27:36 INFO - 0x5f180000 - 0x66365fff xul.dll 105.0.0.8255
[task 2022-08-08T21:27:36.488Z] 21:27:36 INFO - 0x67ee0000 - 0x67ef6fff usp10.dll 10.0.19041.546
[task 2022-08-08T21:27:36.489Z] 21:27:36 INFO - 0x688f0000 - 0x689b1fff propsys.dll 7.0.19041.1023
[task 2022-08-08T21:27:36.489Z] 21:27:36 INFO - 0x70a90000 - 0x70a9cfff lgpllibs.dll 105.0.0.8255
[task 2022-08-08T21:27:36.489Z] 21:27:36 INFO - 0x70aa0000 - 0x70aa7fff wsock32.dll 10.0.19041.1
[task 2022-08-08T21:27:36.489Z] 21:27:36 INFO - 0x70ab0000 - 0x70cdcfff nss3.dll 105.0.0.8255
[task 2022-08-08T21:27:36.490Z] 21:27:36 INFO - 0x70d10000 - 0x70d23fff VCRUNTIME140.dll 14.29.30139.0
[task 2022-08-08T21:27:36.490Z] 21:27:36 INFO - 0x70d30000 - 0x70d9cfff msvcp140.dll 14.29.30139.0
[task 2022-08-08T21:27:36.490Z] 21:27:36 INFO - 0x70e30000 - 0x70edcfff mozglue.dll 105.0.0.8255
[task 2022-08-08T21:27:36.490Z] 21:27:36 INFO - 0x70fd0000 - 0x70fddfff msasn1.dll 10.0.19041.546
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x71cc0000 - 0x71cc8fff ktmw32.dll 10.0.19041.546
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x73080000 - 0x73089fff CRYPTBASE.DLL 10.0.19041.546
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x74f40000 - 0x74f47fff version.dll 10.0.19041.546
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x750b0000 - 0x752c3fff KERNELBASE.dll 10.0.19041.1415
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x752d0000 - 0x753effff ucrtbase.dll 10.0.19041.789
[task 2022-08-08T21:27:36.491Z] 21:27:36 INFO - 0x758c0000 - 0x7599dfff gdi32full.dll 10.0.19041.1387
[task 2022-08-08T21:27:36.492Z] 21:27:36 INFO - 0x75a40000 - 0x75a86fff wintrust.dll 10.0.19041.1266
[task 2022-08-08T21:27:36.492Z] 21:27:36 INFO - 0x75b90000 - 0x75beefff bcryptPrimitives.dll 10.0.19041.1415
[task 2022-08-08T21:27:36.492Z] 21:27:36 INFO - 0x75bf0000 - 0x75cdffff kernel32.dll 10.0.19041.1348
[task 2022-08-08T21:27:36.492Z] 21:27:36 INFO - 0x75cf0000 - 0x75f70fff combase.dll 10.0.19041.1348
[task 2022-08-08T21:27:36.493Z] 21:27:36 INFO - 0x75fc0000 - 0x7607efff rpcrt4.dll 10.0.19041.1288
[task 2022-08-08T21:27:36.493Z] 21:27:36 INFO - 0x76080000 - 0x760f4fff sechost.dll 10.0.19041.1415
[task 2022-08-08T21:27:36.493Z] 21:27:36 INFO - 0x76100000 - 0x761befff msvcrt.dll 7.0.19041.546
[task 2022-08-08T21:27:36.493Z] 21:27:36 INFO - 0x76780000 - 0x767fafff msvcp_win.dll 10.0.19041.789
[task 2022-08-08T21:27:36.494Z] 21:27:36 INFO - 0x76800000 - 0x768f9fff crypt32.dll 10.0.19041.1320
[task 2022-08-08T21:27:36.494Z] 21:27:36 INFO - 0x76900000 - 0x76917fff win32u.dll 10.0.19041.1387
[task 2022-08-08T21:27:36.494Z] 21:27:36 INFO - 0x76980000 - 0x769e2fff ws2_32.dll 10.0.19041.546
[task 2022-08-08T21:27:36.495Z] 21:27:36 INFO - 0x76a80000 - 0x76a98fff bcrypt.dll 10.0.19041.1023
[task 2022-08-08T21:27:36.495Z] 21:27:36 INFO - 0x76be0000 - 0x76cc2fff ole32.dll 10.0.19041.1202
[task 2022-08-08T21:27:36.495Z] 21:27:36 INFO - 0x76cd0000 - 0x76e6ffff user32.dll 10.0.19041.1415
[task 2022-08-08T21:27:36.495Z] 21:27:36 INFO - 0x76e70000 - 0x76ee9fff advapi32.dll 10.0.19041.1052
[task 2022-08-08T21:27:36.495Z] 21:27:36 INFO - 0x76ef0000 - 0x76f13fff gdi32.dll 10.0.19041.1202
[task 2022-08-08T21:27:36.496Z] 21:27:36 INFO - 0x76f20000 - 0x76f44fff imm32.dll 10.0.19041.546
[task 2022-08-08T21:27:36.496Z] 21:27:36 INFO - 0x771e0000 - 0x771e9fff wow64cpu.dll 10.0.19041.662
[task 2022-08-08T21:27:36.496Z] 21:27:36 INFO - 0x771f0000 - 0x77392fff ntdll.dll 10.0.19041.1288
[task 2022-08-08T21:27:36.496Z] 21:27:36 INFO - Unloaded modules:
[task 2022-08-08T21:27:36.496Z] 21:27:36 INFO - 0x759b0000 - 0x75a36fff shcore.dll
[task 2022-08-08T21:27:36.497Z] 21:27:36 INFO - Unimplemented streams encountered:
[task 2022-08-08T21:27:36.497Z] 21:27:36 INFO - Stream 0x00000016 ProcessVmCountersStream (Official) @ 0x0000197c
[task 2022-08-08T21:27:36.497Z] 21:27:36 INFO - Stream 0x00000000 UnusedStream (Official) @ 0x00000000
[task 2022-08-08T21:27:36.497Z] 21:27:36 INFO - Stream 0x00000015 SystemMemoryInfoStream (Official) @ 0x00001790
Assignee: nobody → apehrson
Status: NEW → ASSIGNED

TestCDMStorage runs the fake-cdm plugin in the GMP process. I found that disabling GMP sandboxing made the orange go away. And pre-loading oleaut32 for fake-cdm only helps as well.

It is unclear to me at this point what is trying to use oleaut32, but patching fake-cdm at least doesn't affect anything we ship so I consider that the way forward for now.

This patch helps with a high rate of crashes on windows x86, where the GMP
process crashes after _exit(0) while trying to delay-load oleaut32.dll.

Attachment #9290093 - Attachment description: Bug 1785030 - Pre-load oleaut32.dll for fake-cdm in GMP. r?handyman → Bug 1785030 - Pre-load oleaut32.dll for fake-cdm in GMP. r?handyman!
Pushed by pehrsons@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/813eaa914ec2
Pre-load oleaut32.dll for fake-cdm in GMP. r=media-playback-reviewers,bobowen,padenot
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 105 Branch
See Also: → 1788675
See Also: → 1788592
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: