1899541 - Intermittent application crashed [@ NtUserMsgWaitForMultipleObjectsEx] | single tracking bug

Status: NEW

(Core :: Graphics: WebRender, defect)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=460130096&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cxhc20MnTbiEAEoJWnjQcg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cxhc20MnTbiEAEoJWnjQcg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2024-05-29T12:00:18.967Z] 12:00:18     INFO - REFTEST INFO | Dumping representation of sandbox which can be used for expectation annotations
[task 2024-05-29T12:00:18.967Z] 12:00:18     INFO - REFTEST INFO |     AddressSanitizer: false
[task 2024-05-29T12:00:18.969Z] 12:00:18     INFO - REFTEST INFO |     Android: false
[task 2024-05-29T12:00:18.969Z] 12:00:18     INFO - REFTEST INFO |     Android13: false
[task 2024-05-29T12:00:18.969Z] 12:00:18     INFO - REFTEST INFO |     appleSilicon: false
[task 2024-05-29T12:00:18.971Z] 12:00:18     INFO - REFTEST INFO |     cocoaWidget: false
[task 2024-05-29T12:00:18.971Z] 12:00:18     INFO - REFTEST INFO |     d3d11: false
[task 2024-05-29T12:00:18.971Z] 12:00:18     INFO - REFTEST INFO |     fission: true
[task 2024-05-29T12:00:18.972Z] 12:00:18     INFO - REFTEST INFO |     geckoview: false
[task 2024-05-29T12:00:18.972Z] 12:00:18     INFO - REFTEST INFO |     gtkWidget: false
[task 2024-05-29T12:00:18.973Z] 12:00:18     INFO - REFTEST INFO |     is64Bit: false
[task 2024-05-29T12:00:18.973Z] 12:00:18     INFO - REFTEST INFO |     isCoverageBuild: false
[task 2024-05-29T12:00:18.974Z] 12:00:18     INFO - REFTEST INFO |     isDebugBuild: false
[task 2024-05-29T12:00:18.976Z] 12:00:18     INFO - REFTEST INFO |     mozinfo: {"os": "win", "processor": "x86", "version": "10.0.22621", "os_version": "11.2009", "bits": 32, "has_sandbox": true, "display": null, "automation": true, "apple_silicon": false, "apple_catalina": false, "win10_2009": false, "win11_2009": true, "is_ubuntu": false, "arch": "x86_64", "appname": "firefox", "artifact": false, "asan": false, "bin_suffix": ".exe", "buildapp": "browser", "buildtype": "pgo", "buildtype_guess": "pgo", "cc_type": "clang-cl", "ccov": false, "crashreporter": true, "datareporting": true, "debug": false, "devedition": false, "domstreams": true, "early_beta_or_earlier": true, "healthreport": true, "isolated_process": false, "mozconfig": "/builds/worker/checkouts/gecko/.mozconfig", "nightly_build": true, "normandy": true, "official": true, "pgo": true, "platform_guess": "win32", "release_or_beta": false, "require_signing": false, "stylo": true, "sync": true, "telemetry": false, "tests_enabled": true, "toolkit": "windows", "topobjdir": "/builds/worker/workspace/obj-build", "topsrcdir": "/builds/worker/checkouts/gecko", "tsan": false, "ubsan": false, "updater": true}
[task 2024-05-29T12:00:18.976Z] 12:00:18     INFO - REFTEST INFO |     os_version: undefined
[task 2024-05-29T12:00:18.977Z] 12:00:18     INFO - REFTEST INFO |     OSX: undefined
[task 2024-05-29T12:00:18.977Z] 12:00:18     INFO - REFTEST INFO |     prefs: {}
[task 2024-05-29T12:00:18.978Z] 12:00:18     INFO - REFTEST INFO |     release_or_beta: false
[task 2024-05-29T12:00:18.978Z] 12:00:18     INFO - REFTEST INFO |     swgl: true
[task 2024-05-29T12:00:18.979Z] 12:00:18     INFO - REFTEST INFO |     ThreadSanitizer: false
[task 2024-05-29T12:00:18.979Z] 12:00:18     INFO - REFTEST INFO |     useDrawSnapshot: false
[task 2024-05-29T12:00:18.979Z] 12:00:18     INFO - REFTEST INFO |     verify: false
[task 2024-05-29T12:00:18.980Z] 12:00:18     INFO - REFTEST INFO |     wayland: false
[task 2024-05-29T12:00:18.981Z] 12:00:18     INFO - REFTEST INFO |     webrtc: true
[task 2024-05-29T12:00:18.981Z] 12:00:18     INFO - REFTEST INFO |     winWidget: true
[task 2024-05-29T12:00:18.982Z] 12:00:18     INFO - REFTEST INFO |     xulRuntime: {}
[task 2024-05-29T12:00:25.631Z] 12:00:25     INFO - REFTEST INFO | Skipping included manifest at file:///D:/task_171698144546313/build/tests/reftest/tests/layout/reftests/reftest.list line 278 due to matching skip condition
[task 2024-05-29T12:00:25.631Z] 12:00:25     INFO - REFTEST INFO | Skipping included manifest at file:///D:/task_171698144546313/build/tests/reftest/tests/layout/reftests/reftest.list line 281 due to matching skip condition
[task 2024-05-29T12:00:29.262Z] 12:00:29     INFO - 1716984029262	addons.xpi	ERROR	System addon update list error Error: Failed downloading XML, status: 0, channelStatus: 2152398861, errorCode: 2, reason: error
[task 2024-05-29T12:00:29.329Z] 12:00:29     INFO - REFTEST INFO | Slowest test took 0ms (undefined)
[task 2024-05-29T12:00:29.329Z] 12:00:29     INFO - REFTEST INFO | Total canvas count = 0
[task 2024-05-29T12:00:29.839Z] 12:00:29     INFO - 1716984029838	Marionette	TRACE	Received observer notification quit-application
[task 2024-05-29T12:00:29.840Z] 12:00:29     INFO - 1716984029838	Marionette	INFO	Stopped listening on port 2828
[task 2024-05-29T12:00:29.840Z] 12:00:29     INFO - 1716984029838	Marionette	DEBUG	Marionette stopped listening
[task 2024-05-29T12:00:42.737Z] 12:00:42     INFO - REFTEST INFO | Downloading symbols from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/W3AOmEq4RGahsVnCBdBUDg/artifacts/public/build/target.crashreporter-symbols.zip
[task 2024-05-29T12:01:02.844Z] 12:01:02     INFO - REFTEST INFO | Copy/paste: D:/task_171698144546313/fetches\minidump-stackwalk\minidump-stackwalk.exe --symbols-url=https://symbols.mozilla.org/ --cyborg=C:\Users\task_171698144546313\AppData\Local\Temp\tmpgc91v_1z\ab670c71-1ff2-4d9f-9e1f-40562df65cc8.trace C:\Users\task_171698144546313\AppData\Local\Temp\tmpolpsai_k.mozrunner\minidumps\ab670c71-1ff2-4d9f-9e1f-40562df65cc8.dmp C:\Users\task_171698144546313\AppData\Local\Temp\tmpivxp_ijw
[task 2024-05-29T12:01:35.701Z] 12:01:35     INFO - REFTEST INFO | Saved minidump as D:\task_171698144546313\build\blobber_upload_dir\ab670c71-1ff2-4d9f-9e1f-40562df65cc8.dmp
[task 2024-05-29T12:01:35.703Z] 12:01:35     INFO - REFTEST INFO | Saved app info as D:\task_171698144546313\build\blobber_upload_dir\ab670c71-1ff2-4d9f-9e1f-40562df65cc8.extra
[task 2024-05-29T12:01:35.956Z] 12:01:35     INFO - REFTEST PROCESS-CRASH | application crashed [@ NtUserMsgWaitForMultipleObjectsEx] | pid: None 
[task 2024-05-29T12:01:35.956Z] 12:01:35     INFO - Process type: gpu
[task 2024-05-29T12:01:35.956Z] 12:01:35     INFO - Process pid: 6280
[task 2024-05-29T12:01:35.956Z] 12:01:35     INFO - Crash dump filename: C:\Users\task_171698144546313\AppData\Local\Temp\tmpolpsai_k.mozrunner\minidumps\ab670c71-1ff2-4d9f-9e1f-40562df65cc8.dmp
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO - Operating system: Windows NT
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO -                   10.0.22621
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO - CPU: x86
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO -      GenuineIntel family 6 model 79 stepping 1
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO -      12 CPUs
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO - 
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO - Crash reason:  EXCEPTION_BREAKPOINT
[task 2024-05-29T12:01:35.957Z] 12:01:35     INFO - Crash address: 0x76cd5cbc
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO - Process uptime: 11 seconds
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO - 
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO - Thread 0 MainThread (crashed)
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -  0  win32u.dll!NtUserMsgWaitForMultipleObjectsEx + 0xc
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      eip = 0x76cd5cbc    esp = 0x007df0c8    ebp = 0x007df0e8    ebx = 0x00000004
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      esi = 0x00000000    edi = 0x00000000    eax = 0x00000001    ecx = 0x00000000
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      edx = 0x00000000 eflags = 0x00000202
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -     Found by: given as instruction pointer in context
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -  1  user32.dll!MsgWaitForMultipleObjectsEx + 0x50
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      eip = 0x76412e41    esp = 0x007df0cc    ebp = 0x007df0e8    ebx = 0x00000004
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      esi = 0x00000000    edi = 0x00000000
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -  2  xul.dll!mozilla::widget::WinUtils::WaitForMessage(unsigned long) [WinUtils.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 454 + 0x13]
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      eip = 0x69339dda    esp = 0x007df0f0    ebp = 0x007df134    ebx = 0x00000004
[task 2024-05-29T12:01:35.958Z] 12:01:35     INFO -      esi = 0x00000000    edi = 0x00000000
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -  3  xul.dll!nsAppShell::ProcessNextNativeEvent(bool) [nsAppShell.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 963 + 0x6]
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -      eip = 0x6a84a121    esp = 0x007df13c    ebp = 0x007df484    ebx = 0x00000020
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -      esi = 0x007df184    edi = 0x00c5e040
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -  4  xul.dll!nsBaseAppShell::DoProcessNextNativeEvent(bool) [nsBaseAppShell.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 131]
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -  5  xul.dll!nsBaseAppShell::OnProcessNextEvent(nsIThreadInternal*, bool) [nsBaseAppShell.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 267]
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -  6  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 1114]
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.959Z] 12:01:35     INFO -  7  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 480 + 0x2415]
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -      eip = 0x6a64ecad    esp = 0x007df48c    ebp = 0x007df6e0    ebx = 0x00000001
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -      esi = 0x00000000    edi = 0x6a849d30
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -  8  xul.dll!mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate*) [MessagePump.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 107 + 0xa]
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -      eip = 0x6a6811c8    esp = 0x007df6e8    ebp = 0x007df710    ebx = 0x00c50000
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -      esi = 0x00c57970    edi = 0x00c04220
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -  9  xul.dll!MessageLoop::RunInternal() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 370]
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO - 10  xul.dll!MessageLoop::RunHandler() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 363 + 0x13]
[task 2024-05-29T12:01:35.960Z] 12:01:35     INFO -      eip = 0x691320cf    esp = 0x007df718    ebp = 0x007df748    ebx = 0x69187680
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -      esi = 0x007df860    edi = 0x00c04220
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO - 11  xul.dll!MessageLoop::Run() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 345 + 0x4]
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -      eip = 0x69131f3f    esp = 0x007df750    ebp = 0x007df76c    ebx = 0x69187601
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -      esi = 0x007df750    edi = 0x00cd2800
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO - 12  xul.dll!nsBaseAppShell::Run() [nsBaseAppShell.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 148 + 0xb]
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -      eip = 0x69199445    esp = 0x007df774    ebp = 0x007df77c    ebx = 0x69187601
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -      esi = 0x00c57970    edi = 0x00cd2800
[task 2024-05-29T12:01:35.961Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO - 13  xul.dll!nsAppShell::Run() [nsAppShell.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 822 + 0x5]
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      eip = 0x691992b9    esp = 0x007df784    ebp = 0x007df7a4    ebx = 0x69187601
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      esi = 0x00cd2800    edi = 0x718f0850
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO - 14  xul.dll!XRE_RunAppShell() [nsEmbedFunctions.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 712 + 0xd]
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      eip = 0x69199262    esp = 0x007df7ac    ebp = 0x007df7c4    ebx = 0x69187680
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      esi = 0x007df860    edi = 0x00cd2800
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO - 15  xul.dll!mozilla::ipc::MessagePumpForChildProcess::Run(base::MessagePump::Delegate*) [MessagePump.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 235 + 0x4]
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      eip = 0x691876e4    esp = 0x007df7cc    ebp = 0x007df7e0    ebx = 0x69187680
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -      esi = 0x007df860    edi = 0x00c04220
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.962Z] 12:01:35     INFO - 16  xul.dll!MessageLoop::RunInternal() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 370]
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO - 17  xul.dll!MessageLoop::RunHandler() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 363 + 0x13]
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -      eip = 0x691320cf    esp = 0x007df7e8    ebp = 0x007df818    ebx = 0x69187680
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -      esi = 0x007df860    edi = 0x00c04220
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO - 18  xul.dll!MessageLoop::Run() [message_loop.cc:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 345 + 0x4]
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -      eip = 0x69131f3f    esp = 0x007df820    ebp = 0x007df83c    ebx = 0x718f0850
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -      esi = 0x007df820    edi = 0x00c04bb0
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.963Z] 12:01:35     INFO - 19  xul.dll!XRE_InitChildProcess(int, char**, XREChildData const*) [nsEmbedFunctions.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 647 + 0xa]
[task 2024-05-29T12:01:35.964Z] 12:01:35     INFO -      eip = 0x69105ada    esp = 0x007df844    ebp = 0x007df970    ebx = 0x718f0850
[task 2024-05-29T12:01:35.964Z] 12:01:35     INFO -      esi = 0x00c042e0    edi = 0x00c04bb0
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO - 20  xul.dll!mozilla::BootstrapImpl::XRE_InitChildProcess(int, char**, XREChildData const*) [Bootstrap.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 67 + 0xd]
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -      eip = 0x69105711    esp = 0x007df978    ebp = 0x007df984    ebx = 0x00c08098
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -      esi = 0x00000013    edi = 0x69105700
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO - 21  firefox.exe!content_process_main(mozilla::Bootstrap*, int, char**) [plugin-container.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 57]
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO - 22  firefox.exe!NS_internal_main(int, char**, char**) [nsBrowserApp.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 378]
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO - 23  firefox.exe!wmain(int, wchar_t**) [nsWindowsWMain.cpp:e1da1893a0c56d2752be4e6eb1efa16c58723a55 : 151 + 0x233]
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -      eip = 0x00ec151b    esp = 0x007df98c    ebp = 0x007dfaec    ebx = 0x00c08098
[task 2024-05-29T12:01:35.965Z] 12:01:35     INFO -      esi = 0x00000013    edi = 0x69105700
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO - 24  firefox.exe!invoke_main() [exe_common.inl : 90]
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -     Found by: inlining
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO - 25  firefox.exe!__scrt_common_main_seh() [exe_common.inl : 288 + 0x1b]
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      eip = 0x00ee5c3c    esp = 0x007dfaf4    ebp = 0x007dfb34    ebx = 0x0057d000
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      esi = 0x00992c80    edi = 0x00992f98
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO - 26  kernel32.dll!BaseThreadInitThunk + 0x18
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      eip = 0x76977ba9    esp = 0x007dfb3c    ebp = 0x007dfb44    ebx = 0x0057d000
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      esi = 0x00992c80    edi = 0x00992f98
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO - 27  ntdll.dll!__RtlUserThreadStart + 0x2a
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      eip = 0x771ebe3b    esp = 0x007dfb4c    ebp = 0x007dfb9c    ebx = 0x0057d000
[task 2024-05-29T12:01:35.966Z] 12:01:35     INFO -      esi = 0x00992c80    edi = 0x00992f98
[task 2024-05-29T12:01:35.967Z] 12:01:35     INFO -     Found by: call frame info
[task 2024-05-29T12:01:35.967Z] 12:01:35     INFO - 28  ntdll.dll!_RtlUserThreadStart + 0x1a
[task 2024-05-29T12:01:35.967Z] 12:01:35     INFO -      eip = 0x771ebdbf    esp = 0x007dfba4    ebp = 0x007dfbac    ebx = 0x0057d000
[task 2024-05-29T12:01:35.967Z] 12:01:35     INFO -      esi = 0x00992c80    edi = 0x00992f98
[task 2024-05-29T12:01:35.967Z] 12:01:35     INFO -     Found by: call frame info

Comment 1

[Daniel Holbert [:dholbert]]

Looks like it's a GPU process crash. Probably better to classify this under WebRender than under SVG.

The full log also shows several instances of:

Killing GPU process due to IPC reply timeout

So let's group this with bug 1858436.

Comment 2

[Timothy Nikkel (:tnikkel)]

Note that gpu process crash and "Killing GPU process due to IPC reply timeout" are different things. The latter suggests the infra issue we've been dealing with on Windows where the gpu doesn't seem to respond in a reasonable amount of time. Whereas a general gpu process crash is more likely to be fixable in our code.

Comment 3

[Daniel Holbert [:dholbert]]

(In reply to Timothy Nikkel (:tnikkel) from comment #2)

Note that gpu process crash and "Killing GPU process due to IPC reply timeout" are different things. The latter suggests the infra issue we've been dealing with on Windows where the gpu doesn't seem to respond in a reasonable amount of time. Whereas a general gpu process crash is more likely to be fixable in our code.

Agree in general -- but I think the gpu process crash here is likely still the same underlying issue (or related), because:

(1) All three of the failures so far (Not just the log in comment 0) show the known-suspicious "Killing GPU process due to IPC reply timeout" message somewhere in the log, which suggests the known infra issue is at least happening during the test run (even if it's not the explanation for the particular gpu-process-crash that TreeHerder narrows in on).

(2) It's notable that the gpu process crash here is in NtUserMsgWaitForMultipleObjectsEx (inside WaitForMessage) which is when the process is just waiting for a signal. That's typically not something that would crash, I think; a crash in this code (particularly with EXCEPTION_BREAKPOINT) suggests some sort of timeout-detection or deadlock-detection has intervened and killed the process. So even if the log doesn't explicitly show logging about this for the highlighted gpu crash, it still looks a lot like someone is effectively Killing GPU process due to [some sort of] timeout.

Comment 4

[Timothy Nikkel (:tnikkel)]

Yeah, I think we are on the same page here, this bug does seem to be the Windows gpu timeout infra issue. My comment was just intended to highlight that the timeout part is important to that classification, and a gpu process crash doesn't by itself characterize those issues.

Comment 5

[Intermittent Failures Robot]

6 failures in 4202 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• windows11-32-2009-qr: 3
  • opt: 3
• windows11-32-2009-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 6

[Intermittent Failures Robot]

9 failures in 3649 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• windows11-32-2009-qr: 6
  • opt: 6
• windows11-32-2009-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-06-03&endday=2024-06-09&tree=all

Comment 7

[Intermittent Failures Robot]

11 failures in 4625 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 4

Platform and build breakdown:

• windows11-32-2009-qr: 7
  • opt: 7
• windows11-32-2009-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-06-10&endday=2024-06-16&tree=all

Comment 8

[Intermittent Failures Robot]

4 failures in 4577 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-32-2009-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 9

[Intermittent Failures Robot]

2 failures in 4116 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• windows11-32-2009-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-06-24&endday=2024-06-30&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 3799 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr128: 1

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-07-15&endday=2024-07-21&tree=all

Comment 11

[Intermittent Failures Robot]

5 failures in 3459 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• try: 1

Platform and build breakdown:

• windows11-32-2009-qr: 4
  • opt: 4
• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-08-05&endday=2024-08-11&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 2154 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-08-12&endday=2024-08-18&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 3668 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1899541&startday=2024-09-02&endday=2024-09-08&tree=all