Open Bug 1822800 Opened 2 years ago Updated 2 years ago

Intermittent [tier 2] Main app process exited normally | application crashed [@ fetch_add] AFTER WARNING: Process XX hanging at shutdown; attempting crash report (fatal error).: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/process_wa

Categories

(Core :: JavaScript Engine, defect, P5)

Product:
Core
Component:
JavaScript Engine
Type:
defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Blocks 2 open bugs)

Details

(Keywords: crash, intermittent-failure)

Crash Data

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=409116065&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HKBsCRviQz6tyGjcd6qtRg/runs/0/artifacts/public/logs/live_backing.log

[task 2023-03-16T10:51:02.811Z] 10:51:02     INFO - mozcrash Downloading symbols from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VrHqhfJ5TXG0iLuBBscBlg/artifacts/public/build/target.crashreporter-symbols.zip
[task 2023-03-16T10:51:13.151Z] 10:51:13     INFO - mozcrash Copy/paste: /builds/worker/fetches/minidump-stackwalk/minidump-stackwalk --symbols-url=https://symbols.mozilla.org/ --cyborg=/tmp/tmp40utm4zj/750a8fce-2f78-d6c6-a024-110ee6676341.trace /tmp/tmp075fbxhj.mozrunner/minidumps/750a8fce-2f78-d6c6-a024-110ee6676341.dmp /tmp/tmptu8xn9ed
[task 2023-03-16T10:51:17.869Z] 10:51:17     INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/750a8fce-2f78-d6c6-a024-110ee6676341.dmp
[task 2023-03-16T10:51:17.927Z] 10:51:17     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ fetch_add]
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Crash dump filename: /tmp/tmp075fbxhj.mozrunner/minidumps/750a8fce-2f78-d6c6-a024-110ee6676341.dmp
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Operating system: Linux
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO -                   4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - CPU: amd64
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO -      family 6 model 85 stepping 7
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO -      4 CPUs
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Linux Ubuntu 18.04 - bionic (Ubuntu 18.04.6 LTS)
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - 
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Crash reason:  SIGABRT
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Crash address: 0x0
[task 2023-03-16T10:51:17.928Z] 10:51:17     INFO - Crashing instruction: `inc qword [rip + 0x7fbafbf]`
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO - Memory accessed by instruction:
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -   0. Address: 0x00007f6a4619fb71
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -      Size: 8
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO - Process uptime: not available
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO - 
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO - Thread 0 Isolated Web Co (crashed)
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  0  libxul.so!fetch_add [atomic_base.h : 514]
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  1  libxul.so!add [Atomics.h:7954e1671be3190ab36018a2c80848b07398e0c9 : 219]
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  2  libxul.so!inc [Atomics.h:7954e1671be3190ab36018a2c80848b07398e0c9 : 245]
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  3  libxul.so!operator++ [Atomics.h:7954e1671be3190ab36018a2c80848b07398e0c9 : 343]
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  4  libxul.so!AutoEnterIteration [GCRuntime.h:7954e1671be3190ab36018a2c80848b07398e0c9 : 1405]
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.929Z] 10:51:17     INFO -  5  libxul.so!ZonesIter [PublicIterators.h:7954e1671be3190ab36018a2c80848b07398e0c9 : 37]
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -  6  libxul.so!JS::ClearKeptObjects(JSContext*) [jsapi.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 1349 + 0x8]
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      rax = 0x0fc4f9ac7a986300    rdx = 0x00007f6a309994b0
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      rcx = 0x00007f6a309994b0    rbx = 0x00007f6a2642f000
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      rsi = 0x00007ffdf1e30f08    rdi = 0x00007f6a26522100
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      rbp = 0x00007ffdf1e30ff0    rsp = 0x00007ffdf1e30fd0
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -       r8 = 0x000000000015cc56     r9 = 0x0000000000000003
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      r10 = 0x00136617f13dc3d5    r11 = 0x00000000ffffffff
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      r12 = 0x00007f6a2b043d08    r13 = 0x0000000000000000
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      r14 = 0x00007f6a26516000    r15 = 0x00007f6a2642f000
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -      rip = 0x00007f6a3e1e4bb2
[task 2023-03-16T10:51:17.930Z] 10:51:17     INFO -     Found by: given as instruction pointer in context
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -  7  libxul.so!mozilla::CycleCollectedJSContext::PerformMicroTaskCheckPoint(bool) [CycleCollectedJSContext.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 610 + 0xe]
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rbx = 0x00007f6a2642f000    rbp = 0x00007ffdf1e310b0
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31000    r12 = 0x00007f6a2b043d08
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000000
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r15 = 0x00007f6a2642f000    rip = 0x00007f6a3524bae3
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -  8  libxul.so!mozilla::CycleCollectedJSContext::AfterProcessTask(unsigned int) + 0x19
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rbx = 0x00007f6a2642f000    rbp = 0x00007ffdf1e310d0
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e310c0    r12 = 0x00007f6a2b043d08
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000001
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r15 = 0x00007f6a50879240    rip = 0x00007f6a3524c35a
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -  9  libxul.so!XPCJSContext::AfterProcessTask(unsigned int) [XPCJSContext.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 1480 + 0xa]
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rbx = 0x00007f6a2642f000    rbp = 0x00007ffdf1e311c0
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e310e0    r12 = 0x00007f6a2b043d08
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r13 = 0x0000000000000000    r14 = 0x0000000000000001
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -      r15 = 0x00007f6a50879240    rip = 0x00007f6a36362d71
[task 2023-03-16T10:51:17.931Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO - 10  libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 1276 + 0x13]
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      rbx = 0x00007ffdf1e31268    rbp = 0x00007ffdf1e31300
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e311d0    r12 = 0x00007f6a2b043d08
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      r13 = 0x0000000000000000    r14 = 0x00007ffdf1e3131f
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      r15 = 0x00007f6a50879240    rip = 0x00007f6a353cd007
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO - 11  libxul.so!NS_ProcessNextEvent(nsIThread*, bool) + 0x40
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x00007ffdf1e31330
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31310    r12 = 0x00007f6a508b0530
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      r13 = 0x00007f6a508b0510    r14 = 0x00007ffdf1e31498
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      r15 = 0x00007f6a50879240    rip = 0x00007f6a353d2c61
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO - 12  libxul.so!mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate*) [MessagePump.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 85 + 0x9]
[task 2023-03-16T10:51:17.932Z] 10:51:17     INFO -      rbx = 0x0000000000000001    rbp = 0x00007ffdf1e31370
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31340    r12 = 0x00007f6a508b0530
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      r13 = 0x00007f6a508b0510    r14 = 0x00007ffdf1e31498
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      r15 = 0x00007f6a50879240    rip = 0x00007f6a36169f7c
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO - 13  libxul.so!RunInternal [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 381]
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO - 14  libxul.so!RunHandler [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 374]
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO - 15  libxul.so!MessageLoop::Run() [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 356 + 0xb]
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      rbx = 0x00007f6a2b043d00    rbp = 0x00007ffdf1e313a0
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31380    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.933Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00007f6a50879240
[task 2023-03-16T10:51:17.934Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a360b44a6
[task 2023-03-16T10:51:17.934Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.934Z] 10:51:17     INFO - 16  libxul.so!nsBaseAppShell::Run() + 0x2f
[task 2023-03-16T10:51:17.934Z] 10:51:17     INFO -      rbx = 0x00007f6a2b043d00    rbp = 0x00007ffdf1e313c0
[task 2023-03-16T10:51:17.934Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e313b0    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00007f6a50879240
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a3b2f4500
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO - 17  libxul.so!XRE_RunAppShell() [nsEmbedFunctions.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 738 + 0x5]
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x00007ffdf1e313f0
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e313d0    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00007f6a508b0510
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a3d9671aa
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO - 18  libxul.so!mozilla::ipc::MessagePumpForChildProcess::Run(base::MessagePump::Delegate*) + 0x1d
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x00007ffdf1e31420
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31400    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.935Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00007f6a508b0510
[task 2023-03-16T10:51:17.936Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a3616a93e
[task 2023-03-16T10:51:17.936Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.936Z] 10:51:17     INFO - 19  libxul.so!RunInternal [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 381]
[task 2023-03-16T10:51:17.936Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO - 20  libxul.so!RunHandler [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 374]
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO - 21  libxul.so!MessageLoop::Run() [message_loop.cc:7954e1671be3190ab36018a2c80848b07398e0c9 : 356 + 0xb]
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x00007ffdf1e31450
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31430    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00000000508ba601
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a360b44a6
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO - 22  libxul.so!XRE_InitChildProcess(int, char**, XREChildData const*) [nsEmbedFunctions.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 673 + 0x12]
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x00007ffdf1e31700
[task 2023-03-16T10:51:17.937Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31460    r12 = 0x0000000000001803
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32858    r14 = 0x00000000508ba601
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -      r15 = 0x00000000508f7f01    rip = 0x00007f6a3d966012
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO - 23  firefox-bin!content_process_main [plugin-container.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 57]
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -     Found by: inlining
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO - 24  firefox-bin!main [nsBrowserApp.cpp:7954e1671be3190ab36018a2c80848b07398e0c9 : 353 + 0x23]
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -      rbx = 0x0000000000000012    rbp = 0x00007ffdf1e32770
[task 2023-03-16T10:51:17.938Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e31710    r12 = 0x00007ffdf1e32858
[task 2023-03-16T10:51:17.939Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32850    r14 = 0x00007ffdf1e32858
[task 2023-03-16T10:51:17.939Z] 10:51:17     INFO -      r15 = 0x00007f6a508036c0    rip = 0x000055bc7bf0afa9
[task 2023-03-16T10:51:17.939Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.939Z] 10:51:17     INFO - 25  libc.so.6!__libc_start_main [libc-start.c : 310 + 0x19]
[task 2023-03-16T10:51:17.940Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x000055bc7c00a050
[task 2023-03-16T10:51:17.940Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e32780    r12 = 0x000055bc7bf0a8b0
[task 2023-03-16T10:51:17.940Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32850    r14 = 0x0000000000000000
[task 2023-03-16T10:51:17.940Z] 10:51:17     INFO -      r15 = 0x0000000000000000    rip = 0x00007f6a50af9b97
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO - 26  firefox-bin!_start + 0x28
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO -      rbx = 0x0000000000000000    rbp = 0x0000000000000000
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO -      rsp = 0x00007ffdf1e32840    r12 = 0x000055bc7bf0a8b0
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO -      r13 = 0x00007ffdf1e32850    r14 = 0x0000000000000000
[task 2023-03-16T10:51:17.941Z] 10:51:17     INFO -      r15 = 0x0000000000000000    rip = 0x000055bc7bf0a8d9
[task 2023-03-16T10:51:17.942Z] 10:51:17     INFO -     Found by: call frame info
[task 2023-03-16T10:51:17.942Z] 10:51:17     INFO - 
[task 2023-03-16T10:51:17.942Z] 10:51:17     INFO - Thread 1 IPC I/O Child

I do not yet know if this is something directly targeting the JS engine.
The Zone Iterator sounds unlikely to have an infinite loop, as being a linear array iterator.

In the worse case it might be a quite large set of zones, but in such cases the problem is most likely in the code which is producing the garbage to be collected.

I will keep it under the radar for now, hopping that the related issue will surface and blame the code which is producing this garbage instead.

Blocks: sm-defects-intermittents, GC
Severity: -- → S4
Priority: -- → P5
You need to log in before you can comment on or make changes to this bug.