Closed Bug 1565642 Opened 5 years ago Closed 3 years ago

Intermittent PROCESS-CRASH | Main app process exited normally | application crashed [@ mozilla::Vector<mozilla::UniquePtr<RegisteredThread, mozilla::DefaultDelete<RegisteredThread> >, 0ul, mozilla::MallocAllocPolicy>::begin() const]

Categories

(Core :: Graphics: WebRender, defect, P3)

Product:
Core
Component:
Graphics: WebRender
Type:
defect

Tracking

()

Status:
RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: crash, intermittent-failure, regression)

Crash Data

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=256211094&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/U1xBwbCOQAmCfWoGJoTeeg/runs/0/artifacts/public/logs/live_backing.log

[task 2019-07-12T14:44:21.492Z] 14:44:21 INFO - TEST-START | dom/presentation/tests/mochitest/test_presentation_tcp_sender_establish_connection_error.html
[task 2019-07-12T14:44:32.547Z] 14:44:32 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ mozilla::Vector<mozilla::UniquePtr<RegisteredThread, mozilla::DefaultDelete<RegisteredThread> >, 0ul, mozilla::MallocAllocPolicy>::begin() const]
[task 2019-07-12T14:44:32.548Z] 14:44:32 INFO - Crash dump filename: /tmp/tmpyNRGns.mozrunner/minidumps/24f0ce22-abc2-3010-603a-23378a509c52.dmp
[task 2019-07-12T14:44:32.549Z] 14:44:32 INFO - Operating system: Linux
[task 2019-07-12T14:44:32.551Z] 14:44:32 INFO - 0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2019-07-12T14:44:32.553Z] 14:44:32 INFO - CPU: amd64
[task 2019-07-12T14:44:32.554Z] 14:44:32 INFO - family 6 model 62 stepping 4
[task 2019-07-12T14:44:32.555Z] 14:44:32 INFO - 2 CPUs
[task 2019-07-12T14:44:32.556Z] 14:44:32 INFO -
[task 2019-07-12T14:44:32.557Z] 14:44:32 INFO - GPU: UNKNOWN
[task 2019-07-12T14:44:32.558Z] 14:44:32 INFO -
[task 2019-07-12T14:44:32.559Z] 14:44:32 INFO - Crash reason: SIGSEGV /SEGV_MAPERR
[task 2019-07-12T14:44:32.560Z] 14:44:32 INFO - Crash address: 0x28
[task 2019-07-12T14:44:32.561Z] 14:44:32 INFO - Process uptime: not available
[task 2019-07-12T14:44:32.562Z] 14:44:32 INFO -
[task 2019-07-12T14:44:32.563Z] 14:44:32 INFO - Thread 1 (crashed)
[task 2019-07-12T14:44:32.564Z] 14:44:32 INFO - 0 libxul.so!mozilla::Vector<mozilla::UniquePtr<RegisteredThread, mozilla::DefaultDelete<RegisteredThread> >, 0ul, mozilla::MallocAllocPolicy>::begin() const [Vector.h:1fbc711925ba8c05f021f40aad329483413d38f6 : 495 + 0x0]
[task 2019-07-12T14:44:32.565Z] 14:44:32 INFO - rax = 0x0000000000000bd2 rdx = 0x0000000000000000
[task 2019-07-12T14:44:32.565Z] 14:44:32 INFO - rcx = 0x00007fce288134d9 rbx = 0x00007fce104e5ca0
[task 2019-07-12T14:44:32.566Z] 14:44:32 INFO - rsi = 0x0000000000000090 rdi = 0x0000000000000008
[task 2019-07-12T14:44:32.566Z] 14:44:32 INFO - rbp = 0x00007fce104e5c90 rsp = 0x00007fce104e5c48
[task 2019-07-12T14:44:32.572Z] 14:44:32 INFO - r8 = 0x0000000000000000 r9 = 0x00007fffcadcfe6f
[task 2019-07-12T14:44:32.573Z] 14:44:32 INFO - r10 = 0x0000000000000042 r11 = 0x0000000000000246
[task 2019-07-12T14:44:32.574Z] 14:44:32 INFO - r12 = 0x0000000000000008 r13 = 0x00007fffcadcfe6f
[task 2019-07-12T14:44:32.575Z] 14:44:32 INFO - r14 = 0x0000000000000000 r15 = 0x0000000000000bd2
[task 2019-07-12T14:44:32.576Z] 14:44:32 INFO - rip = 0x00007fce1983c1d4
[task 2019-07-12T14:44:32.577Z] 14:44:32 INFO - Found by: given as instruction pointer in context
[task 2019-07-12T14:44:32.578Z] 14:44:32 INFO - 1 libxul.so!FindCurrentThreadRegisteredThread(mozilla::BaseAutoLock<PSMutex&> const&) [platform.cpp:1fbc711925ba8c05f021f40aad329483413d38f6 : 2743 + 0x8]
[task 2019-07-12T14:44:32.579Z] 14:44:32 INFO - rbx = 0x00007fce104e5ca0 rbp = 0x00007fce104e5c90
[task 2019-07-12T14:44:32.580Z] 14:44:32 INFO - rsp = 0x00007fce104e5c50 r12 = 0x0000000000000008
[task 2019-07-12T14:44:32.581Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x0000000000000000
[task 2019-07-12T14:44:32.582Z] 14:44:32 INFO - r15 = 0x0000000000000bd2 rip = 0x00007fce1983ac18
[task 2019-07-12T14:44:32.583Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.585Z] 14:44:32 INFO - 2 libxul.so!profiler_unregister_thread() [platform.cpp:1fbc711925ba8c05f021f40aad329483413d38f6 : 3797 + 0x5]
[task 2019-07-12T14:44:32.586Z] 14:44:32 INFO - rbx = 0x00007fce104e5ca0 rbp = 0x00007fce104e5ce0
[task 2019-07-12T14:44:32.587Z] 14:44:32 INFO - rsp = 0x00007fce104e5ca0 r12 = 0x00007fce10892f70
[task 2019-07-12T14:44:32.588Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce10892f90
[task 2019-07-12T14:44:32.589Z] 14:44:32 INFO - r15 = 0x00000000108f4000 rip = 0x00007fce1983aaad
[task 2019-07-12T14:44:32.589Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.590Z] 14:44:32 INFO - 3 libxul.so!__rust_maybe_catch_panic [lib.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 29 + 0x5]
[task 2019-07-12T14:44:32.590Z] 14:44:32 INFO - rbx = 0x00007fce1085db30 rbp = 0x00007fce104e5dd0
[task 2019-07-12T14:44:32.591Z] 14:44:32 INFO - rsp = 0x00007fce104e5cf0 r12 = 0x00007fce10892f70
[task 2019-07-12T14:44:32.591Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce10892f90
[task 2019-07-12T14:44:32.592Z] 14:44:32 INFO - r15 = 0x00000000108f4000 rip = 0x00007fce1b4ee279
[task 2019-07-12T14:44:32.592Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.593Z] 14:44:32 INFO - 4 libxul.so!rayon_core::registry::main_loop [panicking.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 272 + 0x6]
[task 2019-07-12T14:44:32.593Z] 14:44:32 INFO - rbx = 0x00007fce1085db30 rbp = 0x00007fce104e5dd0
[task 2019-07-12T14:44:32.594Z] 14:44:32 INFO - rsp = 0x00007fce104e5d00 r12 = 0x00007fce10892f70
[task 2019-07-12T14:44:32.594Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce10892f90
[task 2019-07-12T14:44:32.594Z] 14:44:32 INFO - r15 = 0x00000000108f4000 rip = 0x00007fce1b45fff4
[task 2019-07-12T14:44:32.595Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.595Z] 14:44:32 INFO - 5 libxul.so!std::panicking::try::do_call [mod.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 470 + 0x18]
[task 2019-07-12T14:44:32.596Z] 14:44:32 INFO - rbx = 0x00007fce104e5e80 rbp = 0x00007fce104e5e00
[task 2019-07-12T14:44:32.596Z] 14:44:32 INFO - rsp = 0x00007fce104e5de0 r12 = 0x00007fce104e5e80
[task 2019-07-12T14:44:32.597Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce104e5e20
[task 2019-07-12T14:44:32.597Z] 14:44:32 INFO - r15 = 0x00007fce1e461ce0 rip = 0x00007fce1b465020
[task 2019-07-12T14:44:32.597Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.598Z] 14:44:32 INFO - 6 libxul.so!__rust_maybe_catch_panic [lib.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 29 + 0x5]
[task 2019-07-12T14:44:32.598Z] 14:44:32 INFO - rbx = 0x00007fce104e5e80 rbp = 0x00007fce104e5e70
[task 2019-07-12T14:44:32.599Z] 14:44:32 INFO - rsp = 0x00007fce104e5e10 r12 = 0x00007fce104e5e80
[task 2019-07-12T14:44:32.599Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce104e5e20
[task 2019-07-12T14:44:32.599Z] 14:44:32 INFO - r15 = 0x00007fce1e461ce0 rip = 0x00007fce1b4ee279
[task 2019-07-12T14:44:32.599Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.600Z] 14:44:32 INFO - 7 libxul.so!core::ops::function::FnOnce::call_once{{vtable.shim}} [function.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 231 + 0x80]
[task 2019-07-12T14:44:32.600Z] 14:44:32 INFO - rbx = 0x00007fce104e5e80 rbp = 0x00007fce104e5e70
[task 2019-07-12T14:44:32.600Z] 14:44:32 INFO - rsp = 0x00007fce104e5e20 r12 = 0x00007fce104e5e80
[task 2019-07-12T14:44:32.601Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce104e5e20
[task 2019-07-12T14:44:32.601Z] 14:44:32 INFO - r15 = 0x00007fce1e461ce0 rip = 0x00007fce1b460e90
[task 2019-07-12T14:44:32.601Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.601Z] 14:44:32 INFO - 8 libxul.so!<alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once [boxed.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 704 + 0x2e]
[task 2019-07-12T14:44:32.602Z] 14:44:32 INFO - rbx = 0x00007fce104e5e80 rbp = 0x00007fce104e5ed0
[task 2019-07-12T14:44:32.602Z] 14:44:32 INFO - rsp = 0x00007fce104e5e80 r12 = 0x0000000000000030
[task 2019-07-12T14:44:32.603Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce108aab20
[task 2019-07-12T14:44:32.603Z] 14:44:32 INFO - r15 = 0x00007fce1e461ce0 rip = 0x00007fce1b4bf70f
[task 2019-07-12T14:44:32.604Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.604Z] 14:44:32 INFO - 9 libxul.so!std::sys::unix::thread::Thread::new::thread_start [thread.rs:a53f9df32fbb0b5f4382caaad8f1a46f36ea887c : 79 + 0x86]
[task 2019-07-12T14:44:32.605Z] 14:44:32 INFO - rbx = 0x00007fce299df000 rbp = 0x0000000000000000
[task 2019-07-12T14:44:32.605Z] 14:44:32 INFO - rsp = 0x00007fce104e5ee0 r12 = 0x0000000000000000
[task 2019-07-12T14:44:32.606Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce108ab0a0
[task 2019-07-12T14:44:32.606Z] 14:44:32 INFO - r15 = 0x00007fffcadcff70 rip = 0x00007fce1b4ed180
[task 2019-07-12T14:44:32.607Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.607Z] 14:44:32 INFO - 10 libpthread-2.23.so + 0x76ba
[task 2019-07-12T14:44:32.608Z] 14:44:32 INFO - rbx = 0x0000000000000000 rbp = 0x0000000000000000
[task 2019-07-12T14:44:32.608Z] 14:44:32 INFO - rsp = 0x00007fce104e5f20 r12 = 0x0000000000000000
[task 2019-07-12T14:44:32.609Z] 14:44:32 INFO - r13 = 0x00007fffcadcfe6f r14 = 0x00007fce104e69c0
[task 2019-07-12T14:44:32.609Z] 14:44:32 INFO - r15 = 0x00007fffcadcff70 rip = 0x00007fce297906ba
[task 2019-07-12T14:44:32.609Z] 14:44:32 INFO - Found by: call frame info
[task 2019-07-12T14:44:32.610Z] 14:44:32 INFO - 11 libc-2.23.so + 0x10741d
[task 2019-07-12T14:44:32.611Z] 14:44:32 INFO - rsp = 0x00007fce104e5fc0 rip = 0x00007fce2881941d
[task 2019-07-12T14:44:32.611Z] 14:44:32 INFO - Found by: stack scanning

Looks like a crash in Gecko Profiler code (profiler_unregister_thread calling into FindCurrentThreadRegisteredThread which is then doing something illegal/crashy with a Vector).

Reclassifying to Gecko Profiler component.

Component: Layout → Gecko Profiler

I think this is similar to the WR crashes Nical has been looking at recently. profiler_unregister_thread is just the function that Style / WebRender threads use to register themselves with the profiler.

It's a pity that we don't know which of the two rayon thread-pools is it, since it looks like either gecko_profiler_unregister_thread and Gecko_UnregisterProfilerThread has been inlined.

Nical, I suspect given your recent changes and that this is only happening on QR builds that this is WebRender related. Does this ring a bell?

Component: Gecko Profiler → Graphics: WebRender
Flags: needinfo?(nical.bugzilla)
Type: -- → defect

My recent patches did not fully fix the shutdown issues so this could be the same problem. Hard to know for sure from the stack trace as you pointed out.

Flags: needinfo?(nical.bugzilla)
See Also: → 1557208

The priority flag is not set for this bug.
:jbonisteel, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(jbonisteel)
Flags: needinfo?(jbonisteel)
Priority: -- → P3

Marking this as Resolved > Worksforme since there are no more crashes in the last 6 months with this signature.

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.