Closed Bug 1321540 Opened 9 years ago Closed 6 years ago

Intermittent devtools/shared/heapsnapshot/tests/mochitest/test_saveHeapSnapshot_e10s_01.html | application terminated with exit code 1 AFTER ABORT: Aborting on channel error.: file MessageChannel.cpp, line 2155

Categories

(Core :: Networking: Cache, defect, P3)

Product:
Core
Component:
Networking: Cache
Type:
defect

Tracking

()

Status:
RESOLVED WORKSFORME

People

(Reporter: aryx, Unassigned)

References

Details

(Keywords: intermittent-failure, Whiteboard: [necko-backlog])

https://treeherder.mozilla.org/logviewer.html#?job_id=7564331&repo=autoland 03:52:43 INFO - TEST-START | devtools/shared/heapsnapshot/tests/mochitest/test_saveHeapSnapshot_e10s_01.html 03:52:43 INFO - ++DOMWINDOW == 7 (0x1274c8000) [pid = 2147] [serial = 7] [outer = 0x1274cb000] 03:52:43 INFO - [Child 2147] ###!!! ABORT: Aborting on channel error.: file /builds/slave/autoland-m64-d-000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 2155 03:53:16 INFO - #01: mozilla::ipc::ProcessLink::OnChannelError() [xpcom/glue/Monitor.h:36] 03:53:16 INFO - 03:53:16 INFO - #02: event_base_loop [ipc/chromium/src/third_party/libevent/event.c:1355] 03:53:16 INFO - 03:53:16 INFO - #03: base::MessagePumpLibevent::Run(base::MessagePump::Delegate*) [ipc/chromium/src/base/message_pump_libevent.cc:372] 03:53:16 INFO - 03:53:16 INFO - #04: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:490] 03:53:16 INFO - 03:53:16 INFO - #05: base::Thread::ThreadMain() [ipc/chromium/src/base/thread.cc:183] 03:53:16 INFO - 03:53:16 INFO - #06: ThreadFunc [ipc/chromium/src/base/platform_thread_posix.cc:38] 03:53:16 INFO - 03:53:16 INFO - #07: libsystem_pthread.dylib + 0x405a 03:53:16 INFO - 03:53:16 INFO - #08: libsystem_pthread.dylib + 0x3fd7 03:53:16 INFO - 03:53:16 INFO - [Child 2147] ###!!! ABORT: Aborting on channel error.: file /builds/slave/autoland-m64-d-000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 2155 03:53:16 INFO - Hit MOZ_CRASH() at /builds/slave/autoland-m64-d-000000000000000/build/src/memory/mozalloc/mozalloc_abort.cpp:33 03:53:16 INFO - ** Unknown exception behavior: -2147483647 03:53:16 INFO - TEST-INFO | Main app process: exit 1 03:53:16 INFO - Buffered messages finished 03:53:16 ERROR - TEST-UNEXPECTED-FAIL | devtools/shared/heapsnapshot/tests/mochitest/test_saveHeapSnapshot_e10s_01.html | application terminated with exit code 1 03:53:16 INFO - runtests.py | Application ran for: 0:00:40.722158 03:53:16 INFO - zombiecheck | Reading PID log: /var/folders/hm/9qlv5fh54ms08d6djtv3wf9r00000w/T/tmpdTYLUipidlog 03:53:16 INFO - ==> process 2146 launched child process 2147 03:53:16 INFO - zombiecheck | Checking for orphan process with PID: 2147 03:53:16 INFO - mozcrash Copy/paste: /builds/slave/test/build/macosx64-minidump_stackwalk /var/folders/hm/9qlv5fh54ms08d6djtv3wf9r00000w/T/tmpjKizfZ.mozrunner/minidumps/A41AB295-D66C-4295-A064-62C4860EE79F.dmp /builds/slave/test/build/symbols 03:53:31 INFO - mozcrash Saved minidump as /builds/slave/test/build/blobber_upload_dir/A41AB295-D66C-4295-A064-62C4860EE79F.dmp 03:53:31 INFO - mozcrash Saved app info as /builds/slave/test/build/blobber_upload_dir/A41AB295-D66C-4295-A064-62C4860EE79F.extra 03:53:32 INFO - PROCESS-CRASH | devtools/shared/heapsnapshot/tests/mochitest/test_saveHeapSnapshot_e10s_01.html | application crashed [@ nsQueryInterface::operator()(nsID const&, void**) const] 03:53:32 INFO - Crash dump filename: /var/folders/hm/9qlv5fh54ms08d6djtv3wf9r00000w/T/tmpjKizfZ.mozrunner/minidumps/A41AB295-D66C-4295-A064-62C4860EE79F.dmp 03:53:32 INFO - Operating system: Mac OS X 03:53:32 INFO - 10.10.5 14F27 03:53:32 INFO - CPU: amd64 03:53:32 INFO - family 6 model 69 stepping 1 03:53:32 INFO - 4 CPUs 03:53:32 INFO - 03:53:32 INFO - GPU: UNKNOWN 03:53:32 INFO - 03:53:32 INFO - Crash reason: EXC_BAD_ACCESS / EXC_I386_GPFLT 03:53:32 INFO - Crash address: 0x0 03:53:32 INFO - Process uptime: 8 seconds 03:53:32 INFO - 03:53:32 INFO - Thread 18 (crashed) 03:53:32 INFO - 0 XUL!nsQueryInterface::operator()(nsID const&, void**) const [nsCOMPtr.cpp:e36b4963793f : 14 + 0x3] 03:53:32 INFO - rax = 0xe5e5e5e5e5e5e5e5 rdx = 0x0000000111ceb858 03:53:32 INFO - rcx = 0x000000010228fec0 rbx = 0x000000012a7b25c8 03:53:32 INFO - rsi = 0x0000000107f050c0 rdi = 0x00000001249f4b70 03:53:32 INFO - rbp = 0x0000000111ceb840 rsp = 0x0000000111ceb840 03:53:32 INFO - r8 = 0x0000000000000000 r9 = 0x000000000000000e 03:53:32 INFO - r10 = 0xffffffffffffffff r11 = 0x0000000000000246 03:53:32 INFO - r12 = 0x000000012a95ae00 r13 = 0x000000012a7b25c8 03:53:32 INFO - r14 = 0x000000012a95ae00 r15 = 0x0000000000000000 03:53:32 INFO - rip = 0x00000001026fbfaf 03:53:32 INFO - Found by: given as instruction pointer in context 03:53:32 INFO - 1 XUL!nsCOMPtr<nsIInputStream>::Assert_NoQueryNeeded() [nsCOMPtr.h:e36b4963793f : 1121 + 0x14] 03:53:32 INFO - rbx = 0x000000012a7b25c8 rbp = 0x0000000111ceb870 03:53:32 INFO - rsp = 0x0000000111ceb850 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x000000012a7b25c8 r14 = 0x000000012a95ae00 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102600048 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 2 XUL!mozilla::net::nsHttpChannel::OpenCacheInputStream(nsICacheEntry*, bool, bool) [nsHttpChannel.cpp:e36b4963793f : 4597 + 0x13] 03:53:32 INFO - rbx = 0x0000000109061858 rbp = 0x0000000111ceb900 03:53:32 INFO - rsp = 0x0000000111ceb880 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x000000012a7b25c8 r14 = 0x000000012a95ae00 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102b07407 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 3 XUL!mozilla::net::nsHttpChannel::OnCacheEntryCheck(nsICacheEntry*, nsIApplicationCache*, unsigned int*) [nsHttpChannel.cpp:e36b4963793f : 4083 + 0x11] 03:53:32 INFO - rbx = 0x000000012a7b2000 rbp = 0x0000000111cebbd0 03:53:32 INFO - rsp = 0x0000000111ceb910 r12 = 0x0000000000000000 03:53:32 INFO - r13 = 0x0000000000000000 r14 = 0x000000012a95ae00 03:53:32 INFO - r15 = 0x0000000109061858 rip = 0x0000000102b063ae 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 4 XUL!mozilla::net::CacheEntry::InvokeCallback(mozilla::net::CacheEntry::Callback&) [CacheEntry.cpp:e36b4963793f : 750 + 0xf] 03:53:32 INFO - rbx = 0x000000012a95ae01 rbp = 0x0000000111cebc20 03:53:32 INFO - rsp = 0x0000000111cebbe0 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x000000012a95ae00 r14 = 0x0000000111cebcb8 03:53:32 INFO - r15 = 0x000000012a95ae40 rip = 0x00000001029d5ae3 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 5 XUL!mozilla::net::CacheEntry::InvokeCallback(mozilla::net::CacheEntry::Callback&) [CacheEntry.cpp:e36b4963793f : 808 + 0xb] 03:53:32 INFO - rbx = 0x000000012a95ae01 rbp = 0x0000000111cebc70 03:53:32 INFO - rsp = 0x0000000111cebc30 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x000000012a95ae00 r14 = 0x0000000111cebcb8 03:53:32 INFO - r15 = 0x000000012a95ae40 rip = 0x00000001029d5d40 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 6 XUL!mozilla::net::CacheEntry::InvokeCallbacks(bool) [CacheEntry.cpp:e36b4963793f : 679 + 0xb] 03:53:32 INFO - rbx = 0x000000012a95ae68 rbp = 0x0000000111cebd20 03:53:32 INFO - rsp = 0x0000000111cebc80 r12 = 0x0000000000000000 03:53:32 INFO - r13 = 0x000000012a95ae00 r14 = 0x0000000000000000 03:53:32 INFO - r15 = 0x0000000111cebcb8 rip = 0x00000001029d53e5 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 7 XUL!mozilla::net::CacheEntry::InvokeCallbacks() [CacheEntry.cpp:e36b4963793f : 620 + 0xa] 03:53:32 INFO - rbx = 0x000000012a95ae00 rbp = 0x0000000111cebd40 03:53:32 INFO - rsp = 0x0000000111cebd30 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000000000004 03:53:32 INFO - r15 = 0x0000000000000008 rip = 0x00000001029d2f5f 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 8 XUL!mozilla::net::CacheEntry::BackgroundOp(unsigned int, bool) [CacheEntry.cpp:e36b4963793f : 1849 + 0x8] 03:53:32 INFO - rbx = 0x0000000000000000 rbp = 0x0000000111cebd90 03:53:32 INFO - rsp = 0x0000000111cebd50 r12 = 0x000000012a95ae00 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000000000004 03:53:32 INFO - r15 = 0x0000000000000008 rip = 0x00000001029d372a 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 9 XUL!mozilla::net::CacheEntry::Run() [CacheEntry.cpp:e36b4963793f : 1567 + 0x8] 03:53:32 INFO - rbx = 0x000000012a95ae00 rbp = 0x0000000111cebdb0 03:53:32 INFO - rsp = 0x0000000111cebda0 r12 = 0x0000000000000000 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x000000012a95ae40 03:53:32 INFO - r15 = 0x0000000000000008 rip = 0x00000001029dbb09 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 10 XUL!non-virtual thunk to mozilla::net::CacheEntry::Run() [CacheEntry.cpp:e36b4963793f : 1561 + 0x9] 03:53:32 INFO - rbx = 0x0000000113182900 rbp = 0x0000000111cebdc0 03:53:32 INFO - rsp = 0x0000000111cebdc0 r12 = 0x0000000000000000 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000000000000 03:53:32 INFO - r15 = 0x0000000000000008 rip = 0x00000001029dbb8d 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 11 XUL!mozilla::net::CacheIOThread::LoopOneLevel(unsigned int) [CacheIOThread.cpp:e36b4963793f : 553 + 0x6] 03:53:32 INFO - rbx = 0x0000000113182900 rbp = 0x0000000111cebe50 03:53:32 INFO - rsp = 0x0000000111cebdd0 r12 = 0x0000000000000000 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000000000000 03:53:32 INFO - r15 = 0x0000000000000008 rip = 0x0000000102a12c7f 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 12 XUL!mozilla::net::CacheIOThread::ThreadFunc() [CacheIOThread.cpp:e36b4963793f : 491 + 0x8] 03:53:32 INFO - rbx = 0x0000000113182900 rbp = 0x0000000111cebea0 03:53:32 INFO - rsp = 0x0000000111cebe60 r12 = 0x0000000111cebe78 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000113182918 03:53:32 INFO - r15 = 0x0000000113182938 rip = 0x0000000102a12808 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 13 XUL!mozilla::net::CacheIOThread::ThreadFunc(void*) [CacheIOThread.cpp:e36b4963793f : 434 + 0x8] 03:53:32 INFO - rbx = 0x0000000113182900 rbp = 0x0000000111cebec0 03:53:32 INFO - rsp = 0x0000000111cebeb0 r12 = 0x000000000000691b 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000111cec000 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102a122c4 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 14 libnss3.dylib!_pt_root [ptthread.c:e36b4963793f : 216 + 0x3] 03:53:32 INFO - rbx = 0x000000010228fec0 rbp = 0x0000000111cebef0 03:53:32 INFO - rsp = 0x0000000111cebed0 r12 = 0x000000000000691b 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x0000000111cec000 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102441170 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 15 libsystem_pthread.dylib!_pthread_body + 0x83 03:53:32 INFO - rbx = 0x0000000111cec000 rbp = 0x0000000111cebf10 03:53:32 INFO - rsp = 0x0000000111cebf00 r12 = 0x000000000000691b 03:53:32 INFO - r13 = 0x00000000000008ff r14 = 0x000000010228fec0 03:53:32 INFO - r15 = 0x0000000102441050 rip = 0x00007fff9795b05a 03:53:32 INFO - Found by: call frame info 03:53:32 INFO - 16 libsystem_pthread.dylib!_pthread_start + 0xb0 03:53:32 INFO - rbp = 0x0000000111cebf50 rsp = 0x0000000111cebf20 03:53:32 INFO - rip = 0x00007fff9795afd7 03:53:32 INFO - Found by: previous frame's frame pointer 03:53:32 INFO - 17 libsystem_pthread.dylib!thread_start + 0xd 03:53:32 INFO - rbp = 0x0000000111cebf78 rsp = 0x0000000111cebf60 03:53:32 INFO - rip = 0x00007fff979583ed 03:53:32 INFO - Found by: previous frame's frame pointer 03:53:32 INFO - 18 libnss3.dylib + 0x141050 03:53:32 INFO - rsp = 0x0000000111cec030 rip = 0x0000000102441050 03:53:32 INFO - Found by: stack scanning
I think the IPC abort is just the child noticing that the parent crashed, which would be the stack trace at the end of comment #0, which looks like Necko.
Component: IPC → Networking: Cache
Honza, can you take a look?
Flags: needinfo?(honzab.moz)
Whiteboard: [necko-active]
See Also: → 1322307
> 03:53:32 INFO - 1 XUL!nsCOMPtr<nsIInputStream>::Assert_NoQueryNeeded() > [nsCOMPtr.h:e36b4963793f : 1121 + 0x14] > 03:53:32 INFO - rbx = 0x000000012a7b25c8 rbp = 0x0000000111ceb870 > 03:53:32 INFO - rsp = 0x0000000111ceb850 r12 = 0x000000012a95ae00 > 03:53:32 INFO - r13 = 0x000000012a7b25c8 r14 = 0x000000012a95ae00 > 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102600048 > 03:53:32 INFO - Found by: call frame info > 03:53:32 INFO - 2 > XUL!mozilla::net::nsHttpChannel::OpenCacheInputStream(nsICacheEntry*, bool, > bool) [nsHttpChannel.cpp:e36b4963793f : 4597 + 0x13] > 03:53:32 INFO - rbx = 0x0000000109061858 rbp = 0x0000000111ceb900 > 03:53:32 INFO - rsp = 0x0000000111ceb880 r12 = 0x000000012a95ae00 > 03:53:32 INFO - r13 = 0x000000012a7b25c8 r14 = 0x000000012a95ae00 > 03:53:32 INFO - r15 = 0x0000000000000000 rip = 0x0000000102b07407 > 03:53:32 INFO - Found by: call frame info It's mCacheInputStream.takeOver(stream); How it happen to not be something implementing an input stream is totally unclear. This could be anything, but it's pretty much mysterious. I don't know how to move forward here w/o being able to reproduce this. The revision is: https://hg.mozilla.org/integration/autoland/rev/e36b4963793fe08d4c6f7d02a6fe753a72a0c86a and it was OS X 10.10 debug M(1) test. I did a retrigger, but this apparently happened just once since filed.
Flags: needinfo?(honzab.moz)
Whiteboard: [necko-active] → [necko-backlog]
Couldn't repro on the push after several retriggers. I leave it open to catch this when it happens again. But w/o more info it;s hard to proceed.
Bulk change to priority: https://bugzilla.mozilla.org/show_bug.cgi?id=1399258
Priority: -- → P1
Priority: P1 → P3
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.