1545738 - Intermittent netwerk/test/crashtests/1274044-1.html | application crashed [...]

Status: RESOLVED WORKSFORME

(Toolkit :: Crash Reporting, defect, P3)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: csabou [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=241393729&repo=autoland

https://queue.taskcluster.net/v1/task/aWjS9ciRQ-63-WuIYAPxzQ/runs/1/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/aWjS9ciRQ-63-WuIYAPxzQ/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

08:00:33 INFO - REFTEST PROCESS-CRASH | file:///Users/cltbld/tasks/task_1555659882/build/tests/reftest/tests/netwerk/test/crashtests/1274044-1.html | application crashed [@ libsystem_kernel.dylib + 0x16166]
08:00:33 INFO - Crash dump filename: /var/folders/1q/7d80st5x7tj8fwt65bwx98jw00000x/T/tmpTiiY94.mozrunner/minidumps/57F00006-0EEA-477A-A1BC-E44FF9593953-browser.dmp
08:00:33 INFO - Operating system: Mac OS X
08:00:33 INFO - 10.10.5 14F27
08:00:33 INFO - CPU: amd64
08:00:33 INFO - family 6 model 69 stepping 1
08:00:33 INFO - 4 CPUs
08:00:33 INFO -
08:00:33 INFO - GPU: UNKNOWN
08:00:33 INFO -
08:00:33 INFO - Crash reason: EXC_BREAKPOINT / EXC_I386_BPT
08:00:33 INFO - Crash address: 0x7fff909cb166
08:00:33 INFO - Process uptime: 786 seconds
08:00:33 INFO -
08:00:33 INFO - Thread 0 (crashed)
08:00:33 INFO - 0 libsystem_kernel.dylib + 0x16166
08:00:33 INFO - rax = 0x000000000200012d rdx = 0x0000000000000000
08:00:33 INFO - rcx = 0x00007fff5c61f908 rbx = 0x0000000000000203
08:00:33 INFO - rsi = 0x0000000000000203 rdi = 0x00007fff5c61fce0
08:00:33 INFO - rbp = 0x00007fff5c61f990 rsp = 0x00007fff5c61f908
08:00:33 INFO - r8 = 0x0000000000002060 r9 = 0x0000000000000000
08:00:33 INFO - r10 = 0x0000000000000eda r11 = 0x0000000000000246
08:00:33 INFO - r12 = 0x00007fff5c61fcf8 r13 = 0x0000000000000203
08:00:33 INFO - r14 = 0x0000000000000000 r15 = 0x00007fff5c61fce0
08:00:33 INFO - rip = 0x00007fff909cb166
08:00:33 INFO - Found by: given as instruction pointer in context
08:00:33 INFO - 1 XUL!google_breakpad::ExceptionHandler::WriteMinidump(bool) [exception_handler.cc:0160424142d14988f7b30595e03f156c31278a42 : 300 + 0x5]
08:00:33 INFO - rbp = 0x00007fff5c61fc20 rsp = 0x00007fff5c61f9a0
08:00:33 INFO - rip = 0x0000000109070bb6
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 2 XUL!google_breakpad::ExceptionHandler::WriteMinidump(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool, bool (*)(char const*, char const*, void*, bool), void*) [exception_handler.cc:0160424142d14988f7b30595e03f156c31278a42 : 315 + 0xa]
08:00:33 INFO - rbp = 0x00007fff5c61fd50 rsp = 0x00007fff5c61fc30
08:00:33 INFO - rip = 0x0000000109070cdd
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 3 XUL!CrashReporter::CreateMinidumpsAndPair(unsigned int, unsigned int, nsTSubstring<char> const&, nsIFile*, nsIFile**) [nsExceptionHandler.cpp:0160424142d14988f7b30595e03f156c31278a42 : 3529 + 0x19]
08:00:33 INFO - rbp = 0x00007fff5c61fde0 rsp = 0x00007fff5c61fd60
08:00:33 INFO - rip = 0x000000010906c9bd
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 4 XUL!bool mozilla::ipc::CrashReporterHost::GenerateMinidumpAndPair<mozilla::dom::ContentParent>(mozilla::dom::ContentParent*, nsIFile*, nsTSubstring<char> const&) [CrashReporterHost.h:0160424142d14988f7b30595e03f156c31278a42 : 73 + 0xe]
08:00:33 INFO - rbp = 0x00007fff5c61fe20 rsp = 0x00007fff5c61fdf0
08:00:33 INFO - rip = 0x0000000107425e6c
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 5 XUL!mozilla::dom::ContentParent::GeneratePairedMinidump(char const*) [ContentParent.cpp:0160424142d14988f7b30595e03f156c31278a42 : 3356 + 0xa]
08:00:33 INFO - rbp = 0x00007fff5c61fee0 rsp = 0x00007fff5c61fe30
08:00:33 INFO - rip = 0x0000000107425ce6
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 6 XUL!mozilla::dom::ContentParent::KillHard(char const*) [ContentParent.cpp:0160424142d14988f7b30595e03f156c31278a42 : 3377 + 0xb]
08:00:33 INFO - rbp = 0x00007fff5c61ff50 rsp = 0x00007fff5c61fef0
08:00:33 INFO - rip = 0x0000000107419788
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 7 XUL!mozilla::dom::(anonymous namespace)::KillContentParentRunnable::Run() [ClientSourceParent.cpp:0160424142d14988f7b30595e03f156c31278a42 : 46 + 0x15]
08:00:33 INFO - rbp = 0x00007fff5c61ff70 rsp = 0x00007fff5c61ff60
08:00:33 INFO - rip = 0x000000010695a337
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 8 XUL!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:0160424142d14988f7b30595e03f156c31278a42 : 1180 + 0x6]
08:00:33 INFO - rbp = 0x00007fff5c620480 rsp = 0x00007fff5c61ff80
08:00:33 INFO - rip = 0x0000000103d2d9e0
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 9 XUL!NS_ProcessPendingEvents(nsIThread*, unsigned int) [nsThreadUtils.cpp:0160424142d14988f7b30595e03f156c31278a42 : 434 + 0xe]
08:00:33 INFO - rbp = 0x00007fff5c6204d0 rsp = 0x00007fff5c620490
08:00:33 INFO - rip = 0x0000000103d2a8f1
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 10 XUL!nsBaseAppShell::NativeEventCallback() [nsBaseAppShell.cpp:0160424142d14988f7b30595e03f156c31278a42 : 87 + 0x14]
08:00:33 INFO - rbp = 0x00007fff5c620500 rsp = 0x00007fff5c6204e0
08:00:33 INFO - rip = 0x00000001078a333f
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 11 XUL!nsAppShell::ProcessGeckoEvents(void*) [nsAppShell.mm:0160424142d14988f7b30595e03f156c31278a42 : 439 + 0x8]
08:00:33 INFO - rbp = 0x00007fff5c620560 rsp = 0x00007fff5c620510
08:00:33 INFO - rip = 0x000000010791ac29
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 12 CoreFoundation + 0x80a01
08:00:33 INFO - rbp = 0x00007fff5c620570 rsp = 0x00007fff5c620570
08:00:33 INFO - rip = 0x00007fff8ceafa01
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 13 CoreFoundation + 0x72b8d
08:00:33 INFO - rbp = 0x00007fff5c6205d0 rsp = 0x00007fff5c620580
08:00:33 INFO - rip = 0x00007fff8cea1b8d
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 14 CoreFoundation + 0x721bf
08:00:33 INFO - rbp = 0x00007fff5c6212b0 rsp = 0x00007fff5c6205e0
08:00:33 INFO - rip = 0x00007fff8cea11bf
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 15 CoreFoundation + 0x71bd8
08:00:33 INFO - rbp = 0x00007fff5c621310 rsp = 0x00007fff5c6212c0
08:00:33 INFO - rip = 0x00007fff8cea0bd8
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 16 HIToolbox + 0x3256f
08:00:33 INFO - rbp = 0x00007fff5c621350 rsp = 0x00007fff5c621320
08:00:33 INFO - rip = 0x00007fff9352a56f
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 17 HIToolbox + 0x322ea
08:00:33 INFO - rbp = 0x00007fff5c6213d0 rsp = 0x00007fff5c621360
08:00:33 INFO - rip = 0x00007fff9352a2ea
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 18 HIToolbox + 0x3212b
08:00:33 INFO - rbp = 0x00007fff5c6213f0 rsp = 0x00007fff5c6213e0
08:00:33 INFO - rip = 0x00007fff9352a12b
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 19 AppKit + 0x918ab
08:00:33 INFO - rbp = 0x00007fff5c621860 rsp = 0x00007fff5c621400
08:00:33 INFO - rip = 0x00007fff8de7a8ab
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 20 AppKit + 0x90e58
08:00:33 INFO - rbp = 0x00007fff5c621b00 rsp = 0x00007fff5c621870
08:00:33 INFO - rip = 0x00007fff8de79e58
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 21 XUL!-[GeckoNSApplication nextEventMatchingMask:untilDate:inMode:dequeue:] [nsAppShell.mm:0160424142d14988f7b30595e03f156c31278a42 : 168 + 0x2c]
08:00:33 INFO - rbp = 0x00007fff5c621b70 rsp = 0x00007fff5c621b10
08:00:33 INFO - rip = 0x0000000107919bce
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 22 AppKit + 0x86af3
08:00:33 INFO - rbp = 0x00007fff5c621bf0 rsp = 0x00007fff5c621b80
08:00:33 INFO - rip = 0x00007fff8de6faf3
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 23 XUL!nsAppShell::Run() [nsAppShell.mm:0160424142d14988f7b30595e03f156c31278a42 : 702 + 0x1a]
08:00:33 INFO - rbp = 0x00007fff5c621c40 rsp = 0x00007fff5c621c00
08:00:33 INFO - rip = 0x000000010791b5bf
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 24 XUL!nsAppStartup::Run() [nsAppStartup.cpp:0160424142d14988f7b30595e03f156c31278a42 : 270 + 0xf]
08:00:33 INFO - rbp = 0x00007fff5c621c60 rsp = 0x00007fff5c621c50
08:00:33 INFO - rip = 0x0000000108f74d2e
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 25 XUL!XREMain::XRE_mainRun() [nsAppRunner.cpp:0160424142d14988f7b30595e03f156c31278a42 : 4584 + 0x16]
08:00:33 INFO - rbp = 0x00007fff5c621d90 rsp = 0x00007fff5c621c70
08:00:33 INFO - rip = 0x00000001090fe2bc
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 26 XUL!XREMain::XRE_main(int, char**, mozilla::BootstrapConfig const&) [nsAppRunner.cpp:0160424142d14988f7b30595e03f156c31278a42 : 4722 + 0x8]
08:00:33 INFO - rbp = 0x00007fff5c621e70 rsp = 0x00007fff5c621da0
08:00:33 INFO - rip = 0x00000001090ff06f
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 27 XUL!XRE_main(int, char**, mozilla::BootstrapConfig const&) [nsAppRunner.cpp:0160424142d14988f7b30595e03f156c31278a42 : 4803 + 0x10]
08:00:33 INFO - rbp = 0x00007fff5c621fc0 rsp = 0x00007fff5c621e80
08:00:33 INFO - rip = 0x000000010910000c
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 28 firefox!main [nsBrowserApp.cpp:0160424142d14988f7b30595e03f156c31278a42 : 291 + 0x59]
08:00:33 INFO - rbp = 0x00007fff5c622410 rsp = 0x00007fff5c621fd0
08:00:33 INFO - rip = 0x00000001035dde16
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 29 libdyld.dylib + 0x35c9
08:00:33 INFO - rbp = 0x00007fff5c622428 rsp = 0x00007fff5c622420
08:00:33 INFO - rip = 0x00007fff963865c9
08:00:33 INFO - Found by: previous frame's frame pointer
08:00:33 INFO - 30 libdyld.dylib + 0x35c9
08:00:33 INFO - rbp = 0x00007fff5c622428 rsp = 0x00007fff5c622428
08:00:33 INFO - rip = 0x00007fff963865c9
08:00:33 INFO - Found by: stack scanning

Comment 2

[Intermittent Failures Robot]

19 failures in 354 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 2
• mozilla-inbound: 3

Platform breakdown:

• macosx64-qr: 5
• linux32-shippable: 5
• linux32: 1
• osx-10-10-shippable: 3
• osx-10-10: 3
• linux64: 1
• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1545738&startday=2019-04-19&endday=2019-04-19&tree=all

Comment 3

[Andreea Pavel [:apavel]]

Joel looks like crashes move on to the next test again:

https://searchfox.org/mozilla-central/source/netwerk/test/crashtests/crashtests.list

Is there any action we should take here?

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

I would bet we could enable the previous two and disable the first test:

here is the current file:
skip-if(Android&&browserIsRemote) load 675518.html
skip load 785753-1.html #bug 1536772
skip load 785753-2.html #bug 1543732
load 1274044-1.html
skip-if(Android) pref(privacy.firstparty.isolate,true) load 1334468-1.html
load 1399467-1.html

and I propose this now:
skip load 675518.html
load 785753-1.html
load 785753-2.html
load 1274044-1.html
skip-if(Android) pref(privacy.firstparty.isolate,true) load 1334468-1.html
load 1399467-1.html

I was easily able to reproduce the failure on try in 10 runs and by doing the proposed I had 20 runs with no crash.

Comment 5

[Razvan Maries]

Attachment: Bug 1545738 - Disabling test 675518.html

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7c58e263667c
Disabling test 675518.html r=jmaher

Comment 7

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/7c58e263667c

Comment 8

[Intermittent Failures Robot]

38 failures in 2673 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 22
• mozilla-central: 7
• mozilla-inbound: 9

Platform breakdown:

• macosx64-qr: 6
• linux32-shippable: 6
• linux32: 3
• osx-10-10-shippable: 4
• osx-10-10: 7
• linux64: 6
• linux64-shippable: 5
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1545738&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 9

[Firefox Bug Husbandry Bot]

Don't mark intermittent crashes as P5s. We want them to go to triage owners.

Comment 10

[Gabriele Svelto [:gsvelto]]

Finally had some time to look into this: from the signature it seems like the main process was busy killing hung content processes and taking their minidumps. It probably took too long and was killed in turn. This is either the test being very slow or something effectively hanging content processes.

Comment 11

[Valentin Gosu [:valentin] (he/him)]

Closing intermittent bugs not touched in the past 6 months.