1554852 - Intermittent A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down

Status: RESOLVED FIXED

(Testing :: Reftest, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=248661516&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/HkwjyUw1TjybeWpIUu8ABQ/runs/0/artifacts/public/logs/live_backing.log

---

06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x35002F,name=PContent::Msg_UpdateSharedData) Channel error: cannot send/recv
06:45:38     INFO -  [Parent 3817, Main Thread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 23
06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x35002F,name=PContent::Msg_UpdateSharedData) Channel error: cannot send/recv
06:45:38     INFO -  [Parent 3817, Main Thread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 23
06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x35002F,name=PContent::Msg_UpdateSharedData) Channel error: cannot send/recv
06:45:38     INFO -  [Parent 3817, Main Thread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 23
06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x35011A,name=PContent::Msg_AsyncMessage) Channel error: cannot send/recv
06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x35011A,name=PContent::Msg_AsyncMessage) Channel error: cannot send/recv
06:45:38     INFO -  ###!!! [Parent][MessageChannel] Error: (msgtype=0x1D0001,name=PBrowser::Msg_AsyncMessage) Channel error: cannot send/recv
06:45:38     INFO -  [Parent 3817, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/build/src/ipc/glue/ProtocolUtils.cpp, line 608
06:45:38     INFO -  [Parent 3817, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/build/src/ipc/glue/ProtocolUtils.cpp, line 608
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38     INFO -  ++DOCSHELL 0x124a76000 == 6 [pid = 3817] [id = {995008d7-1849-be4a-9d1e-eebf04fe2a79}]
06:45:38     INFO -  ++DOMWINDOW == 12 (0x124aa17a0) [pid = 3817] [serial = 13] [outer = 0x0]
06:45:38     INFO -  ++DOMWINDOW == 13 (0x11d360400) [pid = 3817] [serial = 14] [outer = 0x124aa17a0]
06:45:38    ERROR -  A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 1662: TypeError: subject.QueryInterface is not a function
06:45:38    ERROR -  A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
06:45:38     INFO -  JavaScript error: resource:///modules/sessionstore/TabStateFlusher.jsm, line 97: NS_ERROR_UNEXPECTED
06:45:38     INFO -  --DOCSHELL 0x12f607000 == 5 [pid = 3817] [id = {d9b2775c-826b-9945-874c-745506101cd6}] [url = chrome://browser/content/browser.xhtml]
06:45:38     INFO -  --DOCSHELL 0x1282b4800 == 4 [pid = 3817] [id = {9d94bfd2-9769-f54c-8f13-dae04d58893c}] [url = chrome://browser/content/hiddenWindowMac.xhtml]
06:45:38     INFO -  --DOCSHELL 0x131476800 == 3 [pid = 3817] [id = {cee8e817-430d-9245-b606-b8a2a04d8bb8}] [url = chrome://extensions/content/dummy.xul]
06:45:38     INFO -  --DOCSHELL 0x1302cb800 == 2 [pid = 3817] [id = {815118c2-6ca5-5144-ac19-924b27d02070}] [url = about:blank]
06:45:39     INFO -  1559025938995	Marionette	TRACE	Received observer notification xpcom-will-shutdown
06:45:39     INFO -  1559025938996	Marionette	INFO	Stopped listening on port 2828
06:45:39     INFO -  1559025938996	Marionette	DEBUG	Remote service is inactive
06:45:39     INFO -  [Parent 3817, Main Thread] WARNING: NS_ENSURE_TRUE(mDB) failed: file /builds/worker/workspace/build/src/netwerk/cache/nsDiskCacheDeviceSQL.cpp, line 1285
06:45:39     INFO -  [Parent 3817, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/workspace/build/src/widget/cocoa/nsAppShell.mm, line 725

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

That is a very interesting report. Note that a content process crash happened and Firefox shutdown, but Marionette wasn't able to find any report to process with mozcrash. I wonder if there is some kind of delay here, which writes the minidump files after Firefox has been shutdown?

Comment 2

[Gabriele Svelto [:gsvelto]]

Yeah, this one is very odd. Looking at the log ContentCrashHandlers.observe() is being invoked thrice in the same second - as if three content processes crashed at the same time - but there's no trace of a minidump. There doesn't seem to be a trace of why or where the processes crashed and it's possible to get an abnormal shutdown w/o a minidump but it's odd to see three of them at the same time. The test is restarting marionette IIUC so maybe something's messing up with IPC? The main process might think that a content process crashed if something happens to its IPC with the content process but I've never seen it happen in practice.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I would say lets wait for more samples. As it looks like this is a one-off, and hard to reproduce. I will keep an eye on it.

Comment 4

[Narcis Beleuzu [:NarcisB]]

There are 64 failures in the last 2 days. Most of them (60 failures) are on windows7-32
I did some retriggs and seems that it started from Bug 1554063
Retriggs:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=windows%2C10%2Cx64%2Cdebug%2Creftests%2Ctest-windows10-64%2Fdebug-crashtest-e10s%2Cr%28c%29&tochange=3edc5be703bef8ad5e78a0ec9b08e98c69cf026b&fromchange=e78c08a8a56c85a7a1e9e86364f672ea8e93cf73

Comment 5

[Mike Hommey [:glandium]]

Bug 1554063 caused /some/ "A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down" messages, but it was backed out, and relanded without causing them.

Now, if I look at the most recent error linked from orange factor, there's something else that didn't appear in the logs on the landing of bug 1554063:

22:13:09     INFO - REFTEST PROCESS-CRASH | file:///Z:/task_1559248544/build/tests/reftest/tests/layout/style/crashtests/439184-1.html | application crashed [@ mozalloc_handle_oom(unsigned int)]

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=249248314&repo=autoland&lineNumber=82607

So looking around and retriggering some, it looks like it started on bug 1493420.
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=windows%2C7%2Cdebug%2Creftests%2Ctest-windows7-32%2Fdebug-crashtest-e10s%2Cr%28c%29&fromchange=196e318992aa867869ab3de7cea0ae1365320cc3&tochange=899d0c1363e0f250406ca7f0a02ad798726abb94&selectedJob=249254933&group_state=expanded

Comment 6

[Mike Hommey [:glandium]]

(Interestingly enough, though, that doesn't match the one for which this bug was filed, which doesn't look like it reoccurred.

Comment 7

[Emilio Cobos Álvarez (:emilio)]

Yeah, that looks like a totally different bug.

That OOM looks legitimate, and reasonably triggered by my patches. That crashtest effectively triggers the best-case for the old code I removed, but worse-case for the code I created.

That crashtest creates approx. a million rules one as a child of each other. Before we were just linking them, now we're storing them in a hashmap (which presumably allocates more than a single entry if non-empty, and thus gets more entries).

So it seems plausible that, depending on load, that would make a win7 machine OOM more often. It's not OOMing in the code directly touched by that bug, but in the code that runs immediately after, which also ends up allocating a million pointers on a SmallVec, effectively...

I could try to optimize the case of rule nodes with a single-children, it doesn't strike me as a particularly strange situation... Will measure some pages in the wild to report percentage of rule nodes with a single child, and potentially optimize this so it goes back to the previous memory usage, hopefully. But if I find out it's not worth it, then this is probably WONTFIX and we should probably disable the test on win32. Cam, does that sound reasonable? If so I'll take a look tomorrow.

But that's probably a separate bug from the one filed in comment 0.

Comment 8

[Cameron McCormack (:heycam)]

Getting some measurements about how common a single child is sounds good to me. And if it's common, maybe we do want to box the children HashMap after all.

For this particular test, can we reduce the number of rules a little, and see if that eliminates the OOMs on the test machines?

Comment 9

[Cameron McCormack (:heycam)]

(In reply to Cameron McCormack (:heycam) from comment #8)

For this particular test, can we reduce the number of rules a little, and see if that eliminates the OOMs on the test machines?

(If it's not worth handling single children differently. Otherwise if it solves this test's issue we can leave the test as is.)

Comment 10

[Intermittent Failures Robot]

83 failures in 792 pushes (0.105 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 62
• mozilla-inbound: 11
• mozilla-central: 4
• try: 6

Platform breakdown:

• windows7-32: 74
• windows7-32-shippable: 7
• macosx1010-64-devedition: 1
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1554852&startday=2019-05-30&endday=2019-05-30&tree=all

Comment 11

[Intermittent Failures Robot]

22 failures in 155 pushes (0.142 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 14
• mozilla-inbound: 2
• try: 5
• mozilla-central: 1

Platform breakdown:

• windows7-32: 18
• windows7-32-shippable: 1
• windows7-32-devedition: 2
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1554852&startday=2019-06-01&endday=2019-06-01&tree=all

Comment 12

[Andreea Pavel [:apavel]]

There are 218 total failures in the last 7 days mostly on windows7-32 debug.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=249649952&repo=autoland&lineNumber=82958

01:39:28 INFO - REFTEST TEST-START | file:///Z:/task_1559520162/build/tests/reftest/tests/layout/style/crashtests/439184-1.html
01:39:28 INFO - REFTEST TEST-LOAD | file:///Z:/task_1559520162/build/tests/reftest/tests/layout/style/crashtests/439184-1.html | 2887 / 3759 (76%)

01:39:33 INFO - ++DOCSHELL 17F7A800 == 13 [pid = 4052] [id = {091f2d8f-f96f-4c6b-a96e-3dd48e8dd6f6}]
01:39:33 INFO - ++DOMWINDOW == 30 (1A10D820) [pid = 4052] [serial = 56] [outer = 00000000]
01:39:33 INFO - ++DOMWINDOW == 31 (17F7C800) [pid = 4052] [serial = 57] [outer = 1A10D820]
01:39:33 ERROR - A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
01:39:33 INFO - [Parent 4052, Main Thread] WARNING: IPC message discarded: actor cannot send: file z:/build/build/src/ipc/glue/ProtocolUtils.cpp, line 608
01:39:33 INFO - ++DOMWINDOW == 32 (1BA9E400) [pid = 4052] [serial = 58] [outer = 1A10D4C0]
01:39:33 INFO - ++DOMWINDOW == 33 (1CE35000) [pid = 4052] [serial = 59] [outer = 1A10D820]
01:39:33 INFO - [Parent 4052, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 160
01:39:33 INFO - [Child 2204, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
01:39:33 INFO - [Child 2204, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
01:39:33 INFO - JavaScript error: resource://reftest/reftest.jsm, line 1558: NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIPropertyBag2.getPropertyAsAString]

01:39:58 INFO - REFTEST PROCESS-CRASH | file:///Z:/task_1559520162/build/tests/reftest/tests/layout/style/crashtests/439184-1.html | application crashed [@ GeckoCrash]
01:39:58 INFO - Crash dump filename: c:\users\task_1559520162\appdata\local\temp\tmp7ks8m5.mozrunner\minidumps\637e20b8-7148-4f3d-92d2-18e4082c63ba.dmp
01:39:58 INFO - Operating system: Windows NT
01:39:58 INFO - 6.1.7601 Service Pack 1
01:39:58 INFO - CPU: x86
01:39:58 INFO - GenuineIntel family 6 model 63 stepping 2
01:39:58 INFO - 8 CPUs
01:39:58 INFO -
01:39:58 INFO - GPU: UNKNOWN
01:39:58 INFO -
01:39:58 INFO - Crash reason: EXCEPTION_BREAKPOINT
01:39:58 INFO - Crash address: 0x5b066052
01:39:58 INFO - Assertion: Unknown assertion type 0x00000000
01:39:58 INFO - Process uptime: 468 seconds
01:39:58 INFO -
01:39:58 INFO - Thread 0 (crashed)
01:39:58 INFO - 0 xul.dll!GeckoCrash [nsAppRunner.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 5161 + 0x22]
01:39:58 INFO - eip = 0x5b066052 esp = 0x002fdec8 ebp = 0x002fded0 ebx = 0x00000015
01:39:58 INFO - esi = 0x002fdeea edi = 0x000003e5 eax = 0x730b06cc ecx = 0x000003e5
01:39:58 INFO - edx = 0x00000013 efl = 0x00200202
01:39:58 INFO - Found by: given as instruction pointer in context
01:39:58 INFO - 1 xul.dll!static void gkrust_shared::panic_hook(struct core::panic::PanicInfo ) [lib.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 243 + 0x8]
01:39:58 INFO - eip = 0x5b7a3653 esp = 0x002fded8 ebp = 0x5dc23a34 esi = 0x000003e5
01:39:58 INFO - edi = 0x000000ba
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 2 xul.dll!static void core::ops::function::Fn::call<fn(core::panic::PanicInfo),(core::panic::PanicInfo*)>( * , struct core::panic::PanicInfo ) [function.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 69 + 0x9]
01:39:58 INFO - eip = 0x5b7a27c9 esp = 0x002fe304 ebp = 0x00000001 ebx = 0x5db98adc
01:39:58 INFO - esi = 0x5dacca8c edi = 0x002fe364
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 3 xul.dll!void std::panicking::rust_panic_with_hook() [panicking.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 478 + 0x5]
01:39:58 INFO - eip = 0x5bdf1c1e esp = 0x002fe308 ebp = 0x00000001
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 4 xul.dll!static void std::panicking::continue_panic_fmt() [panicking.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 381 + 0x13]
01:39:58 INFO - eip = 0x5bdf17e2 esp = 0x002fe354 ebp = 0x002fe3ac ebx = 0x002fe404
01:39:58 INFO - esi = 0x002fe3bc edi = 0x00000015
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 5 xul.dll!void std::panicking::rust_begin_panic() [panicking.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 308 + 0x9]
01:39:58 INFO - eip = 0x5bdf16b9 esp = 0x002fe3b4 ebp = 0x002fe534 ebx = 0x00000200
01:39:58 INFO - esi = 0x00000015 edi = 0x000003e5
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 6 xul.dll!void core::panicking::panic_fmt() [panicking.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 85 + 0x6]
01:39:58 INFO - eip = 0x5be08583 esp = 0x002fe3b8 ebp = 0x002fe534
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 7 xul.dll!<NoType> core::result::unwrap_failed<hashglobe::FailedAllocationError>(struct str, struct hashglobe::FailedAllocationError) [macros.rs:3c235d5600393dfe6c36eeed34042efad8d4f26e : 18 + 0xb]
01:39:58 INFO - eip = 0x5c16fe17 esp = 0x002fe3e4 ebp = 0x002fe534 esi = 0x5dc40cce
01:39:58 INFO - edi = 0x00000026
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 8 xul.dll!union hashglobe::hash_map::Entry<style::rule_tree::ChildKey, style::rule_tree::WeakRuleNode> hashglobe::hash_map::HashMap<style::rule_tree::ChildKey, style::rule_tree::WeakRuleNode, core::hash::BuildHasherDefault<fxhash::FxHasher>>::entry<style::rule_tree::ChildKey,style::rule_tree::WeakRuleNode,core::hash::BuildHasherDefault<fxhash::FxHasher>>(struct style::rule_tree::ChildKey) [hash_map.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 985 + 0xe4]
01:39:58 INFO - eip = 0x5c30ac80 esp = 0x002fe420 ebp = 0x002fe534
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 9 xul.dll!struct style::rule_tree::StrongRuleNode style::rule_tree::StrongRuleNode::ensure_child(struct style::rule_tree::WeakRuleNode, struct style::rule_tree::StyleSource, style::rule_tree::CascadeLevel) [mod.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 960 + 0x13]
01:39:58 INFO - eip = 0x5c179431 esp = 0x002fe470 ebp = 0x002fe534 ebx = 0x7fdf1ca0
01:39:58 INFO - esi = 0x002fe54c edi = 0x7fdf1cb8
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 10 xul.dll!struct style::rule_tree::StrongRuleNode style::rule_tree::RuleTree::compute_rule_node(struct smallvec::SmallVec<[style::applicable_declarations::ApplicableDeclarationBlock; 16]> , struct style::shared_lock::StylesheetGuards ) [mod.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 355 + 0x377]
01:39:58 INFO - eip = 0x5c177ae5 esp = 0x002fe53c ebp = 0x400f3c88 ebx = 0x002fe54c
01:39:58 INFO - esi = 0x002fe608 edi = 0x4716d684
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 11 xul.dll!struct style::style_resolver::MatchingResults style::style_resolver::StyleResolverForElement<style::gecko::wrapper::GeckoElement>::match_primary<style::gecko::wrapper::GeckoElement>(selectors::context::VisitedHandlingMode) [style_resolver.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 447 + 0xf]
01:39:58 INFO - eip = 0x5c0e3fbe esp = 0x002fe67c ebp = 0x002fe810 ebx = 0x00000000
01:39:58 INFO - esi = 0x002fe904 edi = 0x002fe6d0
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 12 xul.dll!struct style::style_resolver::PrimaryStyle style::style_resolver::StyleResolverForElement<style::gecko::wrapper::GeckoElement>::resolve_primary_style<style::gecko::wrapper::GeckoElement>(union core::option::Option<style::gecko_properties::ComputedValues>, union core::option::Option<style::gecko_properties::ComputedValues>) [style_resolver.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 162 + 0xb]
01:39:58 INFO - eip = 0x5c0e448e esp = 0x002fe818 ebp = 0x00000000 ebx = 0x002fe904
01:39:58 INFO - esi = 0x002fe860 edi = 0x09e80d84
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 13 xul.dll!struct style::style_resolver::ResolvedElementStyles style::style_resolver::StyleResolverForElement<style::gecko::wrapper::GeckoElement>::resolve_style<style::gecko::wrapper::GeckoElement>(union core::option::Option<style::gecko_properties::ComputedValues>, union core::option::Option<style::gecko_properties::ComputedValues*>) [style_resolver.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 232 + 0xb]
01:39:58 INFO - eip = 0x5c0e4131 esp = 0x002fe838 ebp = 0x002fe8a0 ebx = 0x09e80d84
01:39:58 INFO - esi = 0x002fe860 edi = 0x002fe904
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 14 xul.dll!struct style::style_resolver::ResolvedElementStyles style::style_resolver::StyleResolverForElement<style::gecko::wrapper::GeckoElement>::resolve_style_with_default_parents<style::gecko::wrapper::GeckoElement>() [style_resolver.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 269 + 0xed]
01:39:58 INFO - eip = 0x5c0e472c esp = 0x002fe8a8 ebp = 0x002fe904 ebx = 0x0b59ce20
01:39:58 INFO - esi = 0x0b704b40 edi = 0x002fe8ec
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 15 xul.dll!style::matching::ChildCascadeRequirement style::traversal::compute_style<style::gecko::wrapper::GeckoElement>(struct style::traversal::PerLevelTraversalData *, struct style::context::StyleContext<style::gecko::wrapper::GeckoElement> *, struct style::gecko::wrapper::GeckoElement, struct style::data::ElementData *) [traversal.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 617 + 0x7]
01:39:58 INFO - eip = 0x5c1dd217 esp = 0x002fe8d4 ebp = 0x002feb10 ebx = 0x002feab0
01:39:58 INFO - esi = 0x002fe8ec edi = 0x002fe93c
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 16 xul.dll!void style::gecko::traversal::{{impl}}::process_preorder<closure>(struct style::gecko::traversal::RecalcStyleOnly *, struct style::traversal::PerLevelTraversalData *, struct style::context::StyleContext<style::gecko::wrapper::GeckoElement> *, struct style::gecko::wrapper::GeckoNode, struct closure) [traversal.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 37 + 0x13a]
01:39:58 INFO - eip = 0x5c0d6b9a esp = 0x002fe9c0 ebp = 0x002fe35c ebx = 0x5df2b288
01:39:58 INFO - esi = 0x00000002 edi = 0x002feb10
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 17 xul.dll!void style::driver::traverse_dom<style::gecko::wrapper::GeckoElement,style::gecko::traversal::RecalcStyleOnly>(struct style::gecko::traversal::RecalcStyleOnly , struct style::traversal::PreTraverseToken<style::gecko::wrapper::GeckoElement>, union core::option::Option<rayon_core::thread_pool::ThreadPool>) [driver.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 111 + 0x17]
01:39:58 INFO - eip = 0x5c1d979d esp = 0x002fea48 ebp = 0x002fedb4 ebx = 0x002feb10
01:39:58 INFO - esi = 0x00000001 edi = 0x11161b00
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 18 xul.dll!static void geckoservo::glue::traverse_subtree(struct style::gecko::wrapper::GeckoElement, struct style::global_style_data::GlobalStyleData *, struct style::gecko::data::PerDocumentStyleDataImpl *, struct style::shared_lock::SharedRwLockReadGuard *, struct style::traversal_flags::TraversalFlags, struct style::gecko_bindings::structs::root::mozilla::ServoElementSnapshotTable *) [glue.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 262 + 0x8]
01:39:58 INFO - eip = 0x5b7f195c esp = 0x002fedbc ebp = 0x002fee80 ebx = 0x002fee38
01:39:58 INFO - esi = 0x0b59ce20 edi = 0x5df2b680
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 19 xul.dll!bool geckoservo::glue::Servo_TraverseSubtree(struct style::gecko_bindings::structs::root::mozilla::dom::Element *, struct style::gecko_bindings::structs::root::RawServoStyleSet *, struct style::gecko_bindings::structs::root::mozilla::ServoElementSnapshotTable *, unsigned int) [glue.rs:3a1135e99b22392d170911105dbdc3f09c0c4085 : 322 + 0x17]
01:39:58 INFO - eip = 0x5b7f1be1 esp = 0x002fee88 ebp = 0x5de74384 ebx = 0x00000000
01:39:58 INFO - esi = 0x0b59ce20 edi = 0x1764e808
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 20 xul.dll!mozilla::ServoStyleSet::StyleDocument(mozilla::ServoTraversalFlags) [ServoStyleSet.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 726 + 0x15]
01:39:58 INFO - eip = 0x59b9aaaf esp = 0x002fef0c ebp = 0x002fef8c ebx = 0x00000000
01:39:58 INFO - esi = 0x11501a80 edi = 0x0b59ce20
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 21 xul.dll!mozilla::RestyleManager::DoProcessPendingRestyles(mozilla::ServoTraversalFlags) [RestyleManager.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 3071 + 0x6]
01:39:58 INFO - eip = 0x59c30e64 esp = 0x002fef94 ebp = 0x002ff104 ebx = 0x154d4800
01:39:58 INFO - esi = 0x00000000 edi = 0x1924f100
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 22 xul.dll!mozilla::PresShell::DoFlushPendingNotifications(mozilla::ChangesToFlush) [PresShell.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 4184 + 0x3b]
01:39:58 INFO - eip = 0x59c0ebe1 esp = 0x002ff10c ebp = 0x002ff1b0 ebx = 0x1924f100
01:39:58 INFO - esi = 0x002ff110 edi = 0x154d4800
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 23 xul.dll!mozilla::dom::Document::FlushPendingNotifications(mozilla::ChangesToFlush) [Document.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 9357 + 0x4c]
01:39:58 INFO - eip = 0x57a28106 esp = 0x002ff1b8 ebp = 0x002ff1e4 ebx = 0x002ff1ec
01:39:58 INFO - esi = 0x1764d800 edi = 0x14f23000
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 24 xul.dll!mozilla::dom::Document::FlushPendingNotifications(mozilla::FlushType) [Document.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 9287 + 0x19]
01:39:58 INFO - eip = 0x57a138c5 esp = 0x002ff1ec ebp = 0x002ff1fc ebx = 0x002ff29c
01:39:58 INFO - esi = 0xd15fe8f5 edi = 0x002ff298
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 25 xul.dll!nsDocLoader::DocLoaderIsEmpty(bool) [nsDocLoader.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 661 + 0x9]
01:39:58 INFO - eip = 0x572f36b3 esp = 0x002ff204 ebp = 0x002ff2b8 esi = 0x089c0400
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 26 xul.dll!nsDocLoader::OnStopRequest(nsIRequest *,nsresult) [nsDocLoader.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 600 + 0xb]
01:39:58 INFO - eip = 0x572f463d esp = 0x002ff2c0 ebp = 0x002ff33c ebx = 0x13a34b50
01:39:58 INFO - esi = 0x089c0400 edi = 0x002ff2dc
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 27 xul.dll!mozilla::net::nsLoadGroup::RemoveRequest(nsIRequest *,nsISupports *,nsresult) [nsLoadGroup.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 568 + 0xa]
01:39:58 INFO - eip = 0x56598c1d esp = 0x002ff344 ebp = 0x002ff3d4 ebx = 0x13a34b50
01:39:58 INFO - esi = 0x089a9200 edi = 0x00000000
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 28 xul.dll!mozilla::dom::Document::DoUnblockOnload() [Document.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 10042 + 0x10]
01:39:58 INFO - eip = 0x57a2a00b esp = 0x002ff3dc ebp = 0x002ff40c ebx = 0x002ff3f8
01:39:58 INFO - esi = 0x1764d800 edi = 0x002ff3ec
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 29 xul.dll!mozilla::dom::Document::UnblockOnload(bool) [Document.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 9974 + 0x7]
01:39:58 INFO - eip = 0x57a1c46e esp = 0x002ff414 ebp = 0x002ff42c ebx = 0x002ff460
01:39:58 INFO - esi = 0x1764d800 edi = 0x00000000
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 30 xul.dll!mozilla::dom::Document::DispatchContentLoadedEvents() [Document.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 6425 + 0x9]
01:39:58 INFO - eip = 0x57a1c114 esp = 0x002ff434 ebp = 0x002ff494 esi = 0x01180b80
01:39:58 INFO - edi = 0x1764d800
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 31 xul.dll!nsresult mozilla::detail::RunnableMethodImpl<mozilla::dom::Document ,void (mozilla::dom::Document::)() attribute((thiscall)),1,mozilla::RunnableKind::Standard>::Run() [nsThreadUtils.h:3a1135e99b22392d170911105dbdc3f09c0c4085 : 1174 + 0x6]
01:39:58 INFO - eip = 0x57a728c3 esp = 0x002ff49c ebp = 0x002ff49c ebx = 0x0b5e4b68
01:39:58 INFO - esi = 0x002ff4c0 edi = 0x01151120
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 32 xul.dll!mozilla::SchedulerGroup::Runnable::Run() [SchedulerGroup.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 295 + 0x9]
01:39:58 INFO - eip = 0x56461782 esp = 0x002ff4a4 ebp = 0x002ff4b4
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 33 xul.dll!nsThread::ProcessNextEvent(bool,bool *) [nsThread.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 1176 + 0x6]
01:39:58 INFO - eip = 0x56476c7e esp = 0x002ff4bc ebp = 0x002ff98c ebx = 0x0b5f3340
01:39:58 INFO - esi = 0x002ff4c0 edi = 0x01151120
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 34 xul.dll!NS_ProcessNextEvent(nsIThread *,bool) [nsThreadUtils.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 486 + 0x11]
01:39:58 INFO - eip = 0x56479e64 esp = 0x002ff994 ebp = 0x002ff9b0 ebx = 0x01100101
01:39:58 INFO - esi = 0x002ff9a3 edi = 0x01101590
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 35 xul.dll!mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate *) [MessagePump.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 88 + 0xa]
01:39:58 INFO - eip = 0x56b3da94 esp = 0x002ff9b8 ebp = 0x002ff9dc ebx = 0x01100101
01:39:58 INFO - esi = 0x01101580
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 36 xul.dll!MessageLoop::RunInternal() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 315 + 0x5]
01:39:58 INFO - eip = 0x56af3531 esp = 0x002ff9e4 ebp = 0x002ffa00 ebx = 0x0110f000
01:39:58 INFO - esi = 0x002ffb60 edi = 0x01109520
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 37 xul.dll!MessageLoop::RunHandler() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 308 + 0x7]
01:39:58 INFO - eip = 0x56af344c esp = 0x002ffa08 ebp = 0x002ffa34 esi = 0x002ffb60
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 38 xul.dll!MessageLoop::Run() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 290 + 0x5]
01:39:58 INFO - eip = 0x56af331f esp = 0x002ffa3c ebp = 0x002ffa54 ebx = 0x0110f000
01:39:58 INFO - esi = 0x01151120 edi = 0x01109520
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 39 xul.dll!nsBaseAppShell::Run() [nsBaseAppShell.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 137 + 0xc]
01:39:58 INFO - eip = 0x599a7d75 esp = 0x002ffa5c ebp = 0x002ffa64
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 40 xul.dll!nsAppShell::Run() [nsAppShell.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 412 + 0x6]
01:39:58 INFO - eip = 0x59a23c59 esp = 0x002ffa6c ebp = 0x002ffa8c esi = 0x01109520
01:39:58 INFO - edi = 0x002ffa74
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 41 xul.dll!XRE_RunAppShell() [nsEmbedFunctions.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 911 + 0x6]
01:39:58 INFO - eip = 0x5b069188 esp = 0x002ffa94 ebp = 0x002ffaac ebx = 0x0110f000
01:39:58 INFO - esi = 0x002ffb60 edi = 0x01101580
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 42 xul.dll!mozilla::ipc::MessagePumpForChildProcess::Run(base::MessagePump::Delegate *) [MessagePump.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 238 + 0x5]
01:39:58 INFO - eip = 0x56b3e0c6 esp = 0x002ffab4 ebp = 0x002ffac4 esi = 0x002ffb60
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 43 xul.dll!MessageLoop::RunInternal() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 315 + 0x5]
01:39:58 INFO - eip = 0x56af3531 esp = 0x002ffacc ebp = 0x002ffae8 ebx = 0x0110f000
01:39:58 INFO - esi = 0x002ffb60 edi = 0x009267e0
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 44 xul.dll!MessageLoop::RunHandler() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 308 + 0x7]
01:39:58 INFO - eip = 0x56af344c esp = 0x002ffaf0 ebp = 0x002ffb1c esi = 0x002ffb60
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 45 xul.dll!MessageLoop::Run() [message_loop.cc:3a1135e99b22392d170911105dbdc3f09c0c4085 : 290 + 0x5]
01:39:58 INFO - eip = 0x56af331f esp = 0x002ffb24 ebp = 0x002ffb3c ebx = 0x0110f000
01:39:58 INFO - esi = 0x002ffb60 edi = 0x009267e0
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 46 xul.dll!XRE_InitChildProcess(int,char * * const,XREChildData const *) [nsEmbedFunctions.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 749 + 0xd]
01:39:58 INFO - eip = 0x5b0688f1 esp = 0x002ffb44 ebp = 0x002ffc88
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 47 xul.dll!mozilla::BootstrapImpl::XRE_InitChildProcess(int,char * * const,XREChildData const *) [Bootstrap.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 67 + 0xe]
01:39:58 INFO - eip = 0x5b072531 esp = 0x002ffc90 ebp = 0x002ffc9c ebx = 0x0000001a
01:39:58 INFO - esi = 0x01107118 edi = 0x01103040
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 48 firefox.exe!NS_internal_main(int,char * *,char * *) [nsBrowserApp.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 263 + 0x6f]
01:39:58 INFO - eip = 0x00911552 esp = 0x002ffca4 ebp = 0x002ffe04
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 49 firefox.exe!wmain [nsWindowsWMain.cpp:3a1135e99b22392d170911105dbdc3f09c0c4085 : 131 + 0x11]
01:39:58 INFO - eip = 0x009111d1 esp = 0x002ffe0c ebp = 0x002ffe38 ebx = 0x011030b0
01:39:58 INFO - esi = 0x0000006c edi = 0x01103040
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 50 firefox.exe!static int __scrt_common_main_seh() [exe_common.inl : 288 + 0x1c]
01:39:58 INFO - eip = 0x009761f9 esp = 0x002ffe40 ebp = 0x002ffe80 ebx = 0x7ffdd000
01:39:58 INFO - esi = 0x6b11f0b0 edi = 0x00ae2e00
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 51 kernel32.dll! ?? ?? ::FNODOBFM::`string' + 0x46
01:39:58 INFO - eip = 0x7647ef3c esp = 0x002ffe88 ebp = 0x002ffe8c
01:39:58 INFO - Found by: call frame info
01:39:58 INFO - 52 ntdll.dll!__RtlUserThreadStart + 0x27
01:39:58 INFO - eip = 0x77933618 esp = 0x002ffe94 ebp = 0x002ffecc
01:39:58 INFO - Found by: previous frame's frame pointer
01:39:58 INFO - 53 ntdll.dll!_RtlUserThreadStart + 0x1b
01:39:58 INFO - eip = 0x779335eb esp = 0x002ffed4 ebp = 0x002ffee4
01:39:58 INFO - Found by: call frame info

Cameron are there any updates here?

Comment 13

[Intermittent Failures Robot]

240 failures in 4337 pushes (0.055 failures/push) were associated with this bug in the last 7 days.

This is the #5 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 164
• try: 23
• mozilla-inbound: 40
• mozilla-central: 13

Platform breakdown:

• macosx1010-64: 1
• linux64-qr: 1
• linux64: 3
• windows7-32: 202
• windows10-64: 2
• windows10-64-qr: 3
• windows7-32-shippable: 21
• macosx1010-64-devedition: 1
• windows7-32-devedition: 5
• macosx1010-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1554852&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 14

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is no longer Marionette but crashtest (reftest). As such moving this bug over to the appropriate component.

Comment 15

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Recent classifications should get fixed in bug 1555867.

Comment 16

[Emilio Cobos Álvarez (:emilio)]

Yes, comment 12 will be fixed by bug 1555867.

Comment 17

[Andreea Pavel [:apavel]]

Aryx since bug 1555867 is fixed, can we close this as fixed too?

Comment 18

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1554852&startday=2019-06-03&endday=2019-06-09&tree=all