1342735 - Intermittent tp5o_scroll | Found crashes after test run, terminating test

Status: RESOLVED DUPLICATE of bug 1345735

(Testing :: Talos, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=80224321&repo=autoland

https://archive.mozilla.org/pub/firefox/tinderbox-builds/autoland-linux64-pgo/autoland_ubuntu64_hw_test-g1-e10s-pgo-bm104-tests1-linux-build1362.txt.gz

Comment 1

[Geoff Brown [:gbrown]]

This is a timeout that would have previously been reported as bug 1339594.

21:43:06     INFO -  Timeout waiting for test completion; killing browser...
21:43:06     INFO -  Terminating psutil.Process(pid=31585, name='firefox')

Comment 2

[Intermittent Failures Robot]

11 failures in 790 pushes (0.014 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 6
* autoland: 3
* mozilla-central: 2

Platform breakdown:
* windows8-64: 7
* osx-10-10: 3
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-03-06&endday=2017-03-12&tree=all

Comment 3

[Intermittent Failures Robot]

25 failures in 777 pushes (0.032 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 12
* mozilla-inbound: 8
* mozilla-central: 5

Platform breakdown:
* windows8-64: 24
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-03-13&endday=2017-03-19&tree=all

Comment 4

[Geoff Brown [:gbrown]]

Most of these are on Windows 8. A minidump is generated, but we get no crash report - as in bug 1310638.

Comment 5

[Geoff Brown [:gbrown]]

https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=84574245&lineNumber=3268 is different - Linux, and we get a crash report!

02:32:56     INFO -  PROCESS-CRASH | tp5o_scroll | application crashed [@ mozilla::CrossProcessSemaphore::CrossProcessSemaphore]
02:32:56     INFO -  Crash dump filename: /tmp/tmpiiasPS/profile/minidumps/33877e98-6f26-3ff7-28e19740-1ecd963e.dmp
02:32:56     INFO -  Operating system: Linux
02:32:56     INFO -                    0.0.0 Linux 3.2.0-76-generic #111-Ubuntu SMP Tue Jan 13 22:16:09 UTC 2015 x86_64
02:32:56     INFO -  CPU: amd64
02:32:56     INFO -       family 6 model 30 stepping 5
02:32:56     INFO -       8 CPUs
02:32:56     INFO -  GPU: UNKNOWN
02:32:56     INFO -  Crash reason:  SIGSEGV
02:32:56     INFO -  Crash address: 0x0
02:32:56     INFO -  Process uptime: not available
02:32:56     INFO -  Thread 0 (crashed)
02:32:56     INFO -   0  libxul.so!mozilla::CrossProcessSemaphore::CrossProcessSemaphore [CrossProcessSemaphore_posix.cpp:c8098c86e44c : 54 + 0x0]
02:32:56     INFO -      rax = 0x000000000061fd00   rdx = 0x0000000000000002
02:32:56     INFO -      rcx = 0x00007f4fa42272e7   rbx = 0x00007f4f857ae230
02:32:56     INFO -      rsi = 0x0000000000000000   rdi = 0x00007f4fad78f4c0
02:32:56     INFO -      rbp = 0x00007fff6fba18f0   rsp = 0x00007fff6fba18d0
02:32:56     INFO -       r8 = 0x00007f4faca00048    r9 = 0x00007f4f7f900000
02:32:56     INFO -      r10 = 0x0000000000000000   r11 = 0x0000000000000206
02:32:56     INFO -      r12 = 0x00007f4f82665fb0   r13 = 0x0000000000000001
02:32:56     INFO -      r14 = 0x00007fff6fba1a08   r15 = 0x00007fff6fba1a58
02:32:56     INFO -      rip = 0x00007f4fa1e890e2
02:32:56     INFO -      Found by: given as instruction pointer in context
02:32:56     INFO -   1  libxul.so!mozilla::layers::TextureClient::EnableBlockingReadLock [TextureClient.cpp:c8098c86e44c : 1441 + 0x21]
02:32:56     INFO -      rbx = 0x00007f4f853034c0   rbp = 0x00007fff6fba1910
02:32:56     INFO -      rsp = 0x00007fff6fba1900   r12 = 0x00007f4f857ae220
02:32:56     INFO -      r13 = 0x00007fff6fba1928   r14 = 0x00007fff6fba1a08
02:32:56     INFO -      r15 = 0x00007fff6fba1a58   rip = 0x00007f4fa22b2f81
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   2  libxul.so!mozilla::layers::ContentClientRemoteBuffer::CreateBackBuffer [ContentClient.cpp:c8098c86e44c : 323 + 0xc]
02:32:56     INFO -      rbx = 0x00007f4f82dbcf20   rbp = 0x00007fff6fba1950
02:32:56     INFO -      rsp = 0x00007fff6fba1920   r12 = 0x0000000000000002
02:32:56     INFO -      r13 = 0x00007fff6fba1928   r14 = 0x00007fff6fba1a08
02:32:56     INFO -      r15 = 0x00007fff6fba1a58   rip = 0x00007f4fa22baf1e
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   3  libxul.so!mozilla::layers::ContentClientRemoteBuffer::CreateBuffer [ContentClient.cpp:c8098c86e44c : 346 + 0x26]
02:32:56     INFO -      rbx = 0x00007f4f82dbcf20   rbp = 0x00007fff6fba1990
02:32:56     INFO -      rsp = 0x00007fff6fba1960   r12 = 0x0000000000000000
02:32:56     INFO -      r13 = 0x00007fff6fba1a10   r14 = 0x00007fff6fba1a08
02:32:56     INFO -      r15 = 0x00007fff6fba1a58   rip = 0x00007f4fa22bb050
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   4  libxul.so!mozilla::layers::RotatedContentBuffer::BeginPaint [RotatedBuffer.cpp:c8098c86e44c : 676 + 0x25]
02:32:56     INFO -      rbx = 0x00007f4f82dbcf58   rbp = 0x00007fff6fba1c40
02:32:56     INFO -      rsp = 0x00007fff6fba19a0   r12 = 0x00007fff6fba1a40
02:32:56     INFO -      r13 = 0x0000000000000000   r14 = 0x00007fff6fba1cf0
02:32:56     INFO -      r15 = 0x00007fff6fba1a58   rip = 0x00007f4fa2288993
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   5  libxul.so!mozilla::layers::ContentClientRemoteBuffer::BeginPaintBuffer [ContentClient.h:c8098c86e44c : 225 + 0x5]
02:32:56     INFO -      rbx = 0x00007fff6fba1cf0   rbp = 0x00007fff6fba1c60
02:32:56     INFO -      rsp = 0x00007fff6fba1c50   r12 = 0x00007fff6fba1cf0
02:32:56     INFO -      r13 = 0x00007fff6fba1d08   r14 = 0x00007f4f803d76f0
02:32:56     INFO -      r15 = 0x0000000000000000   rip = 0x00007f4fa22b093e
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   6  libxul.so!mozilla::layers::ClientPaintedLayer::PaintThebes [ClientPaintedLayer.cpp:c8098c86e44c : 55 + 0x9]
02:32:56     INFO -      rbx = 0x00007f4f803d7400   rbp = 0x00007fff6fba1d60
02:32:56     INFO -      rsp = 0x00007fff6fba1c70   r12 = 0x00007fff6fba1cf0
02:32:56     INFO -      r13 = 0x00007fff6fba1d08   r14 = 0x00007f4f803d76f0
02:32:56     INFO -      r15 = 0x0000000000000000   rip = 0x00007f4fa22b4634
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   7  libxul.so!mozilla::layers::ClientPaintedLayer::RenderLayerWithReadback [ClientPaintedLayer.cpp:c8098c86e44c : 139 + 0xb]
02:32:56     INFO -      rbx = 0x00007f4f803d7400   rbp = 0x00007fff6fba1db0
02:32:56     INFO -      rsp = 0x00007fff6fba1d70   r12 = 0x00007fff6fba1d70
02:32:56     INFO -      r13 = 0x00007fff6fba1d78   r14 = 0x00007fff6fba1dc0
02:32:56     INFO -      r15 = 0x0000000000000000   rip = 0x00007f4fa22b818d
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   8  libxul.so!mozilla::layers::ClientContainerLayer::RenderLayer [ClientContainerLayer.h:c8098c86e44c : 57 + 0xe]
02:32:56     INFO -      rbx = 0x00007f4f7fab9000   rbp = 0x00007fff6fba1e00
02:32:56     INFO -      rsp = 0x00007fff6fba1dc0   r12 = 0x00007f4f803d7400
02:32:56     INFO -      r13 = 0x00007fff6fba1dc0   r14 = 0x00007fff6fba1dc8
02:32:56     INFO -      r15 = 0x0000000000000000   rip = 0x00007f4fa22b63ae
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -   9  libxul.so!mozilla::layers::ClientContainerLayer::RenderLayer [ClientContainerLayer.h:c8098c86e44c : 57 + 0xe]
02:32:56     INFO -      rbx = 0x00007f4f7fab8c00   rbp = 0x00007fff6fba1e50
02:32:56     INFO -      rsp = 0x00007fff6fba1e10   r12 = 0x00007f4f7fab9000
02:32:56     INFO -      r13 = 0x00007fff6fba1e10   r14 = 0x00007fff6fba1e18
02:32:56     INFO -      r15 = 0x0000000000000001   rip = 0x00007f4fa22b63ae
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -  10  libxul.so!mozilla::layers::ClientContainerLayer::RenderLayer [ClientContainerLayer.h:c8098c86e44c : 57 + 0xe]
02:32:56     INFO -      rbx = 0x00007f4f7d416400   rbp = 0x00007fff6fba1ea0
02:32:56     INFO -      rsp = 0x00007fff6fba1e60   r12 = 0x00007f4f7fab8c00
02:32:56     INFO -      r13 = 0x00007fff6fba1e60   r14 = 0x00007fff6fba1e68
02:32:56     INFO -      r15 = 0x0000000000000001   rip = 0x00007f4fa22b63ae
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -  11  libxul.so!mozilla::layers::ClientLayerManager::EndTransactionInternal [ClientLayerManager.cpp:c8098c86e44c : 358 + 0xa]
02:32:56     INFO -      rbx = 0x00007f4fac99bcc0   rbp = 0x00007fff6fba2090
02:32:56     INFO -      rsp = 0x00007fff6fba1eb0   r12 = 0x00007f4f7d416710
02:32:56     INFO -      r13 = 0x00007fff6fba1ec8   r14 = 0x00007fff6fba1ee0
02:32:56     INFO -      r15 = 0x00007f4f7d416400   rip = 0x00007f4fa22b36e9
02:32:56     INFO -      Found by: call frame info
02:32:56     INFO -  12  libxul.so!mozilla::layers::ClientLayerManager::EndTransaction [ClientLayerManager.cpp:c8098c86e44c : 411 + 0x11]
02:32:56     INFO -      rbx = 0x00007f4fac99bcc0   rbp = 0x00007fff6fba20c0
02:32:56     INFO -      rsp = 0x00007fff6fba20a0   r12 = 0x0000000000000000
02:32:56     INFO -      r13 = 0x00007f4fa3223bac   r14 = 0x00007fff6fba25c0
02:32:56     INFO -      r15 = 0x00007f4f7eef0870   rip = 0x00007f4fa22bd788
02:32:56     INFO -      Found by: call frame info

Comment 6

[Geoff Brown [:gbrown]]

https://hg.mozilla.org/mozilla-central/rev/f01503971a81

Matt, I can only find the one crash report - comment 5 - but I'm hoping this is the same issue that is causing frequent crashes on Windows 8 Talos, in this bug and others. Could you have a look?

Comment 7

[Matt Woodrow (:mattwoodrow)]

That crash is very linux specific - and the same as bug 1341496.

An equivalent crash on windows seem very unlikely to be something that would break the crashreporter (it'll hit a MOZ_CRASH and terminate, shouldn't corrupt the heap).

It's possible that the crashreporter breakage is unrelated and is hiding the real crash for this, but that seems unlikley as we should see the MOZ_CRASH message still.

Comment 8

[Intermittent Failures Robot]

15 failures in 898 pushes (0.017 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 8
* mozilla-inbound: 5
* mozilla-central: 2

Platform breakdown:
* windows8-64: 12
* linux64: 2
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-03-20&endday=2017-03-26&tree=all

Comment 9

[Geoff Brown [:gbrown]]

Recent linux crashes are as in bug 1341496.

Recent osx crashes have no report.

Recent windows crashes usually have no report, but here is an exception:

https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=87326559&lineNumber=7400

Comment 10

[Intermittent Failures Robot]

27 failures in 845 pushes (0.032 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 14
* autoland: 7
* mozilla-central: 5
* mozilla-aurora: 1

Platform breakdown:
* windows8-64: 18
* windows7-32: 4
* osx-10-10: 3
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-03-27&endday=2017-04-02&tree=all

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

I assume fixing the win8 crashes and the linux crashes will make this almost go away.

Comment 12

[Intermittent Failures Robot]

39 failures in 867 pushes (0.045 failures/push) were associated with this bug in the last 7 days. 

This is the #47 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 17
* mozilla-inbound: 16
* mozilla-central: 5
* try: 1

Platform breakdown:
* windows8-64: 35
* osx-10-10: 2
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-04-03&endday=2017-04-09&tree=all

Comment 13

[Intermittent Failures Robot]

37 failures in 894 pushes (0.041 failures/push) were associated with this bug in the last 7 days. 

This is the #45 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 16
* mozilla-inbound: 12
* mozilla-central: 8
* mozilla-aurora: 1

Platform breakdown:
* windows8-64: 32
* linux64: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-04-10&endday=2017-04-16&tree=all

Comment 14

[Joel Maher ( :jmaher ) (UTC -8)]

mostly related to bug 1345735, would prefer to see that fixed before investing time in anything else.

Comment 16

[Intermittent Failures Robot]

26 failures in 817 pushes (0.032 failures/push) were associated with this bug in the last 7 days. 

This is the #41 most frequent failure this week.  

Repository breakdown:
* mozilla-inbound: 11
* autoland: 11
* mozilla-central: 4

Platform breakdown:
* windows8-64: 24
* osx-10-10: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2017-04-17&endday=2017-04-23&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 702 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1342735&startday=2018-02-05&endday=2018-02-11&tree=all