Closed Bug 1609074 Opened 5 years ago Closed 5 years ago

Intermittent Linux test_popup_button.xhtml 18.04 x64 debug crash | application crashed [@ libc-2.27.so + 0x3ee97] after application terminated with exit code 6

Categories

(Core :: Widget: Gtk, defect)

defect
Not set
normal

Tracking

()

RESOLVED DUPLICATE of bug 1607713

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: crash, intermittent-failure, Whiteboard: [stockwell unknown])

Crash Data

Filed by: aiakab [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=284811595&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Ua0flKH8R0SpPuMG7sz-8g/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Ua0flKH8R0SpPuMG7sz-8g/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2020-01-14T08:40:15.476Z] 08:40:15 INFO - TEST-PASS | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | dataTransfer value of "input" should be null
[task 2020-01-14T08:40:15.476Z] 08:40:15 INFO - TEST-PASS | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | Checking organization field
[task 2020-01-14T08:40:15.476Z] 08:40:15 INFO - TEST-PASS | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | Checking #organization highlight style
[task 2020-01-14T08:40:15.476Z] 08:40:15 INFO - TEST-PASS | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | Checking #organization previewValue
[task 2020-01-14T08:40:15.476Z] 08:40:15 INFO - Buffered messages finished
[task 2020-01-14T08:40:15.477Z] 08:40:15 ERROR - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | application terminated with exit code 6
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - runtests.py | Application ran for: 0:00:30.227159
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - zombiecheck | Reading PID log: /tmp/tmp6_qA8Bpidlog
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - ==> process 12262 launched child process 12281
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - ==> process 12262 launched child process 12320
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - ==> process 12262 launched child process 12338
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - ==> process 12262 launched child process 12403
[task 2020-01-14T08:40:15.477Z] 08:40:15 INFO - zombiecheck | Checking for orphan process with PID: 12320
[task 2020-01-14T08:40:15.478Z] 08:40:15 INFO - zombiecheck | Checking for orphan process with PID: 12281
[task 2020-01-14T08:40:15.478Z] 08:40:15 INFO - zombiecheck | Checking for orphan process with PID: 12338
[task 2020-01-14T08:40:15.478Z] 08:40:15 INFO - zombiecheck | Checking for orphan process with PID: 12403
[task 2020-01-14T08:40:15.478Z] 08:40:15 INFO - mozcrash Copy/paste: /builds/worker/workspace/build/linux64-minidump_stackwalk /tmp/tmpWzRaHM.mozrunner/minidumps/2dab13b7-bfde-0081-123d-05054bc9086e.dmp /builds/worker/workspace/build/symbols
[task 2020-01-14T08:40:21.775Z] 08:40:21 INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/2dab13b7-bfde-0081-123d-05054bc9086e.dmp
[task 2020-01-14T08:40:21.775Z] 08:40:21 INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/2dab13b7-bfde-0081-123d-05054bc9086e.extra
[task 2020-01-14T08:40:21.926Z] 08:40:21 INFO - PROCESS-CRASH | browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | application crashed [@ libc-2.27.so + 0x3ee97]
[task 2020-01-14T08:40:21.927Z] 08:40:21 INFO - Crash dump filename: /tmp/tmpWzRaHM.mozrunner/minidumps/2dab13b7-bfde-0081-123d-05054bc9086e.dmp
[task 2020-01-14T08:40:21.927Z] 08:40:21 INFO - Operating system: Linux
[task 2020-01-14T08:40:21.928Z] 08:40:21 INFO - 0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2020-01-14T08:40:21.928Z] 08:40:21 INFO - CPU: amd64
[task 2020-01-14T08:40:21.929Z] 08:40:21 INFO - family 6 model 85 stepping 4
[task 2020-01-14T08:40:21.929Z] 08:40:21 INFO - 2 CPUs
[task 2020-01-14T08:40:21.929Z] 08:40:21 INFO -
[task 2020-01-14T08:40:21.930Z] 08:40:21 INFO - GPU: UNKNOWN
[task 2020-01-14T08:40:21.930Z] 08:40:21 INFO -
[task 2020-01-14T08:40:21.931Z] 08:40:21 INFO - Crash reason: SIGABRT
[task 2020-01-14T08:40:21.931Z] 08:40:21 INFO - Crash address: 0x3e800002fe6
[task 2020-01-14T08:40:21.931Z] 08:40:21 INFO - Process uptime: not available
[task 2020-01-14T08:40:21.932Z] 08:40:21 INFO -
[task 2020-01-14T08:40:21.932Z] 08:40:21 INFO - Thread 0 (crashed)
[task 2020-01-14T08:40:21.932Z] 08:40:21 INFO - 0 libc-2.27.so + 0x3ee97
[task 2020-01-14T08:40:21.933Z] 08:40:21 INFO - rax = 0x0000000000000000 rdx = 0x0000000000000000
[task 2020-01-14T08:40:21.933Z] 08:40:21 INFO - rcx = 0x00007f5dd9e22e97 rbx = 0x0000000000000000
[task 2020-01-14T08:40:21.933Z] 08:40:21 INFO - rsi = 0x00007ffc3356e310 rdi = 0x0000000000000002
[task 2020-01-14T08:40:21.933Z] 08:40:21 INFO - rbp = 0x00007f5dd9f9b7d8 rsp = 0x00007ffc3356e310
[task 2020-01-14T08:40:21.934Z] 08:40:21 INFO - r8 = 0x0000000000000000 r9 = 0x00007ffc3356e310
[task 2020-01-14T08:40:21.934Z] 08:40:21 INFO - r10 = 0x0000000000000008 r11 = 0x0000000000000246
[task 2020-01-14T08:40:21.934Z] 08:40:21 INFO - r12 = 0x00007f5dd7f33eb3 r13 = 0x00007f5dd7f34048
[task 2020-01-14T08:40:21.935Z] 08:40:21 INFO - r14 = 0x0000000000000103 r15 = 0x00007f5dd8635fb0
[task 2020-01-14T08:40:21.935Z] 08:40:21 INFO - rip = 0x00007f5dd9e22e97
[task 2020-01-14T08:40:21.936Z] 08:40:21 INFO - Found by: given as instruction pointer in context
[task 2020-01-14T08:40:21.936Z] 08:40:21 INFO - 1 libc-2.27.so + 0x8863f
[task 2020-01-14T08:40:21.936Z] 08:40:21 INFO - rsp = 0x00007ffc3356e330 rip = 0x00007f5dd9e6c63f
[task 2020-01-14T08:40:21.937Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.937Z] 08:40:21 INFO - 2 firefox-bin!arena_t::DallocSmall(arena_chunk_t*, void*, arena_chunk_map_t*) [mozjemalloc.cpp:f6a56b3d09559e65945cdff58c2e64759232fe63 : 3259 + 0x10]
[task 2020-01-14T08:40:21.937Z] 08:40:21 INFO - rsp = 0x00007ffc3356e370 rip = 0x000055a175a93957
[task 2020-01-14T08:40:21.938Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.938Z] 08:40:21 INFO - 3 libc-2.27.so + 0x40801
[task 2020-01-14T08:40:21.938Z] 08:40:21 INFO - rsp = 0x00007ffc3356e430 rip = 0x00007f5dd9e24801
[task 2020-01-14T08:40:21.938Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.939Z] 08:40:21 INFO - 4 libX11.so.6.3.0 + 0xaeeb3
[task 2020-01-14T08:40:21.939Z] 08:40:21 INFO - rsp = 0x00007ffc3356e4f8 rip = 0x00007f5dd7f33eb3
[task 2020-01-14T08:40:21.939Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.939Z] 08:40:21 INFO - 5 libX11.so.6.3.0 + 0xaf048
[task 2020-01-14T08:40:21.940Z] 08:40:21 INFO - rsp = 0x00007ffc3356e500 rip = 0x00007f5dd7f34048
[task 2020-01-14T08:40:21.940Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.940Z] 08:40:21 INFO - 6 libgdk-3.so.0.2200.30 + 0x67fb0
[task 2020-01-14T08:40:21.940Z] 08:40:21 INFO - rsp = 0x00007ffc3356e510 rip = 0x00007f5dd8635fb0
[task 2020-01-14T08:40:21.941Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.941Z] 08:40:21 INFO - 7 firefox-bin!replace_free(void*) [PHC.cpp:f6a56b3d09559e65945cdff58c2e64759232fe63 : 1101 + 0x2e]
[task 2020-01-14T08:40:21.941Z] 08:40:21 INFO - rsp = 0x00007ffc3356e520 rip = 0x000055a175aad3b0
[task 2020-01-14T08:40:21.941Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.942Z] 08:40:21 INFO - 8 libc-2.27.so + 0x1b3d14
[task 2020-01-14T08:40:21.942Z] 08:40:21 INFO - rsp = 0x00007ffc3356e528 rip = 0x00007f5dd9f97d14
[task 2020-01-14T08:40:21.942Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.942Z] 08:40:21 INFO - 9 libX11.so.6.3.0 + 0xaf2f8
[task 2020-01-14T08:40:21.942Z] 08:40:21 INFO - rsp = 0x00007ffc3356e530 rip = 0x00007f5dd7f342f8
[task 2020-01-14T08:40:21.943Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.943Z] 08:40:21 INFO - 10 libc-2.27.so + 0x1b7700
[task 2020-01-14T08:40:21.943Z] 08:40:21 INFO - rsp = 0x00007ffc3356e538 rip = 0x00007f5dd9f9b700
[task 2020-01-14T08:40:21.943Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.943Z] 08:40:21 INFO - 11 libc-2.27.so + 0x1b77d8
[task 2020-01-14T08:40:21.944Z] 08:40:21 INFO - rsp = 0x00007ffc3356e558 rip = 0x00007f5dd9f9b7d8
[task 2020-01-14T08:40:21.944Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.944Z] 08:40:21 INFO - 12 libc-2.27.so + 0x3039a
[task 2020-01-14T08:40:21.944Z] 08:40:21 INFO - rsp = 0x00007ffc3356e560 rip = 0x00007f5dd9e1439a
[task 2020-01-14T08:40:21.945Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.945Z] 08:40:21 INFO - 13 libX11.so.6.3.0 + 0xaf048
[task 2020-01-14T08:40:21.945Z] 08:40:21 INFO - rsp = 0x00007ffc3356e588 rip = 0x00007f5dd7f34048
[task 2020-01-14T08:40:21.946Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.946Z] 08:40:21 INFO - 14 libX11.so.6.3.0 + 0xaeeb3
[task 2020-01-14T08:40:21.947Z] 08:40:21 INFO - rsp = 0x00007ffc3356e590 rip = 0x00007f5dd7f33eb3
[task 2020-01-14T08:40:21.947Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.947Z] 08:40:21 INFO - 15 libX11.so.6.3.0 + 0xaf2f8
[task 2020-01-14T08:40:21.948Z] 08:40:21 INFO - rsp = 0x00007ffc3356e5a0 rip = 0x00007f5dd7f342f8
[task 2020-01-14T08:40:21.948Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.949Z] 08:40:21 INFO - 16 libc-2.27.so + 0x30412
[task 2020-01-14T08:40:21.949Z] 08:40:21 INFO - rsp = 0x00007ffc3356e5b0 rip = 0x00007f5dd9e14412
[task 2020-01-14T08:40:21.949Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.949Z] 08:40:21 INFO - 17 libc-2.27.so + 0x3ec840
[task 2020-01-14T08:40:21.949Z] 08:40:21 INFO - rsp = 0x00007ffc3356e5c0 rip = 0x00007f5dda1d0840
[task 2020-01-14T08:40:21.950Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.950Z] 08:40:21 INFO - 18 libX11.so.6.3.0 + 0x3de7a
[task 2020-01-14T08:40:21.951Z] 08:40:21 INFO - rsp = 0x00007ffc3356e5e0 rip = 0x00007f5dd7ec2e7a
[task 2020-01-14T08:40:21.951Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.951Z] 08:40:21 INFO - 19 libX11.so.6.3.0 + 0x3df1e
[task 2020-01-14T08:40:21.952Z] 08:40:21 INFO - rsp = 0x00007ffc3356e600 rip = 0x00007f5dd7ec2f1e
[task 2020-01-14T08:40:21.952Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.953Z] 08:40:21 INFO - 20 libX11.so.6.3.0 + 0x3e20d
[task 2020-01-14T08:40:21.953Z] 08:40:21 INFO - rsp = 0x00007ffc3356e650 rip = 0x00007f5dd7ec320d
[task 2020-01-14T08:40:21.953Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.953Z] 08:40:21 INFO - 21 libX11.so.6.3.0 + 0x2fd3d
[task 2020-01-14T08:40:21.953Z] 08:40:21 INFO - rsp = 0x00007ffc3356e660 rip = 0x00007f5dd7eb4d3d
[task 2020-01-14T08:40:21.954Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.954Z] 08:40:21 INFO - 22 libgdk-3.so.0.2200.30 + 0x68001
[task 2020-01-14T08:40:21.954Z] 08:40:21 INFO - rsp = 0x00007ffc3356e680 rip = 0x00007f5dd8636001
[task 2020-01-14T08:40:21.955Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.955Z] 08:40:21 INFO - 23 libglib-2.0.so.0.5600.4 + 0x4bfe1
[task 2020-01-14T08:40:21.956Z] 08:40:21 INFO - rsp = 0x00007ffc3356e6a0 rip = 0x00007f5dd5c66fe1
[task 2020-01-14T08:40:21.956Z] 08:40:21 INFO - Found by: stack scanning
[task 2020-01-14T08:40:21.956Z] 08:40:21 INFO - 24 libxul.so!nsCOMPtr<nsIPowerManagerService>::~nsCOMPtr() [nsCOMPtr.h:f6a56b3d09559e65945cdff58c2e64759232fe63 : 443 + 0x7]
[task 2020-01-14T08:40:21.956Z] 08:40:21 INFO - rsp = 0x00007ffc3356e710 rip = 0x00007f5dca1afddf
[task 2020-01-14T08:40:21.957Z] 08:40:21 INFO - Found by: stack scanning

Summary: Intermittent browser/extensions/formautofill/test/mochitest/creditCard/test_clear_form.html | application crashed [@ libc-2.27.so + 0x3ee97] after application terminated with exit code 6 → Intermittent Linux 18.04 x64 debug crash | application crashed [@ libc-2.27.so + 0x3ee97] after application terminated with exit code 6

The priority flag is not set for this bug.
:MattN, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(MattN+bmo)
Flags: needinfo?(MattN+bmo)
Priority: -- → P3

There are:

Failure rate is about 50/50 between linux1804-64 debug and opt builds. Most of the failures seem to happen on test_popup_attribute.xhtml but not only. Test failure breakdown would be:

  • test_popup_attribute.xhtml - 22 times
  • browser_bug424101.js
  • browser_trackingUI_report_breakage.js
  • test_panel.xhtml
  • browser_contentContextMenu.js
  • browser_save_link-perwindowpb.js
  • browser_popupNotification_4.js
  • test_editor_for_input_with_autocomplete.html
  • browser_rules_colorpicker-and-image-tooltip_02.js
  • browser_pocket_ui_check.js
  • browser_bug295977_autoscroll_overflow.js

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=294265250&repo=autoland
Matt, could you please have a look over what's going on here or redirect to someone? Thank you.

Flags: needinfo?(MattN+bmo)
Whiteboard: [stockwell needswork:owner]
Component: Form Autofill → General
Flags: needinfo?(MattN+bmo)
Priority: P3 → --
Product: Toolkit → Core

Per comment 15, the failure rate went up in the past week. Can you please take a look and suggest the next step for this bug, Andrew? Thanks.

Flags: needinfo?(continuation)

Some of the issue is that libc.so is a very generic signature, and lots of random stuff is getting bucketed in here. The bug as filed talks about debug, but more than half of the crashes are opt. Still, there's clearly something going wrong with test_popup_button.xhtml if not other things. I'll put the test name in the summary.

Karl, could you take a look? These are all pretty deep stacks with a bunch of libc.so and libX11.so in them. test_popup_button.xhtml is the most common failure, maybe because it opens a new window or something.

Component: General → Widget: Gtk
Flags: needinfo?(continuation) → needinfo?(karlt)
Summary: Intermittent Linux 18.04 x64 debug crash | application crashed [@ libc-2.27.so + 0x3ee97] after application terminated with exit code 6 → Intermittent Linux test_popup_button.xhtml 18.04 x64 debug crash | application crashed [@ libc-2.27.so + 0x3ee97] after application terminated with exit code 6

The last recognizable thing on the stack is firefox-bin!arena_t::DallocSmall. That doesn't look like it would call libc outside of a single memset that tries to poison the memory area. So memory might be quite hosed.

The thing on top of the stack is this destructor: libxul.so!nsCOMPtr<nsIPowerManagerService>::~nsCOMPtr().

This kinda reeks of a memory safety/lifetime error.

In the last 7 days there have been 29 occurrences on linux1804-64 mostly opt.

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=296281699&repo=autoland&lineNumber=142239

(In reply to Cosmin Sabou [:CosminS] from comment #21)

firefox: ../../src/xcb_io.c:259: poll_for_event: Assertion !xcb_xlib_threads_sequence_lost' failed.

Thank you, Cosmin. Yes, that will be the key here.

Status: NEW → RESOLVED
Closed: 5 years ago
Flags: needinfo?(karlt)
Resolution: --- → DUPLICATE

I don't know how to fix this issue. As I have been discussing in Bug 1607713 with :stransky, this problem is not something I am familiar with.

The test cannot be disabled either because this is a crash that's occurring across various test suites - it just happens so that these crashes all have the same signature. Disabling each test that causes this crash would result in unacceptable loss of coverage on Linux.

Flags: needinfo?(egao)
You need to log in before you can comment on or make changes to this bug.