Closed Bug 1556632 Opened 5 years ago Closed 5 years ago

Intermittent leakcheck | default 1836 bytes leaked (Mutex, PollableEvent, ReentrantMonitor, nsAStreamCopier, nsPipe, ...)

Categories

(DevTools :: General, defect, P5)

Product:
DevTools
Component:
General
Type:
defect

Tracking

(firefox-esr60 unaffected, firefox-esr68 unaffected, firefox68 unaffected, firefox69 unaffected, firefox70 fixed)

Status:
RESOLVED FIXED
Milestone:
Firefox 70
Tracking Flags:
Tracking Status
firefox-esr60 --- unaffected
firefox-esr68 --- unaffected
firefox68 --- unaffected
firefox69 --- unaffected
firefox70 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ehsan.akhgari)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell fixed:patch])

Attachments

(1 file)

Bug 1556632 - Increase the intermittent leak threshold for all wpt tests on OSX to 2100 bytes to allow for new fields to be added to OriginAttributes;
47 bytes, text/x-phabricator-request
Details | Review

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=249869208&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/bPCvDYnUTpmy06L2Sftxtw/runs/0/artifacts/public/logs/live_backing.log

[task 2019-06-04T06:36:09.059Z] 06:36:09 INFO - TEST-UNEXPECTED-CRASH | /webrtc/simplecall-no-ssrcs.https.html | expected OK
[task 2019-06-04T06:36:09.059Z] 06:36:09 INFO - TEST-INFO took 18255ms
[task 2019-06-04T06:36:23.772Z] 06:36:23 INFO - PID 9471 | #01: mozilla::VideoFrameConverter::ProcessVideoFrame(RefPtr<mozilla::layers::Image> const&, mozilla::TimeStamp, mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits>, bool) [dom/media/VideoFrameConverter.h:312]
[task 2019-06-04T06:36:23.772Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.772Z] 06:36:23 INFO - PID 9471 | #02: mozilla::detail::RunnableMethodImpl<mozilla::VideoFrameConverter*, void (mozilla::VideoFrameConverter::)(RefPtr<mozilla::layers::Image> const&, mozilla::TimeStamp, mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits>, bool), true, (mozilla::RunnableKind)0, StoreCopyPassByLRef<RefPtr<mozilla::layers::Image> >, mozilla::TimeStamp, mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits>, bool>::Run() [xpcom/threads/nsThreadUtils.h:1178]
[task 2019-06-04T06:36:23.772Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.773Z] 06:36:23 INFO - PID 9471 | #03: mozilla::TaskQueue::Runner::Run() [xpcom/threads/TaskQueue.cpp:198]
[task 2019-06-04T06:36:23.773Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.774Z] 06:36:23 INFO - PID 9471 | #04: nsThreadPool::Run() [xpcom/threads/nsThreadPool.cpp:244]
[task 2019-06-04T06:36:23.774Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.775Z] 06:36:23 INFO - PID 9471 | #05: nsThread::ProcessNextEvent(bool, bool) [xpcom/threads/nsThread.cpp:1180]
[task 2019-06-04T06:36:23.775Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.776Z] 06:36:23 INFO - PID 9471 | #06: NS_ProcessNextEvent(nsIThread*, bool) [xpcom/threads/nsThreadUtils.cpp:486]
[task 2019-06-04T06:36:23.776Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.776Z] 06:36:23 INFO - PID 9471 | #07: mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [ipc/glue/MessagePump.cpp:333]
[task 2019-06-04T06:36:23.777Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.777Z] 06:36:23 INFO - PID 9471 | #08: MessageLoop::RunInternal() [ipc/chromium/src/base/message_loop.cc:315]
[task 2019-06-04T06:36:23.777Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.778Z] 06:36:23 INFO - PID 9471 | #09: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:289]
[task 2019-06-04T06:36:23.778Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.779Z] 06:36:23 INFO - PID 9471 | #10: nsThread::ThreadFunc(void*) [xpcom/threads/nsThread.cpp:455]
[task 2019-06-04T06:36:23.779Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.909Z] 06:36:23 INFO - PID 9471 | #11: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2019-06-04T06:36:23.909Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.909Z] 06:36:23 INFO - PID 9471 | #12: libpthread.so.0 + 0x76ba
[task 2019-06-04T06:36:23.909Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.910Z] 06:36:23 INFO - PID 9471 | #13: libc.so.6 + 0x10741d
[task 2019-06-04T06:36:23.910Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.911Z] 06:36:23 INFO - PID 9471 | #14: ??? (???:???)
[task 2019-06-04T06:36:23.912Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Gecko_IOThread] WARNING: pipe error (180): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 358
[task 2019-06-04T06:36:23.913Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Gecko_IOThread] WARNING: pipe error (130): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 358
[task 2019-06-04T06:36:23.914Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Gecko_IOThread] WARNING: pipe error (139): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 358
[task 2019-06-04T06:36:23.915Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/build/src/ipc/glue/ProtocolUtils.cpp, line 608
[task 2019-06-04T06:36:23.915Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/build/src/ipc/glue/ProtocolUtils.cpp, line 608
[task 2019-06-04T06:36:23.916Z] 06:36:23 INFO - PID 9471 | ++DOCSHELL 0x7fd95b289000 == 7 [pid = 9471] [id = {ccd807b5-097a-4dd4-8036-88f8ee6ae629}]
[task 2019-06-04T06:36:23.917Z] 06:36:23 INFO - PID 9471 | ++DOMWINDOW == 14 (0x7fd95e2095c0) [pid = 9471] [serial = 16] [outer = (nil)]
[task 2019-06-04T06:36:23.918Z] 06:36:23 INFO - PID 9471 | ++DOMWINDOW == 15 (0x7fd95b385c00) [pid = 9471] [serial = 17] [outer = 0x7fd95e2095c0]
[task 2019-06-04T06:36:23.919Z] 06:36:23 ERROR - PID 9471 | A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
[task 2019-06-04T06:36:23.920Z] 06:36:23 INFO - PID 9471 | ++DOMWINDOW == 16 (0x7fd95b455400) [pid = 9471] [serial = 18] [outer = 0x7fd95e2095c0]
[task 2019-06-04T06:36:23.920Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Compositor] WARNING: bad Shmem: file /builds/worker/workspace/build/src/ipc/glue/ProtocolUtils.cpp, line 509
[task 2019-06-04T06:36:23.921Z] 06:36:23 INFO - PID 9471 | --DOMWINDOW == 8 (0x7facfd7a5400) [pid = 9524] [serial = 15] [outer = (nil)] [url = moz-extension://efd3b022-c3ea-4f46-b26f-f9a1b98a939e/_generated_background_page.html]
[task 2019-06-04T06:36:23.922Z] 06:36:23 INFO - PID 9471 | --DOCSHELL 0x7fad26579000 == 3 [pid = 9524] [id = {e7af3359-b1b0-4bc5-ae0f-ec5a3536d2ac}] [url = moz-extension://f0b9f65f-f9da-480c-8282-7d9f5c855fb6/_generated_background_page.html]
[task 2019-06-04T06:36:23.922Z] 06:36:23 INFO - PID 9471 | --DOCSHELL 0x7facfdcd0000 == 2 [pid = 9524] [id = {02b5b978-5861-468d-91f1-897211897414}] [url = moz-extension://8d8c7dc6-977d-426f-81c1-15a19ea921e3/_generated_background_page.html]
[task 2019-06-04T06:36:23.923Z] 06:36:23 INFO - PID 9471 | --DOCSHELL 0x7facfed20000 == 1 [pid = 9524] [id = {58559c93-97bb-4af0-81ea-64e1d7cbf7a2}] [url = moz-extension://611566d2-dfce-4db1-bb27-a76d5784799c/_generated_background_page.html]
[task 2019-06-04T06:36:23.924Z] 06:36:23 INFO - PID 9471 | --DOCSHELL 0x7facff0c4000 == 0 [pid = 9524] [id = {b8517dc0-e307-4a18-ae95-26b23ebfdbef}] [url = moz-extension://0dbb37a4-0bd5-4826-ad13-6a3cceeaacc5/_generated_background_page.html]
[task 2019-06-04T06:36:23.925Z] 06:36:23 INFO - PID 9471 | --DOMWINDOW == 3 (0x7f4b54e0f400) [pid = 9553] [serial = 5] [outer = (nil)] [url = http://web-platform.test:8000/testharness_runner.html]
[task 2019-06-04T06:36:23.925Z] 06:36:23 INFO - PID 9471 | --DOMWINDOW == 2 (0x7f4b54e02c00) [pid = 9553] [serial = 4] [outer = (nil)] [url = about:blank]
[task 2019-06-04T06:36:23.926Z] 06:36:23 INFO - PID 9471 | --DOCSHELL 0x7f4b53bcb800 == 0 [pid = 9553] [id = {6eb2ec70-73a0-49e0-bc30-26043200e289}] [url = https://web-platform.test:8443/testharness_runner.html]
[task 2019-06-04T06:36:23.926Z] 06:36:23 INFO - PID 9471 | [Parent 9471, Main Thread] WARNING: unable to post continuation event: file /builds/worker/workspace/build/src/xpcom/io/nsStreamUtils.cpp, line 445
[task 2019-06-04T06:36:23.926Z] 06:36:23 INFO - PID 9471 | --DOMWINDOW == 1 (0x7f4b54ea2d40) [pid = 9553] [serial = 1] [outer = (nil)] [url = https://web-platform.test:8443/testharness_runner.html]
[task 2019-06-04T06:36:23.928Z] 06:36:23 INFO - PID 9471 | --DOMWINDOW == 0 (0x7f4b54e0b000) [pid = 9553] [serial = 6] [outer = (nil)] [url = https://web-platform.test:8443/testharness_runner.html]
[task 2019-06-04T06:36:23.928Z] 06:36:23 INFO - PID 9471 | [Child 9553, Main Thread] WARNING: XPCOM objects created/destroyed from static ctor/dtor: file /builds/worker/workspace/build/src/xpcom/base/nsTraceRefcnt.cpp, line 194
[task 2019-06-04T06:36:23.928Z] 06:36:23 INFO - PID 9471 | [Child 9553, Main Thread] WARNING: XPCOM objects created/destroyed from static ctor/dtor: file /builds/worker/workspace/build/src/xpcom/base/nsTraceRefcnt.cpp, line 194
[task 2019-06-04T06:36:23.929Z] 06:36:23 INFO - PID 9471 | nsStringStats
[task 2019-06-04T06:36:23.930Z] 06:36:23 INFO - PID 9471 | => mAllocCount: 9955
[task 2019-06-04T06:36:23.930Z] 06:36:23 INFO - PID 9471 | => mReallocCount: 0
[task 2019-06-04T06:36:23.931Z] 06:36:23 INFO - PID 9471 | => mFreeCount: 9955
[task 2019-06-04T06:36:23.931Z] 06:36:23 INFO - PID 9471 | => mShareCount: 7769
[task 2019-06-04T06:36:23.931Z] 06:36:23 INFO - PID 9471 | => mAdoptCount: 884
[task 2019-06-04T06:36:23.932Z] 06:36:23 INFO - PID 9471 | => mAdoptFreeCount: 892
[task 2019-06-04T06:36:23.933Z] 06:36:23 INFO - PID 9471 | => Process ID: 9553, Thread ID: 139962208413504
...
[task 2019-06-04T06:36:23.996Z] 06:36:23 INFO - TEST-PASS | leakcheck | tab no leaks detected!
[task 2019-06-04T06:36:23.996Z] 06:36:23 INFO - leakcheck | Processing leak log file /tmp/tmpoKZdYM.mozrunner/runtests_leaks_836_tab_pid9620.log
[task 2019-06-04T06:36:23.996Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.996Z] 06:36:23 INFO - == BloatView: ALL (cumulative) LEAK AND BLOAT STATISTICS, tab process 9620
[task 2019-06-04T06:36:23.997Z] 06:36:23 INFO -
[task 2019-06-04T06:36:23.997Z] 06:36:23 INFO - |<----------------Class--------------->|<-----Bytes------>|<----Objects---->|
[task 2019-06-04T06:36:23.997Z] 06:36:23 INFO - | | Per-Inst Leaked| Total Rem|
[task 2019-06-04T06:36:23.998Z] 06:36:23 INFO - 0 |TOTAL | 34 0| 139694 0|
[task 2019-06-04T06:36:24.001Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.002Z] 06:36:24 INFO - nsTraceRefcnt::DumpStatistics: 949 entries
[task 2019-06-04T06:36:24.002Z] 06:36:24 INFO - TEST-PASS | leakcheck | tab no leaks detected!
[task 2019-06-04T06:36:24.003Z] 06:36:24 INFO - leakcheck | Processing leak log file /tmp/tmpoKZdYM.mozrunner/runtests_leaks_836_tab_pid9665.log
[task 2019-06-04T06:36:24.003Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.004Z] 06:36:24 INFO - == BloatView: ALL (cumulative) LEAK AND BLOAT STATISTICS, tab process 9665
[task 2019-06-04T06:36:24.005Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.005Z] 06:36:24 INFO - |<----------------Class--------------->|<-----Bytes------>|<----Objects---->|
[task 2019-06-04T06:36:24.006Z] 06:36:24 INFO - | | Per-Inst Leaked| Total Rem|
[task 2019-06-04T06:36:24.006Z] 06:36:24 INFO - 0 |TOTAL | 40 0| 14287 0|
[task 2019-06-04T06:36:24.007Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.007Z] 06:36:24 INFO - nsTraceRefcnt::DumpStatistics: 403 entries
[task 2019-06-04T06:36:24.008Z] 06:36:24 INFO - TEST-PASS | leakcheck | tab no leaks detected!
[task 2019-06-04T06:36:24.008Z] 06:36:24 INFO - leakcheck | Processing leak log file /tmp/tmpoKZdYM.mozrunner/runtests_leaks_836.log
[task 2019-06-04T06:36:24.009Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.010Z] 06:36:24 INFO - == BloatView: ALL (cumulative) LEAK AND BLOAT STATISTICS, default process 9471
[task 2019-06-04T06:36:24.010Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.010Z] 06:36:24 INFO - |<----------------Class--------------->|<-----Bytes------>|<----Objects---->|
[task 2019-06-04T06:36:24.011Z] 06:36:24 INFO - | | Per-Inst Leaked| Total Rem|
[task 2019-06-04T06:36:24.012Z] 06:36:24 INFO - 0 |TOTAL | 41 1836| 3397381 12|
[task 2019-06-04T06:36:24.012Z] 06:36:24 INFO - 537 |Mutex | 72 216| 3268 3|
[task 2019-06-04T06:36:24.013Z] 06:36:24 INFO - 815 |PollableEvent | 32 32| 1 1|
[task 2019-06-04T06:36:24.015Z] 06:36:24 INFO - 867 |ReentrantMonitor | 40 40| 6121 1|
[task 2019-06-04T06:36:24.016Z] 06:36:24 INFO - 1387 |nsAStreamCopier | 40 40| 501 1|
[task 2019-06-04T06:36:24.019Z] 06:36:24 INFO - 1714 |nsPipe | 208 208| 839 1|
[task 2019-06-04T06:36:24.020Z] 06:36:24 INFO - 1715 |nsPipeInputStream | 136 136| 839 1|
[task 2019-06-04T06:36:24.020Z] 06:36:24 INFO - 1770 |nsSocketTransport | 816 816| 8 1|
[task 2019-06-04T06:36:24.020Z] 06:36:24 INFO - 1771 |nsSocketTransportService | 328 328| 1 1|
[task 2019-06-04T06:36:24.021Z] 06:36:24 INFO - 1782 |nsStringBuffer | 12 12| 96458 1|
[task 2019-06-04T06:36:24.021Z] 06:36:24 INFO - 1824 |nsTArray_base | 8 8| 1544072 1|
[task 2019-06-04T06:36:24.022Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.023Z] 06:36:24 INFO - nsTraceRefcnt::DumpStatistics: 1953 entries
[task 2019-06-04T06:36:24.023Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 3 Mutex
[task 2019-06-04T06:36:24.024Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 PollableEvent
[task 2019-06-04T06:36:24.025Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 ReentrantMonitor
[task 2019-06-04T06:36:24.025Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsAStreamCopier
[task 2019-06-04T06:36:24.026Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsPipe
[task 2019-06-04T06:36:24.026Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsPipeInputStream
[task 2019-06-04T06:36:24.026Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsSocketTransport
[task 2019-06-04T06:36:24.028Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsSocketTransportService
[task 2019-06-04T06:36:24.028Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsStringBuffer
[task 2019-06-04T06:36:24.028Z] 06:36:24 INFO - TEST-INFO | leakcheck | default leaked 1 nsTArray_base
[task 2019-06-04T06:36:24.030Z] 06:36:24 INFO - TEST-UNEXPECTED-FAIL | leakcheck | default 1836 bytes leaked (Mutex, PollableEvent, ReentrantMonitor, nsAStreamCopier, nsPipe, ...)
[task 2019-06-04T06:36:24.030Z] 06:36:24 INFO -
[task 2019-06-04T06:36:24.032Z] 06:36:24 INFO - Closing logging queue
[task 2019-06-04T06:36:24.032Z] 06:36:24 INFO - queue closed

Not sure if it's the same cause as bug 1436244.

In the last 48 hours, there have been 29 occurrences, all on macosx1014-64 debug.

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=257613259&repo=autoland&lineNumber=9993

00:30:46 INFO - nsTraceRefcnt::DumpStatistics: 1967 entries
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 3 Mutex
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 PollableEvent
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 ReentrantMonitor
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsAStreamCopier
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsPipe
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsPipeInputStream
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsSocketTransport
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsSocketTransportService
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 1 nsStringBuffer
00:30:46 INFO - TEST-INFO | leakcheck | default leaked 2 nsTArray_base
00:30:46 INFO - TEST-UNEXPECTED-FAIL | leakcheck | default 2012 bytes leaked (Mutex, PollableEvent, ReentrantMonitor, nsAStreamCopier, nsPipe, ...)
00:30:46 INFO -

That's bug 1558944, do we need to further increase the threshold?

Flags: needinfo?(esawin) → needinfo?(ehsan)

:apavel, It sounds like :esawin is on this- I agree this is close enough to a perma failing test that we should be backing out- Give it another day if it is a simple tweak of a threshold.

Flags: needinfo?(jmaher)

I think the problem is that I modified testing/web-platform/mozilla/meta/dir.ini but not testing/web-platform/meta/dir.ini... Patch coming up.

Flags: needinfo?(ehsan)
Pushed by eakhgari@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/059024f2d67b
Increase the intermittent leak threshold for all wpt tests on OSX to 2100 bytes to allow for new fields to be added to OriginAttributes; r=mccr8

https://hg.mozilla.org/mozilla-central/rev/059024f2d67b

Status: NEW → RESOLVED
Closed: 5 years ago
status-firefox70: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → Firefox 70
Assignee: nobody → ehsan
Whiteboard: [stockwell disable-recommended] → [stockwell fixed:patch]
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: