Closed Bug 1395843 Opened 7 years ago Closed 4 years ago

Intermittent LeakSanitizer | leak at unknown stack

Categories

(Core :: General, defect, P5)

defect

Tracking

()

RESOLVED FIXED
mozilla76
Tracking Status
firefox76 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: jdescottes)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell unknown])

Attachments

(3 files)

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=127661610&repo=autoland

https://queue.taskcluster.net/v1/task/RglAmdH2SLOaYyoC6TjZIw/runs/1/artifacts/public/logs/live_backing.log

[task 2017-09-01T07:03:03.073890Z] 07:03:03     INFO - *** End BrowserChrome Test Results ***
[task 2017-09-01T07:03:05.651638Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: failed to fork (errno 12)
[task 2017-09-01T07:03:05.696297Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: failed to fork (errno 12)
[task 2017-09-01T07:03:05.737151Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: failed to fork (errno 12)
[task 2017-09-01T07:03:05.999454Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: failed to fork (errno 12)
[task 2017-09-01T07:03:05.999654Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: failed to fork (errno 12)
[task 2017-09-01T07:03:05.999745Z] 07:03:05     INFO - GECKO(4552) | ==4708==WARNING: Failed to use and restart external symbolizer!
[task 2017-09-01T07:03:07.023298Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.026816Z] 07:03:07     INFO - GECKO(4552) | Suppressions used:
[task 2017-09-01T07:03:07.027977Z] 07:03:07     INFO - GECKO(4552) |   count      bytes template
[task 2017-09-01T07:03:07.031065Z] 07:03:07     INFO - GECKO(4552) |     695      22168 nsComponentManagerImpl
[task 2017-09-01T07:03:07.031120Z] 07:03:07     INFO - GECKO(4552) |       4        640 mozJSComponentLoader::LoadModule
[task 2017-09-01T07:03:07.031158Z] 07:03:07     INFO - GECKO(4552) |     304       8933 libfontconfig.so
[task 2017-09-01T07:03:07.031193Z] 07:03:07     INFO - GECKO(4552) |      16       2316 libglib-2.0.so
[task 2017-09-01T07:03:07.031233Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.031273Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.031304Z] 07:03:07     INFO - GECKO(4552) | Suppressions used:
[task 2017-09-01T07:03:07.031336Z] 07:03:07     INFO - GECKO(4552) |   count      bytes template
[task 2017-09-01T07:03:07.031371Z] 07:03:07     INFO - GECKO(4552) |     698      22256 nsComponentManagerImpl
[task 2017-09-01T07:03:07.031739Z] 07:03:07     INFO - GECKO(4552) |       3        480 mozJSComponentLoader::LoadModule
[task 2017-09-01T07:03:07.032273Z] 07:03:07     INFO - GECKO(4552) |     304       8933 libfontconfig.so
[task 2017-09-01T07:03:07.032744Z] 07:03:07     INFO - GECKO(4552) |       1         72 nss_ClearErrorStack
[task 2017-09-01T07:03:07.033265Z] 07:03:07     INFO - GECKO(4552) |      16       2316 libglib-2.0.so
[task 2017-09-01T07:03:07.033752Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.034238Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.034690Z] 07:03:07     INFO - GECKO(4552) | Suppressions used:
[task 2017-09-01T07:03:07.035164Z] 07:03:07     INFO - GECKO(4552) |   count      bytes template
[task 2017-09-01T07:03:07.035640Z] 07:03:07     INFO - GECKO(4552) |     704      22432 nsComponentManagerImpl
[task 2017-09-01T07:03:07.036120Z] 07:03:07     INFO - GECKO(4552) |       4        640 mozJSComponentLoader::LoadModule
[task 2017-09-01T07:03:07.036603Z] 07:03:07     INFO - GECKO(4552) |     304       8933 libfontconfig.so
[task 2017-09-01T07:03:07.037084Z] 07:03:07     INFO - GECKO(4552) |       1         72 nss_ClearErrorStack
[task 2017-09-01T07:03:07.037537Z] 07:03:07     INFO - GECKO(4552) |      16       2316 libglib-2.0.so
[task 2017-09-01T07:03:07.038017Z] 07:03:07     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:07.580377Z] 07:03:07     INFO - GECKO(4552) | =================================================================
[task 2017-09-01T07:03:07.580677Z] 07:03:07    ERROR - GECKO(4552) | ==4708==ERROR: LeakSanitizer: detected memory leaks
[task 2017-09-01T07:03:07.581705Z] 07:03:07     INFO - GECKO(4552) | Direct leak of 160 byte(s) in 1 object(s) allocated from:
[task 2017-09-01T07:03:07.589149Z] 07:03:07     INFO - GECKO(4552) |     #0 0x4bba1c  (/builds/worker/workspace/build/application/firefox/firefox+0x4bba1c)
[task 2017-09-01T07:03:07.589990Z] 07:03:07     INFO - GECKO(4552) |     #1 0x4ecf3d  (/builds/worker/workspace/build/application/firefox/firefox+0x4ecf3d)
[task 2017-09-01T07:03:07.592016Z] 07:03:07     INFO - GECKO(4552) |     #2 0x7f5997cab052  (/builds/worker/workspace/build/application/firefox/libxul.so+0x386e052)
[task 2017-09-01T07:03:07.594242Z] 07:03:07     INFO - GECKO(4552) |     #3 0x7f59965b44a7  (/builds/worker/workspace/build/application/firefox/libxul.so+0x21774a7)
[task 2017-09-01T07:03:07.594374Z] 07:03:07     INFO - GECKO(4552) |     #4 0x7f59965b546e  (/builds/worker/workspace/build/application/firefox/libxul.so+0x217846e)
[task 2017-09-01T07:03:07.594566Z] 07:03:07     INFO - GECKO(4552) |     #5 0x7f59965ac073  (/builds/worker/workspace/build/application/firefox/libxul.so+0x216f073)
[task 2017-09-01T07:03:07.595008Z] 07:03:07     INFO - GECKO(4552) |     #6 0x7f5997d435be  (/builds/worker/workspace/build/application/firefox/libxul.so+0x39065be)
[task 2017-09-01T07:03:07.597100Z] 07:03:07     INFO - GECKO(4552) |     #7 0x7f5996625041  (/builds/worker/workspace/build/application/firefox/libxul.so+0x21e8041)
[task 2017-09-01T07:03:07.597691Z] 07:03:07     INFO - GECKO(4552) |     #8 0x7f5997dbade0  (/builds/worker/workspace/build/application/firefox/libxul.so+0x397dde0)
[task 2017-09-01T07:03:07.598260Z] 07:03:07     INFO - GECKO(4552) |     #9 0x7f5997dc1daf  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3984daf)
[task 2017-09-01T07:03:07.598796Z] 07:03:07     INFO - GECKO(4552) |     #10 0x7f59a12569c4  (/builds/worker/workspace/build/application/firefox/libxul.so+0xce199c4)
[task 2017-09-01T07:03:07.599401Z] 07:03:07     INFO - GECKO(4552) |     #11 0x7f59a124046d  (/builds/worker/workspace/build/application/firefox/libxul.so+0xce0346d)
[task 2017-09-01T07:03:07.600049Z] 07:03:07     INFO - GECKO(4552) |     #12 0x7f59a1227bab  (/builds/worker/workspace/build/application/firefox/libxul.so+0xcdeabab)
[task 2017-09-01T07:03:07.600685Z] 07:03:07     INFO - GECKO(4552) |     #13 0x7f59a12592d7  (/builds/worker/workspace/build/application/firefox/libxul.so+0xce1c2d7)
[task 2017-09-01T07:03:07.601562Z] 07:03:07     INFO - GECKO(4552) |     #14 0x7f59a12aa4b7  (/builds/worker/workspace/build/application/firefox/libxul.so+0xce6d4b7)
[task 2017-09-01T07:03:07.602160Z] 07:03:07     INFO - GECKO(4552) |     #15 0x7f5998dc2583  (/builds/worker/workspace/build/application/firefox/libxul.so+0x4985583)
[task 2017-09-01T07:03:07.602553Z] 07:03:07     INFO - GECKO(4552) |     #16 0x7f5998fb7b39  (/builds/worker/workspace/build/application/firefox/libxul.so+0x4b7ab39)
[task 2017-09-01T07:03:07.602964Z] 07:03:07     INFO - GECKO(4552) |     #17 0x7f599c24fc8d  (/builds/worker/workspace/build/application/firefox/libxul.so+0x7e12c8d)
[task 2017-09-01T07:03:07.603270Z] 07:03:07     INFO - GECKO(4552) |     #18 0x7f5997ac7d56  (/builds/worker/workspace/build/application/firefox/libxul.so+0x368ad56)
[task 2017-09-01T07:03:07.603758Z] 07:03:07     INFO - GECKO(4552) |     #19 0x7f5997397f69  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2f5af69)
[task 2017-09-01T07:03:07.604292Z] 07:03:07     INFO - GECKO(4552) |     #20 0x7f5997394d44  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2f57d44)
[task 2017-09-01T07:03:07.604950Z] 07:03:07     INFO - GECKO(4552) |     #21 0x7f5997396554  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2f59554)
[task 2017-09-01T07:03:07.605478Z] 07:03:07     INFO - GECKO(4552) |     #22 0x7f5997396ba8  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2f59ba8)
[task 2017-09-01T07:03:07.606248Z] 07:03:07     INFO - GECKO(4552) |     #23 0x7f59965ff7bd  (/builds/worker/workspace/build/application/firefox/libxul.so+0x21c27bd)
[task 2017-09-01T07:03:07.606775Z] 07:03:07     INFO - GECKO(4552) |     #24 0x7f5996604df8  (/builds/worker/workspace/build/application/firefox/libxul.so+0x21c7df8)
[task 2017-09-01T07:03:07.607476Z] 07:03:07     INFO - GECKO(4552) |     #25 0x7f599739fb31  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2f62b31)
[task 2017-09-01T07:03:07.608032Z] 07:03:07     INFO - GECKO(4552) |     #26 0x7f599730024b  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2ec324b)
[task 2017-09-01T07:03:07.608706Z] 07:03:07     INFO - GECKO(4552) |     #27 0x7f599ca6162f  (/builds/worker/workspace/build/application/firefox/libxul.so+0x862462f)
[task 2017-09-01T07:03:07.609365Z] 07:03:07     INFO - GECKO(4552) |     #28 0x7f59a0d70137  (/builds/worker/workspace/build/application/firefox/libxul.so+0xc933137)
[task 2017-09-01T07:03:07.610016Z] 07:03:07     INFO - GECKO(4552) |     #29 0x7f599730024b  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2ec324b)


...

[task 2017-09-01T07:03:14.312437Z] 07:03:14     INFO - GECKO(4552) | Suppressions used:
[task 2017-09-01T07:03:14.312483Z] 07:03:14     INFO - GECKO(4552) |   count      bytes template
[task 2017-09-01T07:03:14.312526Z] 07:03:14     INFO - GECKO(4552) |     676      21872 libc.so
[task 2017-09-01T07:03:14.312572Z] 07:03:14     INFO - GECKO(4552) |     304       8933 libfontconfig.so
[task 2017-09-01T07:03:14.312616Z] 07:03:14     INFO - GECKO(4552) |      16       2316 libglib-2.0.so
[task 2017-09-01T07:03:14.312667Z] 07:03:14     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:14.312794Z] 07:03:14     INFO - GECKO(4552) | SUMMARY: AddressSanitizer: 12064 byte(s) leaked in 392 allocation(s).
[task 2017-09-01T07:03:15.963306Z] 07:03:15     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:15.963665Z] 07:03:15     INFO - GECKO(4552) | Suppressions used:
[task 2017-09-01T07:03:15.963939Z] 07:03:15     INFO - GECKO(4552) |   count      bytes template
[task 2017-09-01T07:03:15.964297Z] 07:03:15     INFO - GECKO(4552) |     715      22776 nsComponentManagerImpl
[task 2017-09-01T07:03:15.964608Z] 07:03:15     INFO - GECKO(4552) |      51       8160 mozJSComponentLoader::LoadModule
[task 2017-09-01T07:03:15.965009Z] 07:03:15     INFO - GECKO(4552) |       1        384 pixman_implementation_lookup_composite
[task 2017-09-01T07:03:15.965346Z] 07:03:15     INFO - GECKO(4552) |     611      17509 libfontconfig.so
[task 2017-09-01T07:03:15.965729Z] 07:03:15     INFO - GECKO(4552) |       1         32 libdl.so
[task 2017-09-01T07:03:15.965999Z] 07:03:15     INFO - GECKO(4552) |      17       4348 libglib-2.0.so
[task 2017-09-01T07:03:15.966409Z] 07:03:15     INFO - GECKO(4552) |       1         40 libpulsecommon-8.0.so
[task 2017-09-01T07:03:15.966668Z] 07:03:15     INFO - GECKO(4552) | -----------------------------------------------------
[task 2017-09-01T07:03:16.406361Z] 07:03:16     INFO - TEST-INFO | Main app process: exit 0
[task 2017-09-01T07:03:16.406765Z] 07:03:16     INFO - TEST-INFO | LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2017-09-01T07:03:16.407370Z] 07:03:16     INFO - TEST-INFO | LeakSanitizer | This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2017-09-01T07:03:16.407870Z] 07:03:16    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at unknown stack
https://treeherder.mozilla.org/logviewer.html#?job_id=179269394&repo=mozilla-inbound&lineNumber=3518

[task 2018-05-18T23:18:24.631Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.634Z] 23:18:24     INFO - GECKO(1056) | Suppressions used:
[task 2018-05-18T23:18:24.634Z] 23:18:24     INFO - GECKO(1056) |   count      bytes template
[task 2018-05-18T23:18:24.634Z] 23:18:24     INFO - GECKO(1056) |     627      20768 libc.so
[task 2018-05-18T23:18:24.635Z] 23:18:24     INFO - GECKO(1056) |     611      17713 libfontconfig.so
[task 2018-05-18T23:18:24.636Z] 23:18:24     INFO - GECKO(1056) |       1         29 libglib-2.0.so
[task 2018-05-18T23:18:24.641Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.641Z] 23:18:24     INFO - GECKO(1056) | SUMMARY: AddressSanitizer: 1776 byte(s) leaked in 24 allocation(s).
[task 2018-05-18T23:18:24.641Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.641Z] 23:18:24     INFO - GECKO(1056) | Suppressions used:
[task 2018-05-18T23:18:24.643Z] 23:18:24     INFO - GECKO(1056) |   count      bytes template
[task 2018-05-18T23:18:24.644Z] 23:18:24     INFO - GECKO(1056) |     681      21608 nsComponentManagerImpl
[task 2018-05-18T23:18:24.645Z] 23:18:24     INFO - GECKO(1056) |      11       2288 mozJSComponentLoader::LoadModule
[task 2018-05-18T23:18:24.664Z] 23:18:24     INFO - GECKO(1056) |     611      17713 libfontconfig.so
[task 2018-05-18T23:18:24.664Z] 23:18:24     INFO - GECKO(1056) |       2         88 _PR_Getfd
[task 2018-05-18T23:18:24.664Z] 23:18:24     INFO - GECKO(1056) |       1         29 libglib-2.0.so
[task 2018-05-18T23:18:24.665Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.666Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.671Z] 23:18:24     INFO - GECKO(1056) | Suppressions used:
[task 2018-05-18T23:18:24.672Z] 23:18:24     INFO - GECKO(1056) |   count      bytes template
[task 2018-05-18T23:18:24.674Z] 23:18:24     INFO - GECKO(1056) |     648      20640 nsComponentManagerImpl
[task 2018-05-18T23:18:24.679Z] 23:18:24     INFO - GECKO(1056) |      10       2080 mozJSComponentLoader::LoadModule
[task 2018-05-18T23:18:24.680Z] 23:18:24     INFO - GECKO(1056) |     611      17713 libfontconfig.so
[task 2018-05-18T23:18:24.688Z] 23:18:24     INFO - GECKO(1056) |       1         29 libglib-2.0.so
[task 2018-05-18T23:18:24.688Z] 23:18:24     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:24.748Z] 23:18:24     INFO - GECKO(1056) | LLVM ERROR: IO failure on output stream: Broken pipe
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) | Suppressions used:
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |   count      bytes template
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |     688      21832 nsComponentManagerImpl
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |      50      10400 mozJSComponentLoader::LoadModule
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |     612      17514 libfontconfig.so
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |      14        616 _PR_Getfd
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) |       1         29 libglib-2.0.so
[task 2018-05-18T23:18:31.756Z] 23:18:31     INFO - GECKO(1056) | -----------------------------------------------------
[task 2018-05-18T23:18:32.054Z] 23:18:32     INFO - TEST-INFO | Main app process: exit 0
[task 2018-05-18T23:18:32.056Z] 23:18:32     INFO - TEST-INFO | LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2018-05-18T23:18:32.058Z] 23:18:32     INFO - TEST-INFO | LeakSanitizer | This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2018-05-18T23:18:32.059Z] 23:18:32    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at unknown stack
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 7 years ago6 years ago
Resolution: --- → INCOMPLETE
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 6 years ago6 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=200642672&repo=mozilla-beta&lineNumber=5196
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=213672418&repo=autoland&lineNumber=3167

task 2018-11-24T13:09:31.231Z] 13:09:31     INFO - GECKO(1064) | SUMMARY: AddressSanitizer: 1688 byte(s) leaked in 21 allocation(s).
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) | Suppressions used:
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) |   count      bytes template
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) |     515      16432 nsComponentManagerImpl
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) |       4        832 mozJSComponentLoader::LoadModule
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) |     611      17713 libfontconfig.so
[task 2018-11-24T13:09:34.943Z] 13:09:34     INFO - GECKO(1064) |       1         29 libglib-2.0.so
[task 2018-11-24T13:09:34.945Z] 13:09:34     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:38.491Z] 13:09:38     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) | Suppressions used:
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) |   count      bytes template
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) |     530      16872 nsComponentManagerImpl
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) |       9       1872 mozJSComponentLoader::LoadModule
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) |     611      17713 libfontconfig.so
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) |       1         29 libglib-2.0.so
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:38.494Z] 13:09:38     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) | Suppressions used:
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |   count      bytes template
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |     551      17488 nsComponentManagerImpl
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |      10       2080 mozJSComponentLoader::LoadModule
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |     611      17713 libfontconfig.so
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |       2         88 _PR_Getfd
[task 2018-11-24T13:09:38.495Z] 13:09:38     INFO - GECKO(1064) |       1         29 libglib-2.0.so
[task 2018-11-24T13:09:38.496Z] 13:09:38     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:45.104Z] 13:09:45     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:45.105Z] 13:09:45     INFO - GECKO(1064) | Suppressions used:
[task 2018-11-24T13:09:45.106Z] 13:09:45     INFO - GECKO(1064) |   count      bytes template
[task 2018-11-24T13:09:45.107Z] 13:09:45     INFO - GECKO(1064) |     567      17976 nsComponentManagerImpl
[task 2018-11-24T13:09:45.108Z] 13:09:45     INFO - GECKO(1064) |      50      10400 mozJSComponentLoader::LoadModule
[task 2018-11-24T13:09:45.109Z] 13:09:45     INFO - GECKO(1064) |     612      17514 libfontconfig.so
[task 2018-11-24T13:09:45.109Z] 13:09:45     INFO - GECKO(1064) |      14        616 _PR_Getfd
[task 2018-11-24T13:09:45.109Z] 13:09:45     INFO - GECKO(1064) |       1         29 libglib-2.0.so
[task 2018-11-24T13:09:45.109Z] 13:09:45     INFO - GECKO(1064) |       5        140 libresolv.so
[task 2018-11-24T13:09:45.109Z] 13:09:45     INFO - GECKO(1064) | -----------------------------------------------------
[task 2018-11-24T13:09:45.537Z] 13:09:45     INFO - TEST-INFO | Main app process: exit 0
[task 2018-11-24T13:09:45.538Z] 13:09:45     INFO - TEST-INFO | LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2018-11-24T13:09:45.539Z] 13:09:45     INFO - TEST-INFO | LeakSanitizer | This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2018-11-24T13:09:45.540Z] 13:09:45    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at unknown stack
[task 2018-11-24T13:09:45.543Z] 13:09:45     INFO - runtests.py | Application ran for: 0:18:11.528203
[task 2018-11-24T13:09:45.544Z] 13:09:45     INFO - zombiecheck | Reading PID log: /tmp/tmpW23jXOpidlog
[task 2018-11-24T13:09:45.546Z] 13:09:45     INFO - ==> process 1064 launched child process 1083
[task 2018-11-24T13:09:45.548Z] 13:09:45     INFO - ==> process 1064 launched child process 1159
[task 2018-11-24T13:09:45.551Z] 13:09:45     INFO - ==> process 1064 launched child process 1176
[task 2018-11-24T13:09:45.551Z] 13:09:45     INFO - ==> process 1064 launched child process 1225
[task 2018-11-24T13:09:45.552Z] 13:09:45     INFO - ==> process 1064 launched child process 1258
[task 2018-11-24T13:09:45.553Z] 13:09:45     INFO - ==> process 1064 launched child process 1282
[task 2018-11-24T13:09:45.554Z] 13:09:45     INFO - ==> process 1289 launched child process 1316
[task 2018-11-24T13:09:45.555Z] 13:09:45     INFO - ==> process 1064 launched child process 1475
[task 2018-11-24T13:09:45.555Z] 13:09:45     INFO - ==> process 1064 launched child process 1479
[task 2018-11-24T13:09:45.556Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1282
[task 2018-11-24T13:09:45.557Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1475
[task 2018-11-24T13:09:45.557Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1316
[task 2018-11-24T13:09:45.558Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1159
[task 2018-11-24T13:09:45.559Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1225
[task 2018-11-24T13:09:45.559Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1258
[task 2018-11-24T13:09:45.560Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1479
[task 2018-11-24T13:09:45.561Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1176
[task 2018-11-24T13:09:45.562Z] 13:09:45     INFO - zombiecheck | Checking for orphan process with PID: 1083
[task 2018-11-24T13:09:45.566Z] 13:09:45     INFO - Stopping web server
[task 2018-11-24T13:09:45.602Z] 13:09:45     INFO - Stopping web socket server
[task 2018-11-24T13:09:45.635Z] 13:09:45     INFO - Stopping ssltunnel
[task 2018-11-24T13:09:45.655Z] 13:09:45  WARNING - leakcheck | refcount logging is off, so leaks can't be detected!
[task 2018-11-24T13:09:45.656Z] 13:09:45     INFO - runtests.py | Running tests: end.
[task 2018-11-24T13:09:45.725Z] 13:09:45     INFO - Buffered messages finished
[task 2018-11-24T13:09:45.725Z] 13:09:45     INFO -  TEST-INFO | checking window state
[task 2018-11-24T13:09:45.727Z] 13:09:45     INFO -  Browser Chrome Test Summary
[task 2018-11-24T13:09:45.728Z] 13:09:45     INFO -  	Passed: 7446
[task 2018-11-24T13:09:45.729Z] 13:09:45     INFO -  	Failed: 1
[task 2018-11-24T13:09:45.729Z] 13:09:45     INFO -  	Todo: 0
[task 2018-11-24T13:09:45.730Z] 13:09:45     INFO -  	Mode: e10s
[task 2018-11-24T13:09:45.731Z] 13:09:45     INFO -  *** End BrowserChrome Test Results ***
[task 2018-11-24T13:09:45.732Z] 13:09:45     INFO - Buffered messages finished
[task 2018-11-24T13:09:45.733Z] 13:09:45     INFO - SUITE-END | took 1092s
[task 2018-11-24T13:09:45.802Z] 13:09:45    ERROR - Return code: 1
This seems to have spiked only on the 27th in the last 30 days, all leaks within this test browser_ext_windows_update.js on linux64 asan.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=213672418&repo=autoland&lineNumber=2946

[task 2018-11-24T13:09:09.642Z] 13:09:09     INFO - TEST-START | browser/components/extensions/test/browser/browser_ext_windows_update.js
[task 2018-11-24T13:09:13.583Z] 13:09:13     INFO - GECKO(1064) | MEMORY STAT | vsize 20976673MB | residentFast 3161MB
[task 2018-11-24T13:09:13.584Z] 13:09:13     INFO - TEST-OK | browser/components/extensions/test/browser/browser_ext_windows_update.js | took 3945ms
[task 2018-11-24T13:09:13.706Z] 13:09:13     INFO - checking window state
[task 2018-11-24T13:09:21.957Z] 13:09:21     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1282
[task 2018-11-24T13:09:21.973Z] 13:09:21     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1159
[task 2018-11-24T13:09:22.157Z] 13:09:22     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1225
[task 2018-11-24T13:09:22.198Z] 13:09:22     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1176
[task 2018-11-24T13:09:22.349Z] 13:09:22     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1258
[task 2018-11-24T13:09:24.528Z] 13:09:24     INFO - GECKO(1064) | Completed ShutdownLeaks collections in process 1064
[task 2018-11-24T13:09:24.530Z] 13:09:24     INFO - TEST-START | Shutdown
[task 2018-11-24T13:09:24.531Z] 13:09:24     INFO - Browser Chrome Test Summary
[task 2018-11-24T13:09:24.532Z] 13:09:24     INFO - Passed:  7446
[task 2018-11-24T13:09:24.533Z] 13:09:24     INFO - Failed:  0
[task 2018-11-24T13:09:24.534Z] 13:09:24     INFO - Todo:    0
[task 2018-11-24T13:09:24.536Z] 13:09:24     INFO - Mode:    e10s
[task 2018-11-24T13:09:24.537Z] 13:09:24     INFO - *** End BrowserChrome Test Results ***
[task 2018-11-24T13:09:25.265Z] 13:09:25     INFO - GECKO(1064) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2018-11-24T13:09:27.150Z] 13:09:27     INFO - GECKO(1064) | LLVM ERROR: out of memory

[task 2018-11-24T13:09:29.141Z] 13:09:29     INFO - GECKO(1064) | /builds/worker/workspace/build/application/firefox/llvm-symbolizer[0x40f10d]
[task 2018-11-24T13:09:29.143Z] 13:09:29     INFO - GECKO(1064) | ==1282==WARNING: Can't read from symbolizer at fd 3
[task 2018-11-24T13:09:29.188Z] 13:09:29     INFO - GECKO(1064) | ==1282==WARNING: Failed to use and restart external symbolizer!
[task 2018-11-24T13:09:29.474Z] 13:09:29     INFO - GECKO(1064) | =================================================================
[task 2018-11-24T13:09:29.474Z] 13:09:29    ERROR - GECKO(1064) | ==1282==ERROR: LeakSanitizer: detected memory leaks
[task 2018-11-24T13:09:29.485Z] 13:09:29     INFO - GECKO(1064) | Direct leak of 208 byte(s) in 1 object(s) allocated from:
[task 2018-11-24T13:09:29.485Z] 13:09:29     INFO - GECKO(1064) |     #0 0x55b13d60f943  (/builds/worker/workspace/build/application/firefox/firefox+0xd1943)
[task 2018-11-24T13:09:29.485Z] 13:09:29     INFO - GECKO(1064) |     #1 0x55b13d6432dd  (/builds/worker/workspace/build/application/firefox/firefox+0x1052dd)
[task 2018-11-24T13:09:29.486Z] 13:09:29     INFO - GECKO(1064) |     #2 0x7efd8e1a4725  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3bb1725)
[task 2018-11-24T13:09:29.488Z] 13:09:29     INFO - GECKO(1064) |     #3 0x7efd8c81d3f1  (/builds/worker/workspace/build/application/firefox/libxul.so+0x222a3f1)
[task 2018-11-24T13:09:29.490Z] 13:09:29     INFO - GECKO(1064) |     #4 0x7efd8c81ec72  (/builds/worker/workspace/build/application/firefox/libxul.so+0x222bc72)
[task 2018-11-24T13:09:29.494Z] 13:09:29     INFO - GECKO(1064) |     #5 0x7efd8c81f996  (/builds/worker/workspace/build/application/firefox/libxul.so+0x222c996)
[task 2018-11-24T13:09:29.495Z] 13:09:29     INFO - GECKO(1064) |     #6 0x7efd8c817380  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2224380)
[task 2018-11-24T13:09:29.497Z] 13:09:29     INFO - GECKO(1064) |     #7 0x7efd8c825dd5  (/builds/worker/workspace/build/application/firefox/libxul.so+0x2232dd5)
[task 2018-11-24T13:09:29.498Z] 13:09:29     INFO - GECKO(1064) |     #8 0x7efd8c6c07fe  (/builds/worker/workspace/build/application/firefox/libxul.so+0x20cd7fe)
[task 2018-11-24T13:09:29.500Z] 13:09:29     INFO - GECKO(1064) |     #9 0x7efd8f9766a5  (/builds/worker/workspace/build/application/firefox/libxul.so+0x53836a5)
[task 2018-11-24T13:09:29.501Z] 13:09:29     INFO - GECKO(1064) |     #10 0x7efd91693ab9  (/builds/worker/workspace/build/application/firefox/libxul.so+0x70a0ab9)
[task 2018-11-24T13:09:29.502Z] 13:09:29     INFO - GECKO(1064) |     #11 0x7efd9226b3f9  (/builds/worker/workspace/build/application/firefox/libxul.so+0x7c783f9)
[task 2018-11-24T13:09:29.506Z] 13:09:29     INFO - GECKO(1064) |     #12 0x7efd9a581b9d  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff8eb9d)
[task 2018-11-24T13:09:29.508Z] 13:09:29     INFO - GECKO(1064) |     #13 0x7efd9a5841c2  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff911c2)
[task 2018-11-24T13:09:29.514Z] 13:09:29     INFO - GECKO(1064) |     #14 0x7efd99547516  (/builds/worker/workspace/build/application/firefox/libxul.so+0xef54516)
[task 2018-11-24T13:09:29.517Z] 13:09:29     INFO - GECKO(1064) |     #15 0x7efd8e1f53b6  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3c023b6)
[task 2018-11-24T13:09:29.521Z] 13:09:29     INFO - GECKO(1064) |     #16 0x7efd99600171  (/builds/worker/workspace/build/application/firefox/libxul.so+0xf00d171)
[task 2018-11-24T13:09:29.523Z] 13:09:29     INFO - GECKO(1064) |     #17 0x7efd9a582c3c  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff8fc3c)
[task 2018-11-24T13:09:29.524Z] 13:09:29     INFO - GECKO(1064) |     #18 0x7efd9a56b7f7  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff787f7)
[task 2018-11-24T13:09:29.526Z] 13:09:29     INFO - GECKO(1064) |     #19 0x7efd9a54ed96  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff5bd96)
[task 2018-11-24T13:09:29.529Z] 13:09:29     INFO - GECKO(1064) |     #20 0x7efd9a587455  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff94455)
[task 2018-11-24T13:09:29.531Z] 13:09:29     INFO - GECKO(1064) |     #21 0x7efd9a587c36  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff94c36)
[task 2018-11-24T13:09:29.533Z] 13:09:29     INFO - GECKO(1064) |     #22 0x7efd98c09332  (/builds/worker/workspace/build/application/firefox/libxul.so+0xe616332)
[task 2018-11-24T13:09:29.537Z] 13:09:29     INFO - GECKO(1064) |     #23 0x7efd98c099fa  (/builds/worker/workspace/build/application/firefox/libxul.so+0xe6169fa)
[task 2018-11-24T13:09:29.539Z] 13:09:29     INFO - GECKO(1064) |     #24 0x7efd8e20505b  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3c1205b)
[task 2018-11-24T13:09:29.545Z] 13:09:29     INFO - GECKO(1064) |     #25 0x7efd8e21b613  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3c28613)
[task 2018-11-24T13:09:29.548Z] 13:09:29     INFO - GECKO(1064) |     #26 0x7efd8c8a0ea1  (/builds/worker/workspace/build/application/firefox/libxul.so+0x22adea1)
[task 2018-11-24T13:09:29.549Z] 13:09:29     INFO - GECKO(1064) |     #27 0x7efd8e2b8c73  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3cc5c73)
[task 2018-11-24T13:09:29.551Z] 13:09:29     INFO - GECKO(1064) |     #28 0x7efd8e2becc6  (/builds/worker/workspace/build/application/firefox/libxul.so+0x3ccbcc6)
[task 2018-11-24T13:09:29.552Z] 13:09:29     INFO - GECKO(1064) |     #29 0x7efd9a581b9d  (/builds/worker/workspace/build/application/firefox/libxul.so+0xff8eb9d)
Status: REOPENED → RESOLVED
Closed: 6 years ago5 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

This bug has 55 failures in the last 7 days. Occurs on Linux asan build type.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=226793417&repo=mozilla-inbound&lineNumber=354487

This bug failed 32 times in the last 7 days. Occurs on linux64 debug build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=227378045&repo=mozilla-inbound&lineNumber=347067

Status: REOPENED → RESOLVED
Closed: 5 years ago5 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=257517998&repo=mozilla-central&lineNumber=12224

[task 2019-07-20T11:45:11.489Z] 11:45:11 INFO - TEST-START | /websockets/referrer.any.html
[task 2019-07-20T11:45:11.492Z] 11:45:11 INFO - Closing window 358629769217
[task 2019-07-20T11:45:11.581Z] 11:45:11 INFO - PID 26530 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2019-07-20T11:45:12.365Z] 11:45:12 INFO - .
[task 2019-07-20T11:45:12.365Z] 11:45:12 INFO - TEST-OK | /websockets/referrer.any.html | took 874ms

[task 2019-07-20T11:45:16.434Z] 11:45:16 INFO - PID 26530 | SUMMARY: AddressSanitizer: 10924 byte(s) leaked in 71 allocation(s).
[task 2019-07-20T11:45:17.079Z] 11:45:17 INFO - PID 26530 | -----------------------------------------------------
[task 2019-07-20T11:45:17.079Z] 11:45:17 INFO - PID 26530 | Suppressions used:
[task 2019-07-20T11:45:17.080Z] 11:45:17 INFO - PID 26530 | count bytes template
[task 2019-07-20T11:45:17.080Z] 11:45:17 INFO - PID 26530 | 24 728 nsComponentManagerImpl
[task 2019-07-20T11:45:17.080Z] 11:45:17 INFO - PID 26530 | 4 832 mozJSComponentLoader::LoadModule
[task 2019-07-20T11:45:17.080Z] 11:45:17 INFO - PID 26530 | 611 17509 libfontconfig.so
[task 2019-07-20T11:45:17.081Z] 11:45:17 INFO - PID 26530 | 336 14792 _PR_Getfd
[task 2019-07-20T11:45:17.081Z] 11:45:17 INFO - PID 26530 | 1 29 libglib-2.0.so
[task 2019-07-20T11:45:17.081Z] 11:45:17 INFO - PID 26530 | -----------------------------------------------------
[task 2019-07-20T11:45:17.238Z] 11:45:17 INFO - Browser exited with return code 0
[task 2019-07-20T11:45:17.238Z] 11:45:17 INFO - PROCESS LEAKS None
[task 2019-07-20T11:45:17.238Z] 11:45:17 INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 13492 byte(s) leaked in 85 allocation(s).
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - Allowed depth was 4
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at Alloc, nsTSubstring, Gecko_StartBulkWriteString, nsstring::nsAString::start_bulk_write_impl
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame Alloc matched a expected leak
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::net::CookieSettings::Create, mozilla::net::LoadInfo::LoadInfo, nsDocShell::DoURILoad, nsDocShell::InternalLoad
[task 2019-07-20T11:45:17.239Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame mozilla::net::CookieSettings::Create matched a expected leak
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::BasePrincipal::CreateContentPrincipal, mozilla::BasePrincipal::CreateContentPrincipal, nsScriptSecurityManager::GetChannelURIPrincipal, nsScriptSecurityManager::GetChannelResultPrincipal
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame mozilla::BasePrincipal::CreateContentPrincipal matched a expected leak
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::detail::UniqueSelector, mozilla::dom::ClientInfo::operator=, emplace, GetClientInfo
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame GetClientInfo matched a expected leak
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::detail::UniqueSelector, mozilla::dom::ClientInfo::operator=, nsSupportsWeakReference::GetWeakReference, emplace
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame nsSupportsWeakReference::GetWeakReference matched a expected leak
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at js::jit::InvokeFunction, js::jit::InvokeFromInterpreterStub, Alloc, nsTSubstring
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame Alloc matched a expected leak
[task 2019-07-20T11:45:17.240Z] 11:45:17 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at unknown stack
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::SchedulerGroup::CreateEventTargetFor, mozilla::SchedulerGroup::CreateEventTargets, mozilla::dom::TabGroup::TabGroup, mozilla::dom::ContentChild::GetSpecificMessageEventTarget
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame mozilla::SchedulerGroup::CreateEventTargetFor matched a expected leak
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::net::WebSocketEventService::GetOrCreate, mozilla::dom::WebSocketImpl::Init, mozilla::dom::WebSocket::ConstructorCommon, mozilla::dom::WebSocket::Constructor
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame mozilla::net::WebSocketEventService::GetOrCreate matched a expected leak
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at mozilla::net::nsStandardURL::TemplatedMutator, Init, mozilla::net::nsStandardURL::TemplatedMutator, operator
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame mozilla::net::nsStandardURL::TemplatedMutator matched a expected leak
[task 2019-07-20T11:45:17.241Z] 11:45:17 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at setInternal, js::Proxy::set, SetProperty, SetPropertyOperation
[task 2019-07-20T11:45:17.242Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at Alloc, nsTSubstring, Gecko_StartBulkWriteCString, nsstring::nsACString::start_bulk_write_impl
[task 2019-07-20T11:45:17.242Z] 11:45:17 INFO - INFO | LeakSanitizer | Frame Alloc matched a expected leak
[task 2019-07-20T11:45:17.246Z] 11:45:17 INFO - TEST-FAIL | LeakSanitizer | leak at Create, nsAtomTable::Atomize, mozilla::BasePrincipal::FinishInit, mozilla::ContentPrincipal::Init

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 5 years ago5 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

Julian, this has spiked after Bug 1620194 landed here: https://treeherder.mozilla.org/?#/jobs?repo=autoland&group_state=expanded&searchStr=linux%2C18.04%2Cx64%2Casan%2Copt%2Cmochitests%2Ctest-linux1804-64-asan%2Fopt-mochitest-devtools-chrome-e10s-4%2Cm%28dt4%29&tochange=1f037156fba1beddb204c329515ff27e5b9efcb0&test_paths=devtools%2Fclient%2Finspector%2Frules%2Ftest%2F&fromchange=c620d986a9eb16f3332d767177cdcb5a03735852&selectedJob=294272242

The shutdown leaks happen after https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=293657988&repo=autoland&lineNumber=331665
It has 36 failures since the 18th of March: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2020-03-15&endday=2020-03-22&tree=trunk&bug=1395843
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=294217423&repo=mozilla-central

[task 2020-03-21T22:53:25.462Z] 22:53:25     INFO - TEST-START | Shutdown
[task 2020-03-21T22:53:25.462Z] 22:53:25     INFO - Browser Chrome Test Summary
[task 2020-03-21T22:53:25.463Z] 22:53:25     INFO - Passed:  4530
[task 2020-03-21T22:53:25.464Z] 22:53:25     INFO - Failed:  0
[task 2020-03-21T22:53:25.464Z] 22:53:25     INFO - Todo:    0
[task 2020-03-21T22:53:25.464Z] 22:53:25     INFO - Mode:    e10s
[task 2020-03-21T22:53:25.464Z] 22:53:25     INFO - *** End BrowserChrome Test Results ***
[task 2020-03-21T22:53:26.158Z] 22:53:26     INFO - GECKO(2252) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-03-21T22:53:28.150Z] 22:53:28     INFO - GECKO(2252) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-03-21T22:53:28.156Z] 22:53:28     INFO - GECKO(2252) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-03-21T22:53:29.107Z] 22:53:29     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) | Suppressions used:
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) |   count      bytes template
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) |      27        832 nsComponentManagerImpl
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) |     633      18287 libfontconfig.so
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) |       1         11 libglib-2.0.so
[task 2020-03-21T22:53:29.109Z] 22:53:29     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:29.819Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: failed to fork (errno 12)
[task 2020-03-21T22:53:29.827Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: failed to fork (errno 12)
[task 2020-03-21T22:53:29.827Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: failed to fork (errno 12)
[task 2020-03-21T22:53:29.827Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: failed to fork (errno 12)
[task 2020-03-21T22:53:29.827Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: failed to fork (errno 12)
[task 2020-03-21T22:53:29.827Z] 22:53:29     INFO - GECKO(2252) | ==2617==WARNING: Failed to use and restart external symbolizer!
[task 2020-03-21T22:53:31.445Z] 22:53:31     INFO - GECKO(2252) | 1584831211410	Marionette	TRACE	Received observer notification xpcom-will-shutdown
[task 2020-03-21T22:53:31.447Z] 22:53:31     INFO - GECKO(2252) | 1584831211414	Marionette	INFO	Stopped listening on port 2828
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | 1584831211415	Marionette	DEBUG	Marionette stopped listening
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | Suppressions used:
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |   count      bytes template
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |      27        832 nsComponentManagerImpl
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |     633      18287 libfontconfig.so
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |       1         11 libglib-2.0.so
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | Suppressions used:
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |   count      bytes template
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |      45       1360 nsComponentManagerImpl
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |     633      18287 libfontconfig.so
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) |       1         11 libglib-2.0.so
[task 2020-03-21T22:53:31.448Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) | Suppressions used:
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) |   count      bytes template
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) |      60       1800 nsComponentManagerImpl
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) |     633      18287 libfontconfig.so
[task 2020-03-21T22:53:31.466Z] 22:53:31     INFO - GECKO(2252) |       1         11 libglib-2.0.so
[task 2020-03-21T22:53:31.467Z] 22:53:31     INFO - GECKO(2252) | -----------------------------------------------------
[task 2020-03-21T22:53:59.715Z] 22:53:59     INFO - GECKO(2252) | =================================================================
[task 2020-03-21T22:53:59.717Z] 22:53:59    ERROR - GECKO(2252) | ==2617==ERROR: LeakSanitizer: detected memory leaks

Could you please have over what's going on here? Thank you.

Flags: needinfo?(jdescottes)
Whiteboard: [stockwell needswork:owner]

Thanks! Looking, for now the only thing I can see which seems suspicious is that the logs are completely flooded with a huge object being logged:

    if (accessible.actorID) {
      console.warn(`Error fetching accessible details: `, accessible, error);
    }

at https://searchfox.org/mozilla-central/rev/3fd53c47864fedb916f0ed8f002f15456324f729/devtools/client/accessibility/reducers/details.js#42
This log forces a dump of 160,000 lines of text, maybe this stresses the test harness? And maybe my change made the warning more frequent.

Try pushes in progress to see if changing this has any impact on the failure rate. Keeping the ni? for now.

Flags: needinfo?(jdescottes)
Keywords: leave-open
Assignee: nobody → jdescottes

(didn't mean to clean the ni)

Assignee: jdescottes → nobody
Flags: needinfo?(jdescottes)
Assignee: nobody → jdescottes
Pushed by jdescottes@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/310fe319cb3d
Stop logging the whole accessible object in reducer warning r=yzen
Pushed by jdescottes@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e928d74f55d4
Properly remove the DevTools test shared-head observer r=ochameau

Landing a few improvements, although my try pushes don't indicate they fix the leak (the second one might reduce the failure rate?) .

I found failures dating back to before I landed my patches. Some of them are DevTools, some are not. What is interesting is that for the DevTools one they also occurred in the same chunk, running the same test suites (dt4 linux asan), typically at the end of devtools/client/inspector/rules/test/

The logs are very similar to the ones we have now. So this is really not a new failure, but it became much more frequent. Let's see if the patches which landed so far help reduce the failure rate.

Flags: needinfo?(jdescottes)
Pushed by jdescottes@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5495c9c742d9
Remove DevTools shared-head observable explicitly r=ochameau
Keywords: leave-open

Clearing leave-open, try pushes seem to indicate the last patch fixes the issue.

Status: REOPENED → RESOLVED
Closed: 5 years ago4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla76
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: