Open Bug 1703952 Opened 2 years ago Updated 5 days ago

Intermittent LeakSanitizer | leak at mozilla::SupportsThreadSafeWeakPtr, mozilla::dom::RemoteWorkerChild::RemoteWorkerChild, mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived

Categories

(Core :: DOM: Workers, defect)

defect

Tracking

()

REOPENED

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

References

(Blocks 1 open bug)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell needswork:owner])

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=335881906&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NePrFZFTTPafXeIe0fQnRQ/runs/0/artifacts/public/logs/live_backing.log


[task 2021-04-08T20:37:11.843Z] 20:37:11     INFO - TEST-OK | /upgrade-insecure-requests/gen/top.meta/upgrade/worklet-paint.https.html | took 696ms
[task 2021-04-08T20:37:11.846Z] 20:37:11     INFO - TEST-START | /upgrade-insecure-requests/gen/top.meta/upgrade/xhr.https.html
[task 2021-04-08T20:37:11.846Z] 20:37:11     INFO - Closing window 8589934677
[task 2021-04-08T20:37:12.685Z] 20:37:12     INFO - ......
[task 2021-04-08T20:37:12.685Z] 20:37:12     INFO - TEST-OK | /upgrade-insecure-requests/gen/top.meta/upgrade/xhr.https.html | took 842ms
[task 2021-04-08T20:37:12.686Z] 20:37:12     INFO - Restarting browser for new test group
[task 2021-04-08T20:37:12.687Z] 20:37:12     INFO - PID 14011 | 1617914232685	Marionette	INFO	Stopped listening on port 46987
[task 2021-04-08T20:37:12.866Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:12.871Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:12.892Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:12.895Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:12.993Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:12.998Z] 20:37:12     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:13.001Z] 20:37:13     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:13.001Z] 20:37:13     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:13.002Z] 20:37:13     INFO - PID 14011 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:14.356Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.356Z] 20:37:14     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:14.357Z] 20:37:14     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:14.357Z] 20:37:14     INFO - PID 14011 |      14        448 nsComponentManagerImpl
[task 2021-04-08T20:37:14.358Z] 20:37:14     INFO - PID 14011 |       2        288 libfontconfig.so
[task 2021-04-08T20:37:14.358Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 |      14        448 nsComponentManagerImpl
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 |       2        288 libfontconfig.so
[task 2021-04-08T20:37:14.561Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 |      14        448 nsComponentManagerImpl
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 |       2        288 libfontconfig.so
[task 2021-04-08T20:37:14.566Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.593Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.593Z] 20:37:14     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:14.594Z] 20:37:14     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:14.594Z] 20:37:14     INFO - PID 14011 |      14        448 nsComponentManagerImpl
[task 2021-04-08T20:37:14.594Z] 20:37:14     INFO - PID 14011 |       2        288 libfontconfig.so
[task 2021-04-08T20:37:14.594Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.692Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:14.692Z] 20:37:14     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:14.693Z] 20:37:14     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:14.693Z] 20:37:14     INFO - PID 14011 |      14        448 nsComponentManagerImpl
[task 2021-04-08T20:37:14.693Z] 20:37:14     INFO - PID 14011 |       2        288 libfontconfig.so
[task 2021-04-08T20:37:14.693Z] 20:37:14     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:15.959Z] 20:37:15     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:15.959Z] 20:37:15     INFO - PID 14011 | Suppressions used:
[task 2021-04-08T20:37:15.962Z] 20:37:15     INFO - PID 14011 |   count      bytes template
[task 2021-04-08T20:37:15.962Z] 20:37:15     INFO - PID 14011 |      11        344 nsComponentManagerImpl
[task 2021-04-08T20:37:15.963Z] 20:37:15     INFO - PID 14011 |     633      18083 libfontconfig.so
[task 2021-04-08T20:37:15.963Z] 20:37:15     INFO - PID 14011 |       4         24 libglib-2.0.so
[task 2021-04-08T20:37:15.963Z] 20:37:15     INFO - PID 14011 |       3        624 mozJSComponentLoader
[task 2021-04-08T20:37:15.963Z] 20:37:15     INFO - PID 14011 | -----------------------------------------------------
[task 2021-04-08T20:37:16.042Z] 20:37:16     INFO - Browser exited with return code 0
[task 2021-04-08T20:37:16.042Z] 20:37:16     INFO - PROCESS LEAKS None
[task 2021-04-08T20:37:16.043Z] 20:37:16     INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 296 byte(s) leaked in 3 allocation(s).
[task 2021-04-08T20:37:16.043Z] 20:37:16     INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2021-04-08T20:37:16.043Z] 20:37:16     INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2021-04-08T20:37:16.044Z] 20:37:16     INFO - Allowed depth was 4
[task 2021-04-08T20:37:16.045Z] 20:37:16     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::SupportsThreadSafeWeakPtr, mozilla::dom::RemoteWorkerChild::RemoteWorkerChild, mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived
[task 2021-04-08T20:37:16.045Z] 20:37:16     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived, mozilla::ipc::MessageChannel::DispatchAsyncMessage, mozilla::ipc::MessageChannel::DispatchMessage
[task 2021-04-08T20:37:16.046Z] 20:37:16     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at detail::ProxyRelease, ProxyRelease, NS_ProxyRelease, mozilla::dom::SelfHolder::~SelfHolder
[task 2021-04-08T20:37:16.048Z] 20:37:16     INFO - Closing logging queue
[task 2021-04-08T20:37:16.049Z] 20:37:16     INFO - queue closed
[task 2021-04-08T20:37:16.093Z] 20:37:16     INFO - INFO | runtests.py | ASan using symbolizer at /builds/worker/workspace/build/application/firefox/llvm-symbolizer
[task 2021-04-08T20:37:16.099Z] 20:37:16     INFO - LSan enabled.
[task 2021-04-08T20:37:16.100Z] 20:37:16     INFO - INFO | runtests.py | ASan running in default memory configuration
[task 2021-04-08T20:37:16.101Z] 20:37:16     INFO - UBSan enabled.
[task 2021-04-08T20:37:16.102Z] 20:37:16     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpftk10n2h
[task 2021-04-08T20:37:16.109Z] 20:37:16     INFO - PID 14181 | 1617914194080	Marionette	INFO	Marionette enabled
[task 2021-04-08T20:37:16.110Z] 20:37:16     INFO - PID 14181 | console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /tmp/tmpgvfyv3kl/search.json.mozlz4", (void 0)))
[task 2021-04-08T20:37:16.112Z] 20:37:16     INFO - PID 14181 | 1617914202244	Marionette	INFO	Listening on port 55568
[task 2021-04-08T20:37:16.113Z] 20:37:16     INFO - Starting runner
[task 2021-04-08T20:37:17.105Z] 20:37:17     INFO - PID 14181 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:17.108Z] 20:37:17     INFO - PID 14181 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-04-08T20:37:17.404Z] 20:37:17     INFO - TEST-START | /wasm/jsapi/module/constructor.any.worker.html```
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE
Status: REOPENED → RESOLVED
Closed: 1 year ago1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 1 year ago10 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Blocks: LSan

There have been 33 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr
[task 2022-03-05T08:44:47.273Z] 08:44:47     INFO - Browser exited with return code 0
[task 2022-03-05T08:44:47.275Z] 08:44:47     INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 328 byte(s) leaked in 4 allocation(s).
[task 2022-03-05T08:44:47.275Z] 08:44:47     INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2022-03-05T08:44:47.277Z] 08:44:47     INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - Allowed depth was 4
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::SupportsThreadSafeWeakPtr, mozilla::dom::RemoteWorkerChild::RemoteWorkerChild, mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived, mozilla::ipc::MessageChannel::DispatchAsyncMessage, mozilla::ipc::MessageChannel::DispatchMessage
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::dom::RemoteWorkerChild::ShutdownOnWorker, operator, std::_Function_handler
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at detail::ProxyRelease, ProxyRelease, NS_ProxyRelease, operator
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - Closing logging queue
[task 2022-03-05T08:44:47.279Z] 08:44:47     INFO - queue closed
[task 2022-03-05T08:44:47.304Z] 08:44:47     INFO - INFO | runtests.py | ASan using symbolizer at /builds/worker/workspace/build/application/firefox/llvm-symbolizer
[task 2022-03-05T08:44:47.311Z] 08:44:47     INFO - LSan enabled.
[task 2022-03-05T08:44:47.311Z] 08:44:47     INFO - INFO | runtests.py | ASan running in default memory configuration
[task 2022-03-05T08:44:47.312Z] 08:44:47     INFO - UBSan enabled.
[task 2022-03-05T08:44:47.312Z] 08:44:47     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpjaad33c9
[task 2022-03-05T08:44:47.321Z] 08:44:47     INFO - PID 2207 | 1646469859345	Marionette	INFO	Marionette enabled
[task 2022-03-05T08:44:47.322Z] 08:44:47     INFO - PID 2207 | console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /tmp/tmpuvatc7jr/search.json.mozlz4", (void 0)))
[task 2022-03-05T08:44:47.323Z] 08:44:47     INFO - PID 2207 | 1646469872925	Marionette	INFO	Listening on port 39113
[task 2022-03-05T08:44:47.323Z] 08:44:47     INFO - Starting runner
[task 2022-03-05T08:44:48.584Z] 08:44:48     INFO - TEST-START | /content-security-policy/unsafe-hashes/javascript_src_allowed-href.html
Whiteboard: [domsecurity-intermittent] → [domsecurity-intermittent][stockwell needswork:owner]
See Also: → 1749068
Component: DOM: Security → DOM: Workers
Whiteboard: [domsecurity-intermittent][stockwell needswork:owner] → [stockwell needswork:owner]

There have been 30 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr
[task 2022-05-24T16:57:08.101Z] 16:57:08     INFO - TEST-INFO | Main app process: exit 0
[task 2022-05-24T16:57:08.101Z] 16:57:08     INFO - TEST-INFO | LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2022-05-24T16:57:08.101Z] 16:57:08     INFO - TEST-INFO | LeakSanitizer | This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2022-05-24T16:57:08.102Z] 16:57:08    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::SupportsThreadSafeWeakPtr, mozilla::dom::RemoteWorkerChild::RemoteWorkerChild, mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived
[task 2022-05-24T16:57:08.103Z] 16:57:08    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at detail::ProxyRelease, ProxyRelease, NS_ProxyRelease, operator
[task 2022-05-24T16:57:08.103Z] 16:57:08    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived, mozilla::ipc::MessageChannel::DispatchAsyncMessage, mozilla::ipc::MessageChannel::DispatchMessage
[task 2022-05-24T16:57:08.104Z] 16:57:08    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::dom::RemoteWorkerChild::ShutdownOnWorker, operator, std::_Function_handler
[task 2022-05-24T16:57:08.105Z] 16:57:08     INFO - runtests.py | Application ran for: 0:03:59.303334
[task 2022-05-24T16:57:08.106Z] 16:57:08     INFO - zombiecheck | Reading PID log: /tmp/tmp19xc38etpidlog

There have been 42 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr

There have been 33 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr

There have been 36 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr

Update:

There have been 33 failures within the last 7 days all of them on Linux 18.04 x64 WebRender asan opt.

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=384561291&repo=autoland&lineNumber=6045

[task 2022-07-16T17:25:44.835Z] 17:25:44     INFO - TEST-INFO | Main app process: exit 0
[task 2022-07-16T17:25:44.836Z] 17:25:44     INFO - TEST-INFO | LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2022-07-16T17:25:44.837Z] 17:25:44     INFO - TEST-INFO | LeakSanitizer | This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2022-07-16T17:25:44.837Z] 17:25:44    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at detail::ProxyRelease, ProxyRelease, NS_ProxyRelease, operator
[task 2022-07-16T17:25:44.837Z] 17:25:44    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::SupportsThreadSafeWeakPtr, mozilla::dom::RemoteWorkerChild::RemoteWorkerChild, mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived
[task 2022-07-16T17:25:44.838Z] 17:25:44    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at already_AddRefed, mozilla::dom::RemoteWorkerChild::ShutdownOnWorker, operator, decltype
[task 2022-07-16T17:25:44.838Z] 17:25:44    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::ipc::BackgroundChildImpl::AllocPRemoteWorkerChild, mozilla::ipc::PBackgroundChild::OnMessageReceived, mozilla::ipc::MessageChannel::DispatchAsyncMessage, mozilla::ipc::MessageChannel::DispatchMessage
[task 2022-07-16T17:25:44.839Z] 17:25:44     INFO - runtests.py | Application ran for: 0:02:57.451382

Jens, as the owner of this component, can you help us assign the bug to someone?
Thank you.

Flags: needinfo?(jstutte)

Hi Andrew, I assume this is one of the same series around RemoteWorkerChild?

Flags: needinfo?(jstutte) → needinfo?(bugmail)

There have been 37 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr

There have been 33 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr

There have been 32 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • linux1804-64-asan-qr
Whiteboard: [stockwell unknown][stockwell needswork:owner] → [stockwell needswork:owner]
You need to log in before you can comment on or make changes to this bug.