Closed
Bug 2026203
Opened 5 months ago
Closed 5 months ago
Frequent intermittent BufferError: memoryview has 1 exported buffer
Categories
(Enterprise Products :: Firefox, defect)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: gerard-majax, Unassigned)
References
(Blocks 1 open bug)
Details
Attachments
(1 file)
This is a shutdown issue happening quite frequently since a couple of days now: https://treeherder.mozilla.org/logviewer?job_id=555277404&repo=enterprise-release&task=b280R7RDT4GeDA_DgLCVtw.0&lineNumber=13367
[task 2026-03-24T12:48:07.990+00:00] 12:48:07 INFO - BufferError: memoryview has 1 exported buffer
[task 2026-03-24T12:48:08.095+00:00] 12:48:08 INFO - Process ServerProxy-2:
[task 2026-03-24T12:48:08.096+00:00] 12:48:08 INFO - Process ServerProxy-1:
[task 2026-03-24T12:48:08.101+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.102+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 328, in _recv_bytes
[task 2026-03-24T12:48:08.105+00:00] 12:48:08 INFO - nread, err = ov.GetOverlappedResult(True)
[task 2026-03-24T12:48:08.105+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.105+00:00] 12:48:08 INFO - BrokenPipeError: [WinError 109] The pipe has been ended
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - During handling of the above exception, another exception occurred:
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 78, in run
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - sattr, fargs = self.recv()
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - ^^^^^^^^^^^
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 51, in recv
[task 2026-03-24T12:48:08.116+00:00] 12:48:08 INFO - payload = self.chan.recv()
[task 2026-03-24T12:48:08.118+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.118+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 250, in recv
[task 2026-03-24T12:48:08.118+00:00] 12:48:08 INFO - buf = self._recv_bytes()
[task 2026-03-24T12:48:08.118+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 337, in _recv_bytes
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - raise EOFError
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - EOFError
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - During handling of the above exception, another exception occurred:
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.119+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 328, in _recv_bytes
[task 2026-03-24T12:48:08.121+00:00] 12:48:08 INFO - nread, err = ov.GetOverlappedResult(True)
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - BrokenPipeError: [WinError 109] The pipe has been ended
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\process.py", line 314, in _bootstrap
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - self.run()
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 95, in run
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - self.send(("stop", e))
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 44, in send
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - self.chan.send(args)
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 206, in send
[task 2026-03-24T12:48:08.139+00:00] 12:48:08 INFO - self._send_bytes(_ForkingPickler.dumps(obj))
[task 2026-03-24T12:48:08.141+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 289, in _send_bytes
[task 2026-03-24T12:48:08.142+00:00] 12:48:08 INFO - ov, err = _winapi.WriteFile(self._handle, buf, overlapped=True)
[task 2026-03-24T12:48:08.142+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.142+00:00] 12:48:08 INFO - During handling of the above exception, another exception occurred:
[task 2026-03-24T12:48:08.142+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.142+00:00] 12:48:08 INFO - BrokenPipeError: [WinError 232] The pipe is being closed
[task 2026-03-24T12:48:08.143+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 78, in run
[task 2026-03-24T12:48:08.143+00:00] 12:48:08 INFO - sattr, fargs = self.recv()
[task 2026-03-24T12:48:08.143+00:00] 12:48:08 INFO - ^^^^^^^^^^^
[task 2026-03-24T12:48:08.144+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 51, in recv
[task 2026-03-24T12:48:08.144+00:00] 12:48:08 INFO - payload = self.chan.recv()
[task 2026-03-24T12:48:08.144+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.144+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 250, in recv
[task 2026-03-24T12:48:08.145+00:00] 12:48:08 INFO - buf = self._recv_bytes()
[task 2026-03-24T12:48:08.145+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.145+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 337, in _recv_bytes
[task 2026-03-24T12:48:08.145+00:00] 12:48:08 INFO - raise EOFError
[task 2026-03-24T12:48:08.145+00:00] 12:48:08 INFO - EOFError
[task 2026-03-24T12:48:08.146+00:00] 12:48:08 INFO - During handling of the above exception, another exception occurred:
[task 2026-03-24T12:48:08.146+00:00] 12:48:08 INFO - Traceback (most recent call last):
[task 2026-03-24T12:48:08.146+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\process.py", line 314, in _bootstrap
[task 2026-03-24T12:48:08.146+00:00] 12:48:08 INFO - self.run()
[task 2026-03-24T12:48:08.147+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 95, in run
[task 2026-03-24T12:48:08.147+00:00] 12:48:08 INFO - self.send(("stop", e))
[task 2026-03-24T12:48:08.147+00:00] 12:48:08 INFO - File "D:\task_177435491574991\build\venv\Lib\site-packages\marionette_harness\runner\serve.py", line 44, in send
[task 2026-03-24T12:48:08.147+00:00] 12:48:08 INFO - self.chan.send(args)
[task 2026-03-24T12:48:08.147+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 206, in send
[task 2026-03-24T12:48:08.148+00:00] 12:48:08 INFO - self._send_bytes(_ForkingPickler.dumps(obj))
[task 2026-03-24T12:48:08.148+00:00] 12:48:08 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 289, in _send_bytes
[task 2026-03-24T12:48:08.148+00:00] 12:48:08 INFO - ov, err = _winapi.WriteFile(self._handle, buf, overlapped=True)
[task 2026-03-24T12:48:08.148+00:00] 12:48:08 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-24T12:48:08.148+00:00] 12:48:08 INFO - BrokenPipeError: [WinError 232] The pipe is being closed
[task 2026-03-24T13:04:48.165+00:00] 13:04:48 INFO - Automation Error: mozharness timed out after 1000 seconds running ['D:\\task_177435491574991\\build\\venv\\Scripts\\python', '-u', 'D:\\task_177435491574991\\build\\tests\\marionette\\harness\\marionette_harness\\runtests.py', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--gecko-log=-', '-vv', '--log-errorsummary=D:\\task_177435491574991\\build\\blobber_upload_dir\\marionette_errorsummary.log', '--log-html=D:\\task_177435491574991\\build\\blobber_upload_dir\\report.html', '--binary=D:\\task_177435491574991\\build\\application\\firefox\\firefox.exe', '--address=localhost:2828', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cXtpOomBSS2n_inJFEswRQ/artifacts/public/build/target.crashreporter-symbols.zip', 'D:\\task_177435491574991\\build\\tests\\marionette\\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\enterprise-tests.toml']
[task 2026-03-24T13:04:48.165+00:00] 13:04:48 INFO - Return code: 3221225477
This is shutdown only, and it looks to be a cpython level bug: https://github.com/python/cpython/pull/123898 the fix was backported to 3.13 and 3.12 but tests are executing on 3.11.7
|
||
Comment 1•5 months ago
|
||
|
||
Comment 2•5 months ago
|
||
I had a look at this from the application side, in this job at this log it is shown that it is not shutdown only (Although on shutdown can also happen)
This part
[task 2026-03-16T18:38:19.499+00:00] 18:38:19 INFO - path: /api/browser/policies
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - GET ----------------------------------------
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - Exception occurred during processing of request from ('127.0.0.1', 59178)
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - Traceback (most recent call last):
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\socketserver.py", line 317, in _handle_request_noblock
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - self.process_request(request, client_address)
[task 2026-03-16T18:38:19.500+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\socketserver.py", line 348, in process_request
[task 2026-03-16T18:38:19.501+00:00] 18:38:19 INFO - self.finish_request(request, client_address)
[task 2026-03-16T18:38:19.501+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\socketserver.py", line 361, in finish_request
[task 2026-03-16T18:38:19.502+00:00] 18:38:19 INFO - self.RequestHandlerClass(request, client_address, self)
[task 2026-03-16T18:38:19.502+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\socketserver.py", line 755, in __init__
[task 2026-03-16T18:38:19.502+00:00] 18:38:19 INFO - self.handle()
[task 2026-03-16T18:38:19.502+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\http\server.py", line 436, in handle
[task 2026-03-16T18:38:19.503+00:00] 18:38:19 INFO - self.handle_one_request()
[task 2026-03-16T18:38:19.503+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\http\server.py", line 424, in handle_one_request
[task 2026-03-16T18:38:19.503+00:00] 18:38:19 INFO - method()
[task 2026-03-16T18:38:19.503+00:00] 18:38:19 INFO - File "D:\task_177368455185618\build\tests\marionette\tests\testing\enterprise\felt_tests.py", line 175, in do_GET
[task 2026-03-16T18:38:19.503+00:00] 18:38:19 INFO - self.check_auth()
[task 2026-03-16T18:38:19.504+00:00] 18:38:19 INFO - File "D:\task_177368455185618\build\tests\marionette\tests\testing\enterprise\felt_tests.py", line 119, in check_auth
[task 2026-03-16T18:38:19.504+00:00] 18:38:19 INFO - if bearer[1] != self.server.policy_access_token.value:
[task 2026-03-16T18:38:19.504+00:00] 18:38:19 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-16T18:38:19.504+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\managers.py", line 1141, in get
[task 2026-03-16T18:38:19.504+00:00] 18:38:19 INFO - return self._callmethod('get')
[task 2026-03-16T18:38:19.505+00:00] 18:38:19 INFO - ^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-16T18:38:19.505+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\managers.py", line 821, in _callmethod
[task 2026-03-16T18:38:19.505+00:00] 18:38:19 INFO - conn.send((self._id, methodname, args, kwds))
[task 2026-03-16T18:38:19.505+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 206, in send
[task 2026-03-16T18:38:19.505+00:00] 18:38:19 INFO - self._send_bytes(_ForkingPickler.dumps(obj))
[task 2026-03-16T18:38:19.506+00:00] 18:38:19 INFO - File "c:\mozilla-build\python3\Lib\multiprocessing\connection.py", line 289, in _send_bytes
[task 2026-03-16T18:38:19.506+00:00] 18:38:19 INFO - ov, err = _winapi.WriteFile(self._handle, buf, overlapped=True)
[task 2026-03-16T18:38:19.506+00:00] 18:38:19 INFO - ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2026-03-16T18:38:19.506+00:00] 18:38:19 INFO - BrokenPipeError: [WinError 232] The pipe is being closed
The manager.Value uses the memoryview internally on windows, even if manager.Value variables were there for long time, based on dates it could be that(wild guess) this commit actually changed the GC pattern due to the sso endpoint writing/reading on the values much frequently.
This PR prevents the usage of this Manager.Value but needs to be tested MnEnt if it actually reduces the issue to previous values (as it is anyway in the interpreter)
|
Reporter | |
Comment 3•5 months ago
|
||
it's not impossible
|
|
||
Comment 4•5 months ago
|
||
Authored by https://github.com/victhorlopez
https://github.com/mozilla/enterprise-firefox/commit/a0940dc8d1eda23d4fdc224dd6cdec7144071ecb
[enterprise-main] Bug 2026203: Remove usage of Manager.Value on marionette testutils (#612)
Status: NEW → RESOLVED
Closed: 5 months ago
Resolution: --- → FIXED
You need to log in
before you can comment on or make changes to this bug.
Description
•