Closed Bug 1871099 Opened 1 year ago Closed 1 year ago

Intermittent OSError: [Errno 12] Cannot allocate memory after MOZ_CRASH(assertion `left == right` failed: Incomplete framebuffer

Categories

(Core :: Graphics: WebRender, defect, P5)

Product:
Core
Component:
Graphics: WebRender
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, intermittent-testcase)

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=440903821&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Bl6f7EOkQd6SHpnl8kEvUg/runs/0/artifacts/public/logs/live_backing.log

[task 2023-12-20T17:19:17.322Z] 17:19:17     INFO - TEST-OK | dom/base/test/test_timeout_clamp.html | took 141306ms
[task 2023-12-20T17:19:17.327Z] 17:19:17     INFO - GECKO(1303) | [WARN  webrender::device::gl] Missing optimized shader source for gpu_cache_update
[task 2023-12-20T17:19:17.658Z] 17:19:17     INFO - TEST-START | dom/base/test/test_timer_flood.html
[task 2023-12-20T17:19:17.852Z] 17:19:17     INFO - GECKO(1303) | [Parent 1303, Main Thread] WARNING: WebProgress Ignored: no longer current window global: file /builds/worker/checkouts/gecko/dom/ipc/BrowserParent.cpp:3118
[task 2023-12-20T17:19:17.956Z] 17:19:17     INFO - GECKO(1303) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmpj30m0wym.mozrunner/runtests_leaks_tab_pid15896.log
[task 2023-12-20T17:19:18.027Z] 17:19:18     INFO - GECKO(1303) | [Child 15896, Main Thread] WARNING: could not set real-time limit in CubebUtils::InitLibrary: file /builds/worker/checkouts/gecko/dom/media/CubebUtils.cpp:657
[task 2023-12-20T17:19:19.689Z] 17:19:19     INFO - GECKO(1303) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmpj30m0wym.mozrunner/runtests_leaks_tab_pid15921.log
[task 2023-12-20T17:19:19.764Z] 17:19:19     INFO - GECKO(1303) | [Child 15921, Main Thread] WARNING: could not set real-time limit in CubebUtils::InitLibrary: file /builds/worker/checkouts/gecko/dom/media/CubebUtils.cpp:657
[task 2023-12-20T17:19:19.802Z] 17:19:19     INFO - GECKO(1303) | Couldn't convert chrome URL: chrome://branding/locale/brand.properties
[task 2023-12-20T17:19:19.805Z] 17:19:19     INFO - GECKO(1303) | [Child 15921, Main Thread] WARNING: Could not get the program name for a cubeb stream.: 'NS_SUCCEEDED(rv)', file /builds/worker/checkouts/gecko/dom/media/CubebUtils.cpp:402
[task 2023-12-20T17:19:19.866Z] 17:19:19     INFO - GECKO(1303) | [Child 12572, Main Thread] WARNING: IPC message 'PContent::Msg_AccumulateChildKeyedHistograms' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:545
[task 2023-12-20T17:19:19.869Z] 17:19:19     INFO - GECKO(1303) | [Child 12572, Main Thread] WARNING: '!ipcActor->SendAccumulateChildKeyedHistograms(keyedHistogramsToSend)', file /builds/worker/checkouts/gecko/toolkit/components/telemetry/core/ipc/TelemetryIPCAccumulator.cpp:282
[task 2023-12-20T17:19:19.872Z] 17:19:19     INFO - GECKO(1303) | [Child 12572, Main Thread] WARNING: IPC message 'PContent::Msg_RecordDiscardedData' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:545
[task 2023-12-20T17:19:19.874Z] 17:19:19     INFO - GECKO(1303) | [Child 12572, Main Thread] WARNING: '!ipcActor->SendRecordDiscardedData(discardedData)', file /builds/worker/checkouts/gecko/toolkit/components/telemetry/core/ipc/TelemetryIPCAccumulator.cpp:297
[task 2023-12-20T17:19:20.657Z] 17:19:20     INFO - GECKO(1303) | [WARN  webrender::device::gl] Missing optimized shader source for gpu_cache_update
[task 2023-12-20T17:19:21.737Z] 17:19:21     INFO - GECKO(1303) | [Parent 1303, Main Thread] WARNING: immediately shutting-down already-dead process: file /builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp:2763
[task 2023-12-20T17:19:21.739Z] 17:19:21     INFO - GECKO(1303) | [Parent 1303, Main Thread] WARNING: failed to launch child in the parent: file /builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp:2696
[task 2023-12-20T17:19:21.918Z] 17:19:21     INFO - GECKO(1303) | [Parent 1303, Main Thread] WARNING: NS_ENSURE_TRUE(she && she->mInfo->mSharedState.Get()) failed: file /builds/worker/checkouts/gecko/docshell/shistory/SessionHistoryEntry.cpp:1159
[task 2023-12-20T17:19:21.927Z] 17:19:21     INFO - GECKO(1303) | [Parent 1303, Main Thread] WARNING: NS_ENSURE_TRUE(she && she->mInfo->mSharedState.Get()) failed: file /builds/worker/checkouts/gecko/docshell/shistory/SessionHistoryEntry.cpp:1159
<...>
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO - GECKO(1303) | [Child 12572, Main Thread] WARNING: '!ipcActor->SendRecordDiscardedData(discardedData)', file /builds/worker/checkouts/gecko/toolkit/components/telemetry/core/ipc/TelemetryIPCAccumulator.cpp:297
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO - GECKO(1303) | Hit MOZ_CRASH(assertion `left == right` failed: Incomplete framebuffer
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO - GECKO(1303) |   left: 36054
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO - GECKO(1303) |  right: 36053) at gfx/wr/webrender/src/device/gl.rs:2856
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -  Exception in thread ProcessReader:
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -  Traceback (most recent call last):
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      self.run()
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/usr/lib/python3.8/threading.py", line 870, in run
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      self._target(*self._args, **self._kwargs)
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozprocess/processhandler.py", line 1132, in _read
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      callback(line.rstrip())
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozprocess/processhandler.py", line 1038, in __call__
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      e(*args, **kwargs)
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/tests/mochitest/runtests.py", line 3948, in processOutputLine
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      msg = handler(msg)
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/tests/mochitest/runtests.py", line 4055, in fix_stack
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      message["data"] = self.stackFixerFunction(message["data"])
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozrunner/utils.py", line 279, in stack_fixer_function
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      return stack_fixer_module.fixSymbols(
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/tests/bin/fix_stacks.py", line 112, in fixSymbols
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      initFixStacks(jsonMode, slowWarning, breakpadSymsDir, hide_errors)
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/builds/worker/workspace/build/tests/bin/fix_stacks.py", line 81, in initFixStacks
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      fix_stacks = Popen(
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/usr/lib/python3.8/subprocess.py", line 854, in __init__
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      self._execute_child(args, executable, preexec_fn, close_fds,
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -    File "/usr/lib/python3.8/subprocess.py", line 1637, in _execute_child
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -      self.pid = _posixsubprocess.fork_exec(
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO -  OSError: [Errno 12] Cannot allocate memory
[task 2023-12-20T17:22:47.119Z] 17:22:46     INFO - TEST-INFO | Main app process: exit 11

There's two failures here. First, we assert with MOZ_CRASH(assertionleft == rightfailed: Incomplete framebuffer. Then, the test harness crashes with an OOM when it tries to symbolicate the stack. They might both be due to low memory, but this doesn't seem like an allocator problem.

Component: Memory Allocator → Graphics: WebRender
Summary: Intermittent OSError: [Errno 12] Cannot allocate memory → Intermittent OSError: [Errno 12] Cannot allocate memory after MOZ_CRASH(assertion `left == right` failed: Incomplete framebuffer

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.