1901887 - High freq SUMMARY: AddressSanitizer/ThreadSanitizer: SEGV (/usr/lib/x86_64-linux-gnu/libfreetype.so.6+0x64660) (BuildId: acb61e31697176d046a68500624653579fb6904a)

Status: RESOLVED DUPLICATE of bug 1901884

(Core :: Graphics: WebRender, defect)

Description

[Treeherder Bug Filer]

Filed by: pstanciu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=461908519&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Ycdv3y6nRxmGZvyUN8rtnw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Ycdv3y6nRxmGZvyUN8rtnw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2024-06-11T21:02:40.459Z] 21:02:40     INFO - REFTEST TEST-PASS | layout/reftests/font-face/ex-unit-1-dynamic.html == layout/reftests/font-face/ex-unit-1-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2024-06-11T21:02:40.459Z] 21:02:40     INFO - REFTEST TEST-END | layout/reftests/font-face/ex-unit-1-dynamic.html == layout/reftests/font-face/ex-unit-1-ref.html
[task 2024-06-11T21:02:40.510Z] 21:02:40     INFO - REFTEST TEST-START | layout/reftests/font-face/local-1.html == layout/reftests/font-face/local-1-ref.html
[task 2024-06-11T21:02:40.514Z] 21:02:40     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/font-face/local-1.html | 67 / 170 (39%)
[task 2024-06-11T21:02:40.614Z] 21:02:40     INFO - ThreadSanitizer:DEADLYSIGNAL
[task 2024-06-11T21:02:40.615Z] 21:02:40     INFO - ==1363==ERROR: ThreadSanitizer: SEGV on unknown address 0x000000000018 (pc 0x7fe241e8c660 bp 0x000000000000 sp 0x7fe196462d18 T1409)
[task 2024-06-11T21:02:40.616Z] 21:02:40     INFO - ==1363==The signal is caused by a READ memory access.
[task 2024-06-11T21:02:40.617Z] 21:02:40     INFO - ==1363==Hint: address points to the zero page.
[task 2024-06-11T21:02:40.644Z] 21:02:40     INFO -     #0 <null> <null> (libfreetype.so.6+0x64660) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.645Z] 21:02:40     INFO -     #1 <null> <null> (libfreetype.so.6+0x6732b) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.645Z] 21:02:40     INFO -     #2 <null> <null> (libfreetype.so.6+0x8261d) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.646Z] 21:02:40     INFO -     #3 <null> <null> (libfreetype.so.6+0x2cc84) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.647Z] 21:02:40     INFO -     #4 <null> <null> (libfreetype.so.6+0x2e16a) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.647Z] 21:02:40     INFO -     #5 FT_Load_Glyph <null> (libfreetype.so.6+0x128c1) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.648Z] 21:02:40     INFO -     #6 wr_glyph_rasterizer::platform::unix::font::FontContext::load_glyph::hae3cd9fe5d9dce90 /builds/worker/checkouts/gecko/gfx/wr/wr_glyph_rasterizer/src/platform/unix/font.rs:559:27 (libxul.so+0xbec5fcf) (BuildId: 2bb5fee3d040114a98b43dd549f31f4fdef98c34)
[task 2024-06-11T21:02:40.648Z] 21:02:40     INFO - ThreadSanitizer can not provide additional info.
[task 2024-06-11T21:02:40.649Z] 21:02:40     INFO - SUMMARY: ThreadSanitizer: SEGV (/usr/lib/x86_64-linux-gnu/libfreetype.so.6+0x64660) (BuildId: acb61e31697176d046a68500624653579fb6904a)
[task 2024-06-11T21:02:40.651Z] 21:02:40     INFO - ==1363==ABORTING
[task 2024-06-11T21:02:40.688Z] 21:02:40     INFO - Exiting due to channel error.
[task 2024-06-11T21:02:40.689Z] 21:02:40     INFO - Exiting due to channel error.
[task 2024-06-11T21:02:40.690Z] 21:02:40     INFO - Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown (t=42.8386) Exiting due to channel error.
[task 2024-06-11T21:02:40.690Z] 21:02:40     INFO - Exiting due to channel error.
[task 2024-06-11T21:02:40.691Z] 21:02:40     INFO - Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown (t=43.4092) Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown (t=45.8747) Exiting due to channel error.
[task 2024-06-11T21:02:41.720Z] 21:02:41     INFO - Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown (t=58.802) Crash Annotation GraphicsCriticalError: |[C0][GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown (t=39.6818)
[task 2024-06-11T21:02:41.721Z] 21:02:41     INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/font-face/local-1.html | application terminated with exit code -6
[task 2024-06-11T21:02:41.721Z] 21:02:41     INFO -  mozlog.structuredlog: Failure calling log handler:
[task 2024-06-11T21:02:41.722Z] 21:02:41     INFO -  Traceback (most recent call last):
[task 2024-06-11T21:02:41.723Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/structuredlog.py", line 327, in _handle_log
[task 2024-06-11T21:02:41.723Z] 21:02:41     INFO -      handler(data)
[task 2024-06-11T21:02:41.723Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/handlers/base.py", line 74, in __call__
[task 2024-06-11T21:02:41.724Z] 21:02:41     INFO -      formatted = self.formatter(data)
[task 2024-06-11T21:02:41.724Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/handlers/base.py", line 42, in __call__
[task 2024-06-11T21:02:41.724Z] 21:02:41     INFO -      return self.inner(item)
[task 2024-06-11T21:02:41.724Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/formatters/errorsummary.py", line 31, in __call__
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -      rv = BaseFormatter.__call__(self, data)
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/reader.py", line 72, in __call__
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -      return handler(data)
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/mozlog/formatters/errorsummary.py", line 161, in shutdown_failure
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -      data["group"] = [g for g in self.groups if item["group"].endswith(g)][0]
[task 2024-06-11T21:02:41.725Z] 21:02:41     INFO -  IndexError: list index out of range
[task 2024-06-11T21:02:41.734Z] 21:02:41     INFO - REFTEST INFO | Process mode: e10s
[task 2024-06-11T21:02:41.745Z] 21:02:41     INFO - REFTEST INFO | Running tests in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/backgrounds/reftest.list
[task 2024-06-11T21:02:41.757Z] 21:02:41     INFO - REFTEST INFO | Running with e10s: True
[task 2024-06-11T21:02:41.758Z] 21:02:41     INFO - REFTEST INFO | Running with fission: True
[task 2024-06-11T21:02:41.759Z] 21:02:41     INFO - REFTEST INFO | INFO | runtests.py | TSan using symbolizer at /builds/worker/workspace/build/application/firefox/llvm-symbolizer
[task 2024-06-11T21:02:41.759Z] 21:02:41     INFO - REFTEST INFO | Application command: /builds/worker/workspace/build/application/firefox/firefox -marionette -profile /tmp/tmp3x9pip76.mozrunner
[task 2024-06-11T21:02:44.547Z] 21:02:44     INFO - ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2024-06-11T21:02:44.699Z] 21:02:44     INFO - 1718139764698	Marionette	INFO	Marionette enabled
[task 2024-06-11T21:02:44.710Z] 21:02:44     INFO - 1718139764709	Marionette	TRACE	Received observer notification final-ui-startup
[task 2024-06-11T21:02:45.304Z] 21:02:45     INFO - ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2024-06-11T21:02:45.431Z] 21:02:45     INFO - 1718139765430	Marionette	INFO	Listening on port 2828
[task 2024-06-11T21:02:45.445Z] 21:02:45     INFO - 1718139765443	Marionette	DEBUG	Marionette is listening
[task 2024-06-11T21:02:45.545Z] 21:02:45     INFO - 1718139765544	Marionette	DEBUG	Accepted connection 0 from 127.0.0.1:55554
[task 2024-06-11T21:02:45.662Z] 21:02:45     INFO - 1718139765661	Marionette	DEBUG	Closed connection 0
[task 2024-06-11T21:02:45.893Z] 21:02:45     INFO - 1718139765892	Marionette	DEBUG	Accepted connection 1 from 127.0.0.1:55556
[task 2024-06-11T21:02:46.983Z] 21:02:46     INFO - 1718139766982	Marionette	DEBUG	Closed connection 1
[task 2024-06-11T21:02:47.016Z] 21:02:47     INFO - 1718139767013	Marionette	DEBUG	Accepted connection 2 from 127.0.0.1:55558
[task 2024-06-11T21:02:47.302Z] 21:02:47     INFO - 1718139767301	Marionette	DEBUG	Accepted connection 3 from 127.0.0.1:55560
[task 2024-06-11T21:02:47.306Z] 21:02:47     INFO - 1718139767303	Marionette	DEBUG	Closed connection 2
[task 2024-06-11T21:02:47.459Z] 21:02:47     INFO - 1718139767458	Marionette	DEBUG	3 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2024-06-11T21:02:47.490Z] 21:02:47     INFO - 1718139767489	Marionette	DEBUG	Waiting for initial application window
[task 2024-06-11T21:02:54.490Z] 21:02:54     INFO - console.error: ({})
[task 2024-06-11T21:03:03.429Z] 21:03:03     INFO - [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
[task 2024-06-11T21:03:03.437Z] 21:03:03     INFO - console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
[task 2024-06-11T21:03:03.788Z] 21:03:03     INFO - 1718139783787	Marionette	TRACE	Received observer notification browser-idle-startup-tasks-finished
[task 2024-06-11T21:03:03.864Z] 21:03:03     INFO - 1718139783863	RemoteAgent	TRACE	[9] ProgressListener Start: expectNavigation=false resolveWhenStarted=false unloadTimeout=40000 waitForExplicitStart=false
[task 2024-06-11T21:03:03.869Z] 21:03:03     INFO - 1718139783868	RemoteAgent	TRACE	[9] ProgressListener Setting unload timer (40000ms)
[task 2024-06-11T21:03:03.872Z] 21:03:03     INFO - 1718139783871	RemoteAgent	TRACE	[9] Wait for initial navigation: isInitial=false, isLoadingDocument=false
[task 2024-06-11T21:03:03.876Z] 21:03:03     INFO - 1718139783875	RemoteAgent	TRACE	[9] Document already finished loading: about:blank
[task 2024-06-11T21:03:03.880Z] 21:03:03     INFO - 1718139783879	RemoteAgent	TRACE	[9] ProgressListener Stop: has error=false url=about:blank
[task 2024-06-11T21:03:04.033Z] 21:03:04     INFO - 1718139784030	Marionette	DEBUG	3 <- [1,1,null,{"sessionId":"b13cf679-c502-4869-9e91-f8f55bac6415","capabilities":{"acceptInsecureCerts":false,"browserName":"firefox","browserVersion":"129.0a1","platformName":"linux","unhandledPromptBehavior":"dismiss and notify","userAgent":"Mozilla/5.0 (X11; Linux x86_64; rv:129.0) Gecko/20100101 Firefox/129.0","moz:buildID":"20240611200056","moz:headless":false,"moz:platformVersion":"4.4.0-1014-aws","moz:processID":1674,"moz:profile":"/tmp/tmp3x9pip76.mozrunner","moz:shutdownTimeout":360000,"pageLoadStrategy":"normal","timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"setWindowRect":true,"strictFileInteractability":true,"moz:accessibilityChecks":false,"moz:webdriverClick":true,"moz:windowless":false,"proxy":{}}}]
[task 2024-06-11T21:03:04.108Z] 21:03:04     INFO - 1718139784107	Marionette	DEBUG	3 -> [0,2,"Addon:Install",{"path":"/builds/worker/workspace/build/tests/reftest/specialpowers","temporary":true}]
[task 2024-06-11T21:03:04.360Z] 21:03:04     INFO - 1718139784359	Marionette	DEBUG	3 <- [1,2,null,{"value":"[e-mail]"}]
[task 2024-06-11T21:03:04.418Z] 21:03:04     INFO - 1718139784417	Marionette	DEBUG	3 -> [0,3,"Addon:Install",{"path":"/builds/worker/workspace/build/tests/reftest/reftest","temporary":true}]
[task 2024-06-11T21:03:04.764Z] 21:03:04     INFO - 1718139784764	RemoteAgent	TRACE	Received observer notification domwindowopened
[task 2024-06-11T21:03:04.783Z] 21:03:04     INFO - 1718139784782	Marionette	DEBUG	3 <- [1,3,null,{"value":"[e-mail]"}]
[task 2024-06-11T21:03:04.844Z] 21:03:04     INFO - 1718139784844	Marionette	DEBUG	3 -> [0,4,"WebDriver:DeleteSession",{}]
[task 2024-06-11T21:03:04.866Z] 21:03:04     INFO - 1718139784865	Marionette	DEBUG	3 <- [1,4,null,{"value":null}]
[task 2024-06-11T21:03:04.879Z] 21:03:04     INFO - 1718139784878	Marionette	DEBUG	Closed connection 3
[task 2024-06-11T21:03:06.781Z] 21:03:06     INFO - REFTEST TEST-START | layout/reftests/backgrounds/layers-stacking-order.xhtml == layout/reftests/backgrounds/layers-stacking-order-ref.xhtml
[task 2024-06-11T21:03:06.782Z] 21:03:06     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/backgrounds/layers-stacking-order.xhtml | 0 / 145 (0%)
[task 2024-06-11T21:03:07.705Z] 21:03:07     INFO - REFTEST INFO | drawWindow flags = DRAWWINDOW_DRAW_CARET | DRAWWINDOW_DRAW_VIEW | DRAWWINDOW_USE_WIDGET_LAYERS; window size = 800,1000; test browser size = 800,1000
[task 2024-06-11T21:03:08.174Z] 21:03:08     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/backgrounds/layers-stacking-order-ref.xhtml | 0 / 145 (0%)
[task 2024-06-11T21:03:08.700Z] 21:03:08     INFO - REFTEST TEST-PASS | layout/reftests/backgrounds/layers-stacking-order.xhtml == layout/reftests/backgrounds/layers-stacking-order-ref.xhtml | image comparison, max difference: 0, number of differing pixels: 0

Comment 1

[Intermittent Failures Robot]

32 failures in 1038 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 14
• try: 2

Platform and build breakdown:

• linux1804-64-tsan-qr: 5
  • opt: 5
• linux1804-64-asan-qr: 27
  • opt: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1901887&startday=2024-06-12&endday=2024-06-12&tree=all

Comment 2

[Norisz Fay [:noriszfay]]

Hey Jonathan, any idea what could be the cause for this bug? It is failing a lot when retriggered/backfilled however sometimes it turns out green.

Here and here are 2 different examples of it failing recently. The first link is post backout of Bug 1896503 which backfills pointed out to be the recent culprit and the second link is pre backout of the bug while we were investigating the failure. As it can be seen, it's the same failure in both pre- and post-backout.

Here is the failure log for it.

Comment 3

[Jonathan Kew [:jfkthame]]

The crash appears to be in FT_Load_Glyph being called from webrender, so I guess it might indicate that WR is not managing the lifetime of the freetype font properly, or is failing to handle an earlier error, and ends up passing a broken font face to FT_Load_Glyph.

If we could get a pernosco trace of the failure, that might help track it down.

cc'ing Lee, as I don't really know much about WR's management of the font resources etc.

Comment 4

[Jonathan Kew [:jfkthame]]

And moving to the webrender component, as that's where the crash happens.

Comment 5

[Intermittent Failures Robot]

19 failures in 841 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 5
• try: 4

Platform and build breakdown:

• linux1804-64-tsan-qr: 7
  • opt: 7
• linux1804-64-asan-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1901887&startday=2024-06-13&endday=2024-06-13&tree=all

Comment 6

[Intermittent Failures Robot]

24 failures in 869 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 6
• try: 4

Platform and build breakdown:

• linux1804-64-tsan-qr: 7
  • opt: 7
• linux1804-64-asan-qr: 16
  • opt: 16
• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1901887&startday=2024-06-14&endday=2024-06-14&tree=all

Comment 7

[Lee Salzman [:lsalzman]]

This looks like it started pretty suspiciously around the time bug 1900791 landed. So I'm tentatively going to call it a regression from that patch.

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

:nical, since you are the author of the regressor, bug 1900791, could you take a look?

For more information, please visit BugBot documentation.

Comment 9

[Intermittent Failures Robot]

17 failures in 173 pushes (0.098 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-central: 7
• try: 1

Platform and build breakdown:

• linux1804-64-tsan-qr: 8
  • opt: 8
• linux1804-64-asan-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1901887&startday=2024-06-15&endday=2024-06-15&tree=all