1796267 - Browsing history and site data causing excessive storage bloat

Status: REOPENED

(GeckoView :: General, defect, P3)

Description

[Chris Peterson [:cpeterson]]

From github: https://github.com/mozilla-mobile/fenix/issues/26420.

Steps to reproduce

None in particular, just use fenix.

Expected behavior

Storage space used to remain stable and clearing browser cached images and files to yield some savings

Actual behavior

Storage space used keeps bloating and emptying browser cached images and files is useless.
Deleting browser history and site data clears majority of the bloat, but results in loss of history.

Device information

<img src = https://user-images.githubusercontent.com/15162365/183996063-7868bc12-5936-4e49-8654-784a734455e1.jpg> <img src = https://user-images.githubusercontent.com/15162365/183996068-5324ab31-575a-4a30-a23a-ab4aa213ad6f.jpg>
<img src = https://user-images.githubusercontent.com/15162365/183996070-2acf1cdd-1332-412b-9b53-9d063fa0acf8.jpg> <img src = https://user-images.githubusercontent.com/15162365/183996844-9dd9f2bf-b4ee-40fc-ad5a-0cd1fabd9e10.jpg>

<details>
<summary>About:support output</summary>

{
"application": {
"name": "Firefox",
"osVersion": "Linux 25 #1 SMP PREEMPT Wed Nov 15 16:06:34 KST 2017",
"version": "103.0.2",
"buildID": "20220802163236",
"distributionID": "",
"userAgent": "Mozilla/5.0 (Android 7.1.1; Mobile; rv:103.0) Gecko/103.0 Firefox/103.0",
"safeMode": false,
"memorySizeBytes": 1497272320,
"diskAvailableBytes": 467644416,
"supportURL": "https://support.mozilla.org/1/mobile/103.0.2/Android/en-US/",
"osTheme": "",
"numTotalWindows": 0,
"numFissionWindows": 0,
"numRemoteWindows": 0,
"fissionAutoStart": false,
"fissionDecisionStatus": "disabledByDefault",
"remoteAutoStart": true,
"keyLocationServiceGoogleFound": true,
"keySafebrowsingGoogleFound": true,
"keyMozillaFound": true
},
"securitySoftware": {
"registeredAntiVirus": "",
"registeredAntiSpyware": "",
"registeredFirewall": ""
},
"processes": {
"remoteTypes": {
"web": 1,
"gpu": 1
},
"maxWebContentProcesses": 2
},
"environmentVariables": {},
"modifiedPreferences": {
"browser.search.region": "NL",
"extensions.lastAppVersion": "103.0.2",
"idle.lastDailyNotification": 1660082742,
"media.gmp.storage.version.observed": 1,
"network.dns.disablePrefetch": true,
"network.http.speculative-parallel-limit": 0,
"network.predictor.enabled": false,
"network.prefetch-next": false,
"privacy.purge_trackers.last_purge": "1660082755461",
"privacy.purge_trackers.date_in_cookie_database": "0",
"security.remote_settings.crlite_filters.checked": 1656588114,
"security.remote_settings.intermediates.checked": 1656588114,
"storage.vacuum.last.index": 0
},
"lockedPreferences": {
"fission.autostart.session": false
},
"printingPreferences": {},
"media": {
"currentAudioBackend": "opensl",
"currentMaxAudioChannels": 2,
"currentPreferredSampleRate": 48000,
"audioOutputDevices": [
{
"name": "Default audio output device",
"groupId": "",
"vendor": "",
"type": 2,
"state": 2,
"preferred": 15,
"supportedFormat": 12336,
"defaultFormat": 16,
"maxChannels": 2,
"defaultRate": 44100,
"maxRate": 44100,
"minRate": 44100,
"maxLatency": 441,
"minLatency": 128
}
],
"audioInputDevices": [
{
"name": "Default audio input device",
"groupId": "",
"vendor": "",
"type": 1,
"state": 2,
"preferred": 15,
"supportedFormat": 12336,
"defaultFormat": 16,
"maxChannels": 1,
"defaultRate": 44100,
"maxRate": 44100,
"minRate": 44100,
"maxLatency": 441,
"minLatency": 128
}
]
},
"accessibility": {
"isActive": true,
"forceDisabled": 0,
"handlerUsed": false,
"instantiator": ""
},
"startupCache": {
"DiskCachePath": "/data/user/0/org.mozilla.firefox/files/mozilla/ft7e13yv.default/startupCache/startupCache.4.little",
"IgnoreDiskCache": false,
"FoundDiskCacheOnInit": false,
"WroteToDiskCache": true
},
"libraryVersions": {
"NSPR": {
"minVersion": "4.34",
"version": "4.34"
},
"NSS": {
"minVersion": "3.80",
"version": "3.80"
},
"NSSUTIL": {
"minVersion": "3.80",
"version": "3.80"
},
"NSSSSL": {
"minVersion": "3.80",
"version": "3.80"
},
"NSSSMIME": {
"minVersion": "3.80",
"version": "3.80"
}
},
"userJS": {
"exists": false
},
"intl": {
"localeService": {
"requested": [
"en-NL",
"en-GB"
],
"available": [
"an",
"ar",
"ast",
"az",
"be",
"bg",
"bn",
"br",
"bs",
"ca",
"cak",
"cs",
"cy",
"da",
"de",
"dsb",
"el",
"en-CA",
"en-GB",
"en-US",
"eo",
"es-AR",
"es-CL",
"es-ES",
"es-MX",
"et",
"eu",
"fa",
"ff",
"fi",
"fr",
"fy-NL",
"ga-IE",
"gd",
"gl",
"gn",
"gu-IN",
"he",
"hi-IN",
"hr",
"hsb",
"hu",
"hy-AM",
"id",
"is",
"it",
"ja",
"ka",
"kab",
"kk",
"kn",
"ko",
"lij",
"lo",
"lt",
"lv",
"ml",
"mr",
"ms",
"my",
"nb-NO",
"ne-NP",
"nl",
"nn-NO",
"oc",
"pa-IN",
"pl",
"pt-BR",
"pt-PT",
"rm",
"ro",
"ru",
"sk",
"sl",
"son",
"sq",
"sr",
"sv-SE",
"ta",
"te",
"th",
"tr",
"trs",
"uk",
"ur",
"uz",
"vi",
"wo",
"xh",
"zam",
"zh-CN",
"zh-TW"
],
"supported": [
"en-US",
"en-CA",
"en-GB"
],
"regionalPrefs": [
"en-NL",
"en-GB"
],
"defaultLocale": "en-US"
},
"osPrefs": {
"systemLocales": [
"en-NL",
"en-GB"
],
"regionalPrefsLocales": [
"en-NL",
"en-GB"
]
}
},
"crashes": {
"submitted": [],
"pending": 0
},
"remoteAgent": {
"running": false,
"url": ""
},
"graphics": {
"numTotalWindows": 2,
"numAcceleratedWindows": 2,
"windowLayerManagerType": "WebRender",
"windowLayerManagerRemote": true,
"adapterDescription": "Model: SM-T560NU, Product: gtelwifiue, Manufacturer: samsung, Hardware: qcom, OpenGL: Qualcomm -- Adreno (TM) 306 -- OpenGL ES 3.0 V@145.0 AU@ (GIT@I750f7f2fa6)",
"adapterVendorID": "Qualcomm",
"adapterDeviceID": "Adreno (TM) 306",
"adapterRAM": 0,
"adapterDrivers": "",
"driverVendor": "",
"driverVersion": "OpenGL ES 3.0 V@145.0 AU@ (GIT@I750f7f2fa6)",
"driverDate": "",
"targetFrameRate": 60,
"webgl1Renderer": "Qualcomm -- Adreno (TM) 306",
"webgl1Version": "OpenGL ES 3.0 V@145.0 AU@ (GIT@I750f7f2fa6)",
"webgl1DriverExtensions": "GL_AMD_compressed_ATC_texture GL_AMD_performance_monitor GL_AMD_program_binary_Z400 GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_discard_framebuffer GL_EXT_robustness GL_EXT_texture_format_BGRA8888 GL_EXT_texture_type_2_10_10_10_REV GL_NV_fence GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth_texture GL_OES_depth24 GL_OES_EGL_image GL_OES_EGL_sync GL_OES_EGL_image_external GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_fragment_precision_high GL_OES_get_program_binary GL_OES_packed_depth_stencil GL_OES_depth_texture_cube_map GL_OES_rgb8_rgba8 GL_OES_standard_derivatives GL_OES_texture_3D GL_OES_texture_float GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_vertex_type_10_10_10_2 GL_OES_vertex_array_object GL_QCOM_alpha_test GL_QCOM_binning_control GL_QCOM_driver_control GL_QCOM_perfmon_global_mode GL_QCOM_extended_get GL_QCOM_extended_get2 GL_QCOM_tiled_rendering GL_QCOM_writeonly_rendering GL_EXT_sRGB GL_EXT_sRGB_write_control GL_EXT_texture_sRGB_decode GL_EXT_texture_filter_anisotropic GL_EXT_multisampled_render_to_texture GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_disjoint_timer_query ",
"webgl1Extensions": "ANGLE_instanced_arrays EXT_blend_minmax EXT_color_buffer_half_float EXT_sRGB EXT_texture_filter_anisotropic MOZ_debug OES_element_index_uint OES_fbo_render_mipmap OES_standard_derivatives OES_texture_float OES_texture_half_float OES_texture_half_float_linear OES_vertex_array_object WEBGL_color_buffer_float WEBGL_compressed_texture_etc WEBGL_compressed_texture_etc1 WEBGL_debug_renderer_info WEBGL_debug_shaders WEBGL_depth_texture WEBGL_lose_context",
"webgl1WSIInfo": "EGL_VENDOR: Qualcomm, Inc\nEGL_VERSION: 1.4\nEGL_EXTENSIONS: EGL_QUALCOMM_shared_image EGL_KHR_image EGL_KHR_image_base EGL_QCOM_create_image EGL_KHR_lock_surface EGL_KHR_lock_surface2 EGL_KHR_lock_surface3 EGL_KHR_fence_sync EGL_KHR_cl_event EGL_KHR_cl_event2 EGL_IMG_context_priority EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_renderbuffer_image EGL_EXT_create_context_robustness EGL_ANDROID_blob_cache EGL_ANDROID_framebuffer_target EGL_KHR_create_context EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_ANDROIDX_no_config_context EGL_KHR_partial_update EGL_ANDROID_image_crop EGL_ANDROID_recordable EGL_ANDROID_native_fence_sync EGL_ANDROID_image_native_buffer EGL_KHR_gl_colorspace EGL_IMG_image_plane_attribs \nIsWebglOutOfProcessEnabled: 0",
"webgl2Renderer": "Qualcomm -- Adreno (TM) 306",
"webgl2Version": "OpenGL ES 3.0 V@145.0 AU@ (GIT@I750f7f2fa6)",
"webgl2DriverExtensions": "GL_AMD_compressed_ATC_texture GL_AMD_performance_monitor GL_AMD_program_binary_Z400 GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_discard_framebuffer GL_EXT_robustness GL_EXT_texture_format_BGRA8888 GL_EXT_texture_type_2_10_10_10_REV GL_NV_fence GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth_texture GL_OES_depth24 GL_OES_EGL_image GL_OES_EGL_sync GL_OES_EGL_image_external GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_fragment_precision_high GL_OES_get_program_binary GL_OES_packed_depth_stencil GL_OES_depth_texture_cube_map GL_OES_rgb8_rgba8 GL_OES_standard_derivatives GL_OES_texture_3D GL_OES_texture_float GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_vertex_type_10_10_10_2 GL_OES_vertex_array_object GL_QCOM_alpha_test GL_QCOM_binning_control GL_QCOM_driver_control GL_QCOM_perfmon_global_mode GL_QCOM_extended_get GL_QCOM_extended_get2 GL_QCOM_tiled_rendering GL_QCOM_writeonly_rendering GL_EXT_sRGB GL_EXT_sRGB_write_control GL_EXT_texture_sRGB_decode GL_EXT_texture_filter_anisotropic GL_EXT_multisampled_render_to_texture GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_disjoint_timer_query ",
"webgl2Extensions": "EXT_color_buffer_float EXT_texture_filter_anisotropic MOZ_debug WEBGL_compressed_texture_etc WEBGL_compressed_texture_etc1 WEBGL_debug_renderer_info WEBGL_debug_shaders WEBGL_lose_context",
"webgl2WSIInfo": "EGL_VENDOR: Qualcomm, Inc\nEGL_VERSION: 1.4\nEGL_EXTENSIONS: EGL_QUALCOMM_shared_image EGL_KHR_image EGL_KHR_image_base EGL_QCOM_create_image EGL_KHR_lock_surface EGL_KHR_lock_surface2 EGL_KHR_lock_surface3 EGL_KHR_fence_sync EGL_KHR_cl_event EGL_KHR_cl_event2 EGL_IMG_context_priority EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_renderbuffer_image EGL_EXT_create_context_robustness EGL_ANDROID_blob_cache EGL_ANDROID_framebuffer_target EGL_KHR_create_context EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_ANDROIDX_no_config_context EGL_KHR_partial_update EGL_ANDROID_image_crop EGL_ANDROID_recordable EGL_ANDROID_native_fence_sync EGL_ANDROID_image_native_buffer EGL_KHR_gl_colorspace EGL_IMG_image_plane_attribs \nIsWebglOutOfProcessEnabled: 0",
"info": {
"AzureCanvasBackend (UI Process)": "skia",
"AzureFallbackCanvasBackend (UI Process)": "skia",
"AzureContentBackend (UI Process)": "skia",
"AzureCanvasBackend": "skia",
"AzureContentBackend": "skia",
"ApzTouchInput": 1,
"ApzAutoscrollInput": 1,
"ApzZoomingInput": 1,
"CMSOutputProfile": "Empty profile data",
"DisplayCount": 1,
"Display0": "800x1280@0Hz scales:1.000000|1.000000"
},
"failures": [
"CP+[GFX1-]: Receive IPC close with reason=AbnormalShutdown"
],
"indices": [
0
],
"featureLog": {
"features": [
{
"name": "HW_COMPOSITING",
"description": "Compositing",
"status": "force_enabled",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "user",
"status": "force_enabled",
"message": "Force-enabled by pref"
}
]
},
{
"name": "OPENGL_COMPOSITING",
"description": "OpenGL Compositing",
"status": "force_enabled",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "user",
"status": "force_enabled",
"message": "Force-enabled by pref"
}
]
},
{
"name": "GPU_PROCESS",
"description": "GPU Process",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "WEBRENDER",
"description": "WebRender",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "WEBRENDER_QUALIFIED",
"description": "WebRender qualified",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "WEBRENDER_COMPOSITOR",
"description": "WebRender native compositor",
"status": "disabled",
"log": [
{
"type": "default",
"status": "disabled",
"message": "Disabled by default"
}
]
},
{
"name": "WEBRENDER_PARTIAL",
"description": "WebRender partial present",
"status": "blocklisted",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "env",
"status": "blocklisted",
"message": "Blocklisted by gfxInfo"
}
]
},
{
"name": "WEBRENDER_SHADER_CACHE",
"description": "WebRender shader disk cache",
"status": "blocklisted",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "env",
"status": "blocklisted",
"message": "Blocklisted by gfxInfo"
}
]
},
{
"name": "WEBRENDER_OPTIMIZED_SHADERS",
"description": "WebRender optimized shaders",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "WEBRENDER_ANGLE",
"description": "WebRender ANGLE",
"status": "unavailable",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "env",
"status": "unavailable",
"message": "OS not supported"
}
]
},
{
"name": "WEBRENDER_DCOMP_PRESENT",
"description": "WebRender DirectComposition",
"status": "unavailable",
"log": [
{
"type": "default",
"status": "available"
},
{
"type": "user",
"status": "disabled",
"message": "User disabled via pref"
},
{
"type": "env",
"status": "unavailable",
"message": "Requires Windows 10 or later"
},
{
"type": "runtime",
"status": "unavailable",
"message": "Requires ANGLE"
}
]
},
{
"name": "WEBRENDER_SOFTWARE",
"description": "WebRender software fallback",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "WEBGPU",
"description": "WebGPU",
"status": "blocked",
"log": [
{
"type": "default",
"status": "disabled",
"message": "Disabled by default"
},
{
"type": "runtime",
"status": "blocked",
"message": "WebGPU cannot be enabled in release or beta"
}
]
},
{
"name": "VP8_HW_DECODE",
"description": "VP8 hardware decoding",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
},
{
"name": "VP9_HW_DECODE",
"description": "VP9 hardware decoding",
"status": "available",
"log": [
{
"type": "default",
"status": "available"
}
]
}
],
"fallbacks": []
},
"crashGuards": []
},
"addons": [
{
"name": "Mozilla Android Components - Ads Telemetry",
"type": "extension",
"version": "103.0.10.0803084751",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "Mozilla Android Components - Browser Icons",
"type": "extension",
"version": "103.0.10.0803084737",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "Mozilla Android Components - Firefox Accounts WebChannel",
"type": "extension",
"version": "103.0.10.0803084742",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "Mozilla Android Components - ReaderView",
"type": "extension",
"version": "103.0.10.0803084737",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "Mozilla Android Components - Search Telemetry",
"type": "extension",
"version": "103.0.10.0803084751",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "Mozilla Android Components - Web Compatibility Interventions",
"type": "extension",
"version": "103.0.0",
"isActive": true,
"id": "[e-mail]"
},
{
"name": "uBlock Origin",
"type": "extension",
"version": "1.43.0",
"isActive": true,
"id": "[e-mail]"
}
],
"features": []
}

• Android device: SM-T560NU running 7.1.1
• Fenix version: 103.0.2

┆Issue is synchronized with this Jira Task

Change performed by the Move to Bugzilla add-on.

Comment 1

[Kenneth Heal]

Attachment: console-export-2022-10-17_11-51-13.redacted.txt.gz

Current storage usage of Fenix mozdir

Comment 2

[Kenneth Heal]

I cleared Twitter cookies about a week ago and logged back in again to my twitter accounts.
Attached is the current output of the script in https://github.com/mozilla-mobile/fenix/issues/26420#issuecomment-1279919303

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:cpeterson, could you have a look please?

For more information, please visit auto_nag documentation.

Comment 4

[Olivia Hall [:olivia]]

Reading through the Github bug, I believe this was partially fixed by bug 1795710 and will be fully fixed by bug 1813414, which is still open.

Please reopen if this is not the case.

Comment 5

[Kenneth Heal]

https://bugzilla.mozilla.org/show_bug.cgi?id=1795710 was ruled out in the case I dealt with, and https://bugzilla.mozilla.org/show_bug.cgi?id=1813414 was only a small part of the issue.
Unfortunately dev never managed to narrow down the issue beyond this.
https://bugzilla.mozilla.org/show_bug.cgi?id=1813414 will help, but I doubt this will be more than a 10% fix.
https://github.com/mozilla-mobile/fenix/issues/26420 gives more of the troubleshooting history

Comment 6

[Olivia Hall [:olivia]]

Thanks for the additional info, I will reopen! Could you summarizing some of the important parts of the conversation?

(If you know off-hand the percentage of what type of files aren't clearing, that would be very helpful!)

Comment 7

[Kenneth Heal]

The key problem in attempting to troubleshoot is the complete lack of usable instrumentation to track down where the space is being wasted. We simply see Firefox bloating and nobody seemed to really be able to track down what is happening. Clearing cache was useless and made no real impact. I ran a script in the debug console and uploaded the outputs to the github ticket.
Fwiw the device I see this is a Galaxy Tab E SM-T560NU runs Android 7.1.1 and Samsung experience 8.5.
I don't notice this issue on newer devices, that said newer devices have significantly more internal storage so an issue is less likely to cause problems and be retorted.