1256224 - Thunderbird Windows crashes in OOM | small, even though Thunderbird is NOT out of memory per crash data

Status: NEW

(Thunderbird :: General, defect)

Description

[Wayne Mery (:wsmwk)]

~40% of Thunderbird 38.6.0 OOM | small crashes have Available Virtual Memory >1GB and System Memory Use Percentage <70%.  100% MS-Windows

https://crash-stats.mozilla.com/search/?product=Thunderbird&available_virtual_memory=%3E1000000000&signature=%3DOOM+%7C+small&system_memory_use_percentage=%3C70&_facets=signature&_columns=date&_columns=version&_columns=platform&_columns=user_comments&_columns=email&_columns=uptime#crash-reports

Examples:
bp-26d1bae4-4eaf-4035-bcd2-3f79b2160305  OOM Allocation Size 16384
bp-29c012e2-7933-4192-8901-7c4ca2160307  OOM Allocation Size 1
bp-2ec5d1a3-6f79-480c-8001-cc42a2160307
bp-ab094fe9-1ac1-4f66-93ab-fa40e2160308

Comment 1

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk, NI for questions) from comment #0)
> ~40% of Thunderbird 38.6.0 OOM | small crashes have Available Virtual Memory
> >1GB and System Memory Use Percentage <70%.  100% MS-Windows
> 
> https://crash-stats.mozilla.com/search/
> ?product=Thunderbird&available_virtual_memory=%3E1000000000&signature=%3DOOM+
> %7C+small&system_memory_use_percentage=%3C70&_facets=signature&_columns=date&
> _columns=version&_columns=platform&_columns=user_comments&_columns=email&_col
> umns=uptime#crash-reports

for 45.4.0, it is now 36%

https://crash-stats.mozilla.com/search/?available_virtual_memory=%3E1000000000&signature=%3DOOM%20%7C%20small&system_memory_use_percentage=%3C70&product=Thunderbird&date=%3E%3D2016-11-06T19%3A14%3A00.000Z&date=%3C2016-11-13T19%3A14%3A00.000Z&_sort=-date&_facets=signature&_columns=date&_columns=version&_columns=platform&_columns=user_comments&_columns=email&_columns=uptime#crash-reports

Comment 2

[Wayne Mery (:wsmwk)]

Many users with this crash signature also crash with "EMPTY" signature of bug 610551.

Comment 3

[Wayne Mery (:wsmwk)]

~1.5% for 52.1.0 + 52.1.1
https://crash-stats.mozilla.com/search/?available_virtual_memory=%3E1000000000&signature=%3DOOM%20%7C%20small&system_memory_use_percentage=%3C70&product=Thunderbird&version=52.1.1&version=52.1.0&date=%3E%3D2017-05-17T16%3A40%3A00.000Z&date=%3C2017-05-24T16%3A40%3A00.000Z&_sort=-date&_facets=signature&_columns=date&_columns=version&_columns=platform&_columns=user_comments&_columns=email&_columns=uptime#crash-reports

~27% for 52.1.0 + 52.1.1 if you drop Available Virtual Memory to >500mb (down from >1GB)
https://crash-stats.mozilla.com/search/?available_virtual_memory=%3E500000000&signature=%3DOOM%20%7C%20small&system_memory_use_percentage=%3C70&product=Thunderbird&version=52.1.1&version=52.1.0&date=%3E%3D2017-05-17T16%3A40%3A00.000Z&date=%3C2017-05-24T16%3A40%3A00.000Z&_sort=-date&_facets=signature&_columns=date&_columns=version&_columns=platform&_columns=user_comments&_columns=email&_columns=uptime#crash-reports

Comment 4

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk) from comment #3)

~1.5% for 52.1.0 + 52.1.1

now we're at 10% (which makes me wonder if the number in comment 3 from 2016 should have been stated as 15% )
https://crash-stats.mozilla.com/search/?available_virtual_memory=%3E500000000&signature=%3DOOM%20%7C%20small&system_memory_use_percentage=%3C70&product=Thunderbird&version=68.3.1&version=68.3.0&date=%3E%3D2019-12-05T19%3A30%3A00.000Z&date=%3C2020-01-05T19%3A30%3A00.000Z&_facets=signature&_sort=-date&_columns=date&_columns=version&_columns=platform&_columns=uptime#facet-signature

~27% for 52.1.0 + 52.1.1 if you drop Available Virtual Memory to >500mb
(down from >1GB)

now 12.4%
https://crash-stats.mozilla.com/search/?available_virtual_memory=%3E500000000&signature=%3DOOM%20%7C%20small&system_memory_use_percentage=%3C70&product=Thunderbird&version=68.3.1&version=68.3.0&date=%3E%3D2019-12-05T19%3A30%3A00.000Z&date=%3C2020-01-05T19%3A30%3A00.000Z&_facets=signature&_sort=-date&_columns=date&_columns=version&_columns=platform&_columns=uptime#facet-signature

Comment 5

[Wayne Mery (:wsmwk)]

Related to bug 1660696 and other OOM crashes (that are not like bug 583365 involving bulk message operations) ... not a scientific study, but examining 25-30 crashes I could find little few common themes - including add-ons. So some stats...

Address space - but I don't have a breakdown by OS

• 9% are 64bit (as in 64bit windows 10 running 64bit Thunderbird)
• 16% are 2gb (i.e. tiny)
• 75% are 4gb

Uptime - roughly 15% are >1 week uptime, going as high as 5 weeks

Stacks - again, nothing stands out, except hat a significant percentage, 15-20%, are like bp-e26a7363-1b9a-41a6-9786-534060210530 with pretty useless stack with only xul.dll (and some no stack at all, like bp-99c0e112-809a-45ed-a459-781420210530 )

Comment 6

[Ray Kraesig [:rkraesig]]

Assuming Thunderbird uses the same mozjemalloc that Firefox does, recent evidence suggests that this may often be due to Windows (and possibly macOS?) expanding the page file.

The investigation at bug 1716727 may be of interest.

Comment 7

[Wayne Mery (:wsmwk)]

Thanks, Ray, for pointing this out. Sounds interesting

New query at 70pct, using signature contains OOM (rather than OOM | small) - There are a few nightly crashes, and plenty of beta.

Changing the query to 90pct triples the number of crashes

removing the system_memory_use_percentage restriction completly increases number of crashes another 50%