1174324 - Thunderbird startup crash in OOM | small. Crash gone after deleting the global-messages-db file

Status: RESOLVED WORKSFORME

(Thunderbird :: General, defect)

Description

[Axel Grude [:realRaven]]

This bug was filed from the Socorro interface and is 
report bp-e27713f2-3c1b-43cf-b05b-66b062150612.
=============================================================

Comment 1

[Axel Grude [:realRaven]]

Caused by the upgrade. Tried starting with Addons disabled and deleted session, to no avail. Thunderbird crashes around 20 seconds after showing the UI (which comes up fairly quickly)

Comment 2

[Joe Sabash [:JoeS1]]

Might be bug 1028720 but wondering why it would start now for you
Axel could you publish your crash ID

Comment 3

[Axel Grude [:realRaven]]

Currently running Tb beta which is fine.
I was told to put all crash reports of tonight's update in the bugm so here goes:

http://crash-stats.mozilla.com/report/index/bp-26541aef-0e08-4bb6-8a11-757002150612
http://crash-stats.mozilla.com/report/index/bp-d711d694-ca8f-4161-895b-0e98e2150612
http://crash-stats.mozilla.com/report/index/bp-03001a6a-b600-4ebe-b46d-a47f42150612
http://crash-stats.mozilla.com/report/index/bp-e27713f2-3c1b-43cf-b05b-66b062150612
http://crash-stats.mozilla.com/report/index/bp-11163145-dbb5-4c71-8f34-bb1df2150612

in most of them I kept the addons disabled.

Comment 4

[Joe Sabash [:JoeS1]]

Wayne, does this look like a dup to you

Comment 5

[Wayne Mery (:wsmwk)]

Try with hardware accleration disabled at tools | options | advanced | general

Addons disabled:
bp-11163145-dbb5-4c71-8f34-bb1df2150612 nsCharTraits<T>::length(wchar_t const*) 
bp-e27713f2-3c1b-43cf-b05b-66b062150612  OOM | small 
bp-e27713f2-3c1b-43cf-b05b-66b062150612  OOM | small 
bp-03001a6a-b600-4ebe-b46d-a47f42150612  OOM | small 

not disabled
bp-26541aef-0e08-4bb6-8a11-757002150612
bp-d711d694-ca8f-4161-895b-0e98e2150612

Comment 6

[Axel Grude [:realRaven]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #5)
> Try with hardware accleration disabled at tools | options | advanced |
> general
> 
> Addons disabled:
> bp-11163145-dbb5-4c71-8f34-bb1df2150612 nsCharTraits<T>::length(wchar_t
> const*) 
> bp-e27713f2-3c1b-43cf-b05b-66b062150612  OOM | small 
> bp-e27713f2-3c1b-43cf-b05b-66b062150612  OOM | small 
> bp-03001a6a-b600-4ebe-b46d-a47f42150612  OOM | small 
> 
> not disabled
> bp-26541aef-0e08-4bb6-8a11-757002150612
> bp-d711d694-ca8f-4161-895b-0e98e2150612

..Still crashing with hardware disabled:
bp-c530fb54-a4d3-4129-968d-4e0302150613

Comment 7

[Wayne Mery (:wsmwk)]

How about Windows safe mode??

Comment 8

[Axel Grude [:realRaven]]

I did some more testing today, upgraded the beta to beta6 and the same problem happened; I then went back to beta5 and it still crashes (Loading Message...) then I installed beta4 and there is no problem. 

So beta4: works
beta5: has the problem.

a) Are there downloads of more builds (32bit windows installers please) in between which I could download to narrow it down further?
b) is there are way to log or debug what message it is trying to load at the startup?

I also had a custom landing page in mailnews.start_page.url which I removed but it didn't fix it. It would be great to know which of my mail accounts causes the issue, but I do not want to remove any as this is my "production" profile with the following sizes:

Mail Folder:                7GB
ImapMail Folder:            9.5GB
global-messages-db.sqlite: 55GB

It is definitely something in one of my mail profiles though. If I knew which account I could try repairing / reindexing. Also I do not understand why the status bar says "Loading MEssage..." although when I open it in beta4 it shows the landing page and not a mail.

Comment 9

[:Gijs (he/him)]

(In reply to Axel Grude [:realRaven] from comment #8)
> I did some more testing today, upgraded the beta to beta6 and the same
> problem happened; I then went back to beta5 and it still crashes (Loading
> Message...) then I installed beta4 and there is no problem. 
> 
> So beta4: works
> beta5: has the problem.
> 
> a) Are there downloads of more builds (32bit windows installers please) in
> between which I could download to narrow it down further?

Yes, using treeherder you can find the intermediate builds from the appropriate platform

> b) is there are way to log or debug what message it is trying to load at the
> startup?

Attach a debugger? ( https://developer.mozilla.org/en-US/docs/Debugging_Mozilla_on_Windows_FAQ has some info though it is a little out of date in some respects)

Comment 10

[Wayne Mery (:wsmwk)]

Axel, what addons are installed?


(In reply to Axel Grude [:realRaven] from comment #8)
> So beta4: works
> beta5: has the problem.

In this case there are no intermediate builds. But we can check what patches landed between b4 and b5, which started building 4/29 and 5/11 respectively. We picked up several lightning packaging changes, and bug 1154521 - jsmime fails on long references header an - but beyond that I'm not sure

Magnus, what URL will show which changesets were picked up between b4 and b5?  I looked at http://hg.mozilla.org/releases/comm-esr38/graph and I do not see b4 and b5.

Comment 11

[Axel Grude [:realRaven]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #10)
> Axel, what addons are installed?
> 
A lot! Unfortunately the extension dump mechanism doesn't work but the error also happens in safe mode (which also excludes Lightning), so I am not at all sure this is related to addons. Possibly something else in my profile or the fact that the global-messages-db.sqlite file is so damn huge (55.9 GByte). How can I test this without damaging my database? Any way I could rebuild it?

I will make another attempt with the release version today, if there was corruption in the database that lead to an endless loop the old beta might have fixed it...

Extensions according to crash dump:
[e-mail]
[e-mail]
[e-mail]
[e-mail]
[e-mail]
{4C9FE6FE-2C83-11DC-90B4-DC8456D89593}
[e-mail]
{d0e38b3a-0d60-46bf-bf01-83d4ba041015}
[e-mail]
[e-mail]
[e-mail]
[e-mail]
[e-mail]
[e-mail]
{F8147CF4-B9E3-445B-AA87-081ED66548F8}
[e-mail]
[e-mail]
[e-mail]
[e-mail]
{25A1388B-6B18-46c3-BEBA-A81915D0DE8F}
[e-mail]
{1A2D0EC4-75F5-4c91-89C4-3656F6E44B68}
[e-mail]
{1280606b-2510-4fe0-97ef-9b5a22eafe80}
[e-mail]
[e-mail]
[e-mail]
{e2fda1a4-762b-4020-b5ad-a41df1933103}
[e-mail]
{58D4392A-842E-11DE-B51A-C7B855D89593}
[e-mail]
[e-mail]
[e-mail]
{972ce4c6-7e08-4474-a285-3208198ce6fd}
[e-mail]
[e-mail]
[e-mail]
[e-mail]

Comment 12

[Wayne Mery (:wsmwk)]

(In reply to Axel Grude [:realRaven] from comment #11)
> (In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment
> #10)
> > Axel, what addons are installed?
> > 
> A lot! Unfortunately the extension dump mechanism doesn't work but the error
> also happens in safe mode (which also excludes Lightning), so I am not at
> all sure this is related to addons. Possibly something else in my profile or
> the fact that the global-messages-db.sqlite file is so damn huge (55.9
> GByte). How can I test this without damaging my database? Any way I could
> rebuild it?
> 
> I will make another attempt with the release version today, if there was
> corruption in the database that lead to an endless loop the old beta might
> have fixed it...

I forgot you had tested safe mode


> Mail Folder:                7GB
> ImapMail Folder:            9.5GB
> global-messages-db.sqlite: 55GB

global-messages-db looks way too big.  It should be a fraction of the total mail folders.  With thunderbird shut down, please rename it and it will rebuild when you restart.

Comment 13

[Axel Grude [:realRaven]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #12)
> (In reply to Axel Grude [:realRaven] from comment #11)
> > (In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment
> > #10)
> > Mail Folder:                7GB
> > ImapMail Folder:            9.5GB
> > global-messages-db.sqlite: 55GB
> 
> global-messages-db looks way too big.  It should be a fraction of the total
> mail folders.  With thunderbird shut down, please rename it and it will
> rebuild when you restart.

Okay trying that now, makes sense. It would be good to have a db management tool / front-end to cut out the "crud"; I can't even see what Tb does in the db in activity manager?

I tried opening the profile with release 38.0.1 and it didn't crash for a couple of minutes, but now I am following your advice, after having moved the sqlite database to a different folder. Is there any way I can find out that it is "completed" building? I figure this might take a while what with all the email and folders I have...

It is strange how we have a "Repair Folder" tool for the index files, but no tools at all for the database. A SQL interface where I could browse tables and do some simple select statements would be awesome :) - or maybe there is a way to turn it into a datasource for an external db frontend?

Comment 14

[Axel Grude [:realRaven]]

One additional important difference I notice is that all my folder icons are gone now the db is rebuilding. these were stored using folder string properties (using my own addon code / QuickFolders) - I guess these are somehow stored in the database?

They are stored / set as URL using

nsIMsgFolder.setStringProperty()
nsIMsgFolder.getStringProperty()

(I am using my own treeview code for styling them)

but didn't store an excessive amount of data... I will probably have to write a quick routine that restores all icons in case something like it happens again.

Comment 15

[Wayne Mery (:wsmwk)]

(In reply to Axel Grude [:realRaven] from comment #14)
> One additional important difference I notice is that all my folder icons are
> gone now the db is rebuilding. these were stored using folder string
> properties (using my own addon code / QuickFolders) - I guess these are
> somehow stored in the database?

nope, not stored there. And the database doesn't (or should't) affect folders in that way.  The database only drives the searching and converstions capabilities.

> Okay trying that now, makes sense. It would be good to have a db management tool / front-end to cut 
> out the "crud"; I can't even see what Tb does in the db in activity manager?

db tools are too id depth for the average user. 

Activity manager should be showing db indexing activity. If you do not see anything, then it's not building.

Comment 16

[Axel Grude [:realRaven]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #15)
> (In reply to Axel Grude [:realRaven] from comment #14)
> > One additional important difference I notice is that all my folder icons are
> > gone now the db is rebuilding. these were stored using folder string
> > properties (using my own addon code / QuickFolders) - I guess these are
> > somehow stored in the database?
> 
> nope, not stored there. And the database doesn't (or should't) affect
> folders in that way.  The database only drives the searching and
> converstions capabilities.

Okay WHERE are they stored? This is a big mystery to me and apparently it is also broken in my version. I programmed a routing for restoring the icons but they are gone as soon as I restart Thunderbird. folder properties must surely be stored *somewhere*? At least they used to up until 38beta4 :)

> 
> > Okay trying that now, makes sense. It would be good to have a db management tool / front-end to cut 
> > out the "crud"; I can't even see what Tb does in the db in activity manager?
> 
> db tools are too id depth for the average user. 
> 
> Activity manager should be showing db indexing activity. If you do not see
> anything, then it's not building.

Ok I am still showing indexing activity (so this not just rebuilding the msf files but the actual db) and the SQLLite File wighs in at 616 MByte at the moment.

Comment 17

[Wayne Mery (:wsmwk)]

If I did a proper selection, the checkins for 38.0b5 are as follows...

Fix bug 1154521 - jsmime fails on long references header and e-mail gets sent and stored in Sent without headers (regression). r=rkent, a=rkent 2 months ago, by Philipp Kewisch
Bug 1141446 - Handle mal-formed rfc2047 encoded From message header better; r=rkent, a=rkent 2 months ago, by Jorg K
Bug 1151782 - Inputting 29th Feb as a birthday in the addressbook contact replaces it with 1st Mar. r=mkmelin,iann a=SM always CLOSED TREE, a=rkent 2 months ago, by Christian Hoffmann <christian>
Bug 1161477 - getLogFromFile sometimes returns the wrong log for grouped logs. r=aleth, a=rkent 2 months ago, by Nihanth Subramanya
Bug 1161162 - "Join Chat" doesn't focus the newly joined MUC. r=clokep, a=rkent 2 months ago, by aleth
Bug 1148330 - Font indicator doesn't update when cursor is placed in text where core returns sans-serif; r=iann, a=rkent 2 months ago, by Neil Rashbrook
Bug 1148330 - Remove Linux system generic fonts that collide with CSS generic fonts from preferences; r=mkmelin, a=rkent 2 months ago, by Jorg K
Bug 1069790 - Email addresses with parenthesis are not pretty-printed anymore. r=rkent, a=rkent 2 months ago, by Karsten Düsterloh
Bug 1135291 - Update chat log entries added to Gloda since bug 955292 to use relative paths. r=aleth,asuth a=rkent 2 months ago, by Nihanth Subramanya
Bug 914225 - Support hotfix add-on in Thunderbird. r=standard8, a=rkent 2 months ago, by Magnus Melin
Bug 745664 - Test. r=mkmelin, a=rkent 2 months ago, by Hiroyuki Ikezoe
Bug 745664 - Get localized string from prefs service for adressbook description. r=Neil, a=rkent 2 months ago, by Hiroyuki Ikezoe
Bug 1156669 - Trash folder duplication while using IMAP with localized TB, r=neil, a=rkent 2 months ago, by R Kent James
Switch mozilla repo to mozilla-esr38 to build Thunderbird 38, a=rkent 2 months ago, by R Kent James
Bug 1151440 - Choose a color not responsive when creating a New calendar in Lightning 4.0b1. ui-r=paenglab, r+a=philipp 2 months ago, by Matthew Mecca
Don't bail if lightning-l10n.js is missing. rs=jcranmer,a=release-bustage 2 months ago, by Philipp Kewisch
Run compare-locales using a hardcoded path to make builders happy a=release-bustage 2 months ago, by Philipp Kewisch
Run compare-locales using a hardcoded path to make builders happy a=release-bustage 2 months ago, by Philipp Kewisch
Switch comm-beta to use releases/mozilla-release and THUNDERBIRD_38_VERBRANCH. a=rkent 2 months ago, by Philipp Kewisch
Fix bug 1130854 - Package Lightning with Thunderbird - Make mac unification work - remove extra universal.mk. a=release-bustage 2 months ago, by Philipp Kewisch
Bug 1151206 - Add the titlebar structure to messageWindow, AB and Composer. r=josiah, a=rkent 2 months ago, by Richard Marti
Bug 1138220 - some headers are not not properly capitalized. r=jcranmer, a=rkent 2 months ago, by Magnus Melin
Bug 968334 Disable content retargeting in messages (38 version) r=Standard8, a=rkent 2 months ago, by Neil Rashbrook
Bug 1109178 - Make OAuth implementation work with Evernote. r=clokep, a=rkent 2 months ago, by Mike Kaply
Bug 1152926 - New mail sound preview doesn't work for default system sound on Mac OS X. r=aleth, a=rkent 2 months ago, by Suyash Agarwal
Bug 1152989 - Show the base account manager panels even when an account manager extension can't be loaded. r=rkent, r=mkmelin, a=rkent 2 months ago, by aceman
Bug 1151462 - Send XMPP pings if there has been no outgoing activity to avoid Openfire disconnects. r=clokep, a=rkent 2 months ago, by aleth
Bug 1143569 - User-agent error when posting to NNTP due to RFC5536 violation of Tb (user-agent header is folded just after user-agent:, "user-agent:[CRLF][SP]Mozilla..."). r=jcranmer, a=rkent 2 months ago, by Magnus Melin
Bug 1121874 - Twitter authorization fails as cookies disabled. r=clokep, a=rkent 2 months ago, by aleth
Bug 768480 - Mac OSX TB 13 crashes in nsMsgDBFolder::CreateFileForDB when going online. Caused by folder subscribed on server that no longer exists?, r=neil, a=rkent 2 months ago, by R Kent James

Comment 18

[Axel Grude [:realRaven]]

Thanks for posting the list - doesn't look like there anything relevant there that might have cause a regression.

I would suggest we close the bug as RESOLVED WORKSFORME, as I cannot reproduce it currently after deleting the global-messages-db  file. it currently clocks in at 980 MByte, hope it doesn't grow out of control again.

Comment 19

[Magnus Melin [:mkmelin]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #10) 
> Magnus, what URL will show which changesets were picked up between b4 and
> b5?  I looked at http://hg.mozilla.org/releases/comm-esr38/graph and I do
> not see b4 and b5.

Not sure if you get one where they are marked. http://hg.mozilla.org/releases/comm-esr38/pushloghtml with suitable dates?

Comment 20

[Wayne Mery (:wsmwk)]

(In reply to Magnus Melin from comment #19)
> (In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment
> #10) 
> > Magnus, what URL will show which changesets were picked up between b4 and
> > b5?  I looked at http://hg.mozilla.org/releases/comm-esr38/graph and I do
> > not see b4 and b5.
> 
> Not sure if you get one where they are marked.
> http://hg.mozilla.org/releases/comm-esr38/pushloghtml with suitable dates?

darn, the move to s3 has lost the dates. 
38.0b4 started building 4/29/2015. https://hg.mozilla.org/releases/comm-beta/rev/9a99fcc7f1eb
38.0b5 started building 5/11/2015 https://hg.mozilla.org/releases/comm-beta/rev/6117bc38a1fe

https://hg.mozilla.org/releases/comm-beta/pushloghtml?startdate=2015-04-29&enddate=2015-05-11

Comment 21

[Wayne Mery (:wsmwk)]

(In reply to Axel Grude [:realRaven] from comment #18)
> Thanks for posting the list - doesn't look like there anything relevant
> there that might have cause a regression.
> 
> I would suggest we close the bug as RESOLVED WORKSFORME, as I cannot
> reproduce it currently after deleting the global-messages-db  file. it
> currently clocks in at 980 MByte, hope it doesn't grow out of control again.

Closing WFM, although it feels more incomplete than WFM :)   And I didn't find any gloda/global search bugs fixed in Thunderbird during the time period (although there could have been toolkit+storage bugs fixed)

FWIW, a few users of OOM | small also have "empty" crash reports, ala bug 610551.