555114 - Deciding which messages to index indefinitely. High memory usage

Status: RESOLVED WORKSFORME

(MailNews Core :: Database, defect)

Description

[CortJstr]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2 Glue/4.5 (.NET CLR 3.5.30729)
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.8) Gecko/20100227 Thunderbird/3.0.3

Recently every time I start TB processor usage skyrockets and memory usage increases rapidly. Activity Monitor says "determining which messages to index in Sent Mail" and the throbber never stops spinning. Memory usage (according to Task Manager) is about 1,300,000K during this. I've left it for hours and it never stops, though processor usage drops to 0 after about 5 minutes.

Went through steps at https://wiki.mozilla.org/Thunderbird:Testing:Memory_Usage_Problems and disabling Global Indexing solves the issue, memory usage is now 50,000K. Per instructions on that page I'm entering this bug.

Reproducible: Always




Sent Mail is a GMail IMAP folder. It contains 708 messages and 10 subfolders each of which averages 600 messages.

I first noticed this issue a few days ago but can't confirm definitively when it started.

Comment 1

[Ludovic Hirlimann [:Usul]]

Putting in db, whist this can be a corrupt datastore issue.

What do you see when you re-enable gloda with the debug options on (see https://wiki.mozilla.org/Thunderbird:Using_Gloda) ?

Comment 2

[CortJstr]

I did my best to follow the directions though when I typed "browser.dom.window.dump.enabled" in the filter nothing came up.

Thunderbird again went up to 1,444,xxx mem usage. It got past determining which messages to index and is now stuck on "Indexing 60 of 70 messages in Sent Mail (84% complete)".

Where can I locate the dump file since I assume you need to see it. I looked in %APPDATA%\Thunderbird\Profiles\1tva22eh.default but nothing jumped out at me.

Also, after posting this bug I updated TB to Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4

Comment 3

[Ludovic Hirlimann [:Usul]]

(In reply to comment #2)
> I did my best to follow the directions though when I typed
> "browser.dom.window.dump.enabled" in the filter nothing came up.

yep you need to create it.

Comment 4

[Wayne Mery (:wsmwk)]

perhaps related to bug 557001. Hopefully asuth's or someone else's enthusiasm for head banging the memory issue(s) will soon bear fruit so it can be tested against other bugs.

Comment 5

[CortJstr]

OK, I've added browser.dom.window.dump.enabled and set it to true but I'm still not sure what I should be seeing. I also tried starting TB with the -console switch as I saw that mentioned a few places.

Comment 6

[Ludovic Hirlimann [:Usul]]

You should launch TB from cmd.exe and that should spurt messages that you should then copy paste in a file and attach the file here.

Comment 7

[CortJstr]

I don't get what I'm going wrong. I set both things to true in the config screen and I tried launching TB from cmd.exe. When I launch it with no switches no messages spurt. When I launch it with the -console argument I get lots an lots of messages but they're in a window that won't let me select or copy text like a regular cmd window does.

Comment 8

[Ludovic Hirlimann [:Usul]]

you can also try to redirect when you launch thunderbird.exe -comandswitchthatyouwant >log.txt

Comment 9

[Wayne Mery (:wsmwk)]

CortJstr,  roughly 8am-5pm PST you can get assistance at 
http://www.mibbit.com/chat/?server=irc.mozilla.org&channel=%23tb-qa,%23maildev

You might also try a nightly 3.1 build ftp://ftp.mozilla.org/pub/thunderbird/nightly/latest-comm-1.9.2/ - backup your profile before using

Comment 10

[Wayne Mery (:wsmwk)]

josh, If this improves with 3.0.5, which comes out shortly, please update the bug.
If not, then please try version 3.1 when it releases and update the bug.

Comment 11

[Joshua Cranmer [:jcranmer]]

RESOLVED INCOMPLETE due to lack of response to previous question. If you feel this change was made in error, please respond to this bug with your reasons why.

Comment 12

[CortJstr]

I installed 3.1.1 last night and it appears to have resolved the issue. On first load it used all my memory for about an hour but has been behaving normally sense.