Runaway memory usage when starting because of large panacea.dat (eg. 110MB)

RESOLVED INCOMPLETE

Status

defect
--
major
RESOLVED INCOMPLETE
5 years ago
4 years ago

People

(Reporter: pete, Unassigned)

Tracking

(Blocks 1 bug, {perf})

Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(2 attachments)

User Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:33.0) Gecko/20100101 Firefox/33.0
Build ID: 20141013195847

Steps to reproduce:

Attempted to start thunderbird from Kubuntu menu.
Also tried command line:
  /usr/bin/thunderbird -safe-mode
with the same outcome.
Thunderbird crashed at some point before this problem occurred: crash logs attached if they are any use. It may be that something has been corrupted in the crash?


Actual results:

Dialog appears about checking add-ons for compatibility: this finishes and closes, then memory usage by the thunderbird process starts to increase. Initially it jumps rapidly to around 5Gb resident, then increases more gradually until it gets all the available RAM (on an 8Gb machine) and then starts using swap space. That really kills the machine and eventually I have to kill the process before it eats everything.


Expected results:

Thunderbird should have at least showed me the user interface - I don't even get that (apart from the compatibility dialog)
Crash report will probably not be useful as it will just indicate OOM.
Try starting with  -offline
If that still fails, please try a new profile. https://support.mozilla.org/en-US/kb/using-multiple-profiles

please post your results
Not at all sure what happened, but I tried a new profile and that was fine.
I saw something online about panacea.dat being an occasional pain, so I deleted that in the orginal profile and everything is sweet again. I guess panacea.dat got corrupted?
I still have a copy of the broken profile if it would help
Can you tell us the size of your panacea.dat from the problematic profile?
Flags: needinfo?(pete)
$ ls -la panacea.dat 
-rw-r--r-- 1 pete pete 110055248 Oct 15 13:37 panacea.dat
Flags: needinfo?(pete)
(In reply to Pete Ford from comment #5)
> $ ls -la panacea.dat 
> -rw-r--r-- 1 pete pete 110055248 Oct 15 13:37 panacea.dat

Thanks for that info. 110MB yikes!  this is #17 in https://wiki.mozilla.org/Thunderbird:Testing:Memory_Usage_Problems

Perhaps a result of bug 65086.

Do you often have problems shutting down Thunderbird, and have to kill it?
And, does Help | Troubleshooting show any crash reports?
Severity: normal → major
Component: Untriaged → Database
Depends on: 65086
Keywords: perf
Product: Thunderbird → MailNews Core
Summary: Runaway memory usage when starting → Runaway memory usage when starting because of large panacea.dat
No longer depends on: 65086
Depends on: 929281
No longer depends on: 929281
OK: Let's look at the WikiPedia article you reference.
Taking the Diagnosis steps:
1.  Tried Safe Mode - no difference.
2.  Not using Windows (Ubuntu Linux 12.04)
3.  Tried re-installing: same problem when using the 'bad' profile.
4.  No antivirus on this machine, or at least nothing automatic: I sometimes run ClamAV...
5.  No local firewall on the machine, and the external firewall is pretty relaxed about outgoing stuff.
6.  No gmail accounts set up.
7.  Cannot access account settings to try this, but no Newsgroups were configured.
8.  Ditto - no RSS feeds were in use.
9.  No desktop indexing in use.
10. 
11. Cannot do any UI operations...
12. Ditto
13. Largest folder currently reports 250MB
14. Cannot do any UI operations...
15. There are non-Inbox IMAP folders configured to check for new messages (around 20 of them), but that hasn't been a problem previously (or since, using a cleaned-up profile)
16. Address book has around 425 contacts
17. Yes, but you know that :) Bug 65086 might be similar - I had an unclean Thunderbird shutdown which might have broken panacea.dat
18. No error message seen.
19. CPU is not high, only memory usage.
20. Profile is on a local hard drive.

I have had very few problems with TB shutting down or crashing - I'm not sure there's anything systematic going on, but I will pay more attention from now on.
It seems to me panacea.dat should be written and compressed at TB close.

How many folders do you have?
(In reply to :aceman from comment #8)
> It seems to me panacea.dat should be written and compressed at TB close.
> 
> How many folders do you have?

I have four main IMAP accounts configured, with a total of around 100 folders.
See Also: → 791581
Pete, this will cause some havoc if you hasn't done it already, but if you delete panacea.dat does probblem go way for at least a long time?

(In reply to :aceman from comment #8)
> It seems to me panacea.dat should be written and compressed at TB close.

aceman, perhaps we could use better checks of  panacea.dat at startup?
Flags: needinfo?(pete)
Flags: needinfo?(acelists)
Summary: Runaway memory usage when starting because of large panacea.dat → Runaway memory usage when starting because of large panacea.dat (eg. 110MB)
(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #10)
> Pete, this will cause some havoc if you hasn't done it already, but if you
> delete panacea.dat does probblem go way for at least a long time?

I should have said, rename it.

Pete, What are your results??
Whiteboard: [closeme 2015-05-15 dupeme]
Resolved per whiteboard
Status: UNCONFIRMED → RESOLVED
Closed: 4 years ago
Flags: needinfo?(pete)
Flags: needinfo?(acelists)
Resolution: --- → INCOMPLETE
Whiteboard: [closeme 2015-05-15 dupeme]
You need to log in before you can comment on or make changes to this bug.