Closed Bug 1638572 Opened 11 months ago Closed 4 months ago

Huge memory usage with 86mb panacea.dat after a few weeks or months of not being restarted. related to gmail account?

Categories

(MailNews Core :: Database, defect)

Unspecified
Linux
defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: antropik, Unassigned)

References

(Depends on 1 open bug)

Details

Attachments

(1 file)

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0

Steps to reproduce:

I use thunderbird (+ enigmail & lighning) on ubuntu (first 18 LTS, now 20 LTS)
It's nearly never restarted.
There's two usable profile on it (archive and current).

Of one of the profile (current) :
After a few weeks, sometimes months, memory consumption reach a crazy amount (more than 16 Gb)

Safe mode doesn't change anything, the other profile does not have this problem

Actual results:

After reaching too much memory (mostly all of the RAM), thunderbird begins to malfunction : crash, freeze, some of the time refusing to start at all.

This issue can be solved by deleting panacea.dat (around 86Mo currently), but comes back again a few time later (weeks, months ...).

This might link this to following bug 1084276

Expected results:

Normal usage ;)

Nom Thunderbird
Version 68.7.0
Identifiant de compilation 20200407160932
Agent utilisateur Mozilla/5.0 (X11; Linux x86_64; rv:68.0)
Gecko/20100101 Thunderbird/68.7.0
Système d’exploitation Linux 5.4.0-29-generic
Fenêtres multiprocessus 0/0 Désactivé
Processus distants 0 <#remote-processes>
Stratégies d’entreprise Inactives
Clé du service de localisation de Google Manquante
Clé de Google Safebrowsing Manquante
Clé du service de localisation de Mozilla Manquante
Mode sans échec false

Please enter the address
about:memory?verbose
in the address bar and attach (using the "Attach File" link above) the output here.

Flags: needinfo?(antropik)

will do as soon as it start again
thank you for the answer

non anonymize version is available if needed,

i'm available if more test are needed

regards,

Flags: needinfo?(antropik)

(In reply to Silex from comment #0)

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0

Steps to reproduce:

I use thunderbird (+ enigmail & lighning) on ubuntu (first 18 LTS, now 20 LTS)
It's nearly never restarted.
There's two usable profile on it (archive and current).

Of one of the profile (current) :
After a few weeks, sometimes months, memory consumption reach a crazy amount (more than 16 Gb)

Safe mode doesn't change anything, the other profile does not have this problem

Actual results:

After reaching too much memory (mostly all of the RAM), thunderbird begins to malfunction : crash, freeze, some of the time refusing to start at all.

This issue can be solved by deleting panacea.dat (around 86Mo currently), but comes back again a few time later (weeks, months ...).

This might link this to following bug 1084276

perhaps - 86mb is big

how many folders do you have?
can you email me non-anonymized memory report?

Flags: needinfo?(antropik)
OS: Unspecified → Linux
See Also: → 1219334
Summary: Huge memory leaks - Ubuntu → Huge memory leaks with 86mb panacea.dat - Ubuntu (linux)

File has been send

I'm not sure to know how to count folders (but there's clearly a lot of them),
if you have a method for that, i can check :)

regards,

Flags: needinfo?(antropik)

(In reply to Silex from comment #6)

File has been send

Unfortunately I'm not seeing must of interest there - just a big 13gb chunk of help unclassified

I'm not sure to know how to count folders (but there's clearly a lot of them),

Help > Troubleshooting > profile folder > open folder > do ls -R *.msf | wc

Thank you

in the default profile : 1277
in the mail account (they are not in the default profile) : 983

is there a way to force/clean the rebuild of panacea, or should i periodically delete it (since the problem seems to come from here) ?

panacea is rebuilt after you delete it. But if panacea was involved I would expect memory to be high soon after your startup. What is memory usage within the first hour of startup?

I have 3,300 folders, but panacea is only 6mb

Ok, thank you. Panacea is involved, since the deletion put a temporary fix, but it might not be all.

About the behaviour of memory, it changes a lot :
sometimes, after the deletion of panacea, it might goes back to crazy amount after a few hours,
but most of the time, it might take weeks, or month before going through the roof.
Without deletion, if that was already a huge amount, it goes back where it stopped on loading.

ATM, Panacea is around 34Mo and memory usage of thunderbird is around ~550Mo (which seems normal).

ps :
before opening the bug, I tried to disable archive folder from gmail account to avoid leaks too.

I agree this correlates somewhat to bug 65086. Note bug 65086 comment 34. AFIAK There are no workarounds other than to delete panacea.dat. And there are no prospects of the bug getting fixed - the solution will be bug 418551, which is a long term prospect.

Also, given that it takes weeks or months for you to reach this state, I don't see your problem being resolved any time soon.

However, there may be other factors at play especially given that your panacea.dat is not crazily large - like real memory leaks or folder files not being closed. That would require significant time to analyze. I suggest you plan on restarting Thunderbird every couple weeks for the foreseeable future.

Severity: -- → S3
Depends on: 418551
See Also: → 65086
Summary: Huge memory leaks with 86mb panacea.dat - Ubuntu (linux) → Huge memory usage with 86mb panacea.dat after a few weeks or months of not being restarted. Ubuntu (linux)

ok,
thank you for your time and for the advice :)

(In reply to Silex from comment #12)

ok,
thank you for your time and for the advice :)

Any improvement on this? What TB around you running now?

I deleted one gmail account from thunderbird... there's no more leakage.

yet, i did disable the "archive" folder during the test with the memory leak, so it should come from that, at last...
i'm still available if anyone want to dig deeper in it ;)

(In reply to Silex from comment #14)

I deleted one gmail account from thunderbird... there's no more leakage.

gmail correlation is interesting. Thanks for that information.

We have bug 418551 for the panacea bug, but I don't know why gmail would be related, so let's call this one incomplete

Status: UNCONFIRMED → RESOLVED
Closed: 4 months ago
Resolution: --- → INCOMPLETE
Summary: Huge memory usage with 86mb panacea.dat after a few weeks or months of not being restarted. Ubuntu (linux) → Huge memory usage with 86mb panacea.dat after a few weeks or months of not being restarted. related to gmail account?
You need to log in before you can comment on or make changes to this bug.