368685 - Large IMAP (shift+)Delete causes Memory Exhaustion

Status: RESOLVED WORKSFORME

(Thunderbird :: Mail Window Front End, defect)

Description

[Daniel Watts]

User-Agent:       Opera/9.02 (Windows NT 5.1; U; en)
Build Identifier: version 1.5.0.9 (20061207)


Summary: Thunderbird process becomes unresponsive after selecting a large quantity (1000+) messages and hitting shift+delete. A check of the Task Manager shows memory usage heading towards 1000MB of RAM and growing. 

Suggest looking at last post of bug: 
https://bugzilla.mozilla.org/show_bug.cgi?id=47645

Would be good to implement some magic and then small batching of delete requests (may be 100 at a time). 

I'm sure the problem here is client side as there is very little IMAP traffic. Looks like the problem is all about updating client side caches. 


Reproducible: Always

Steps to Reproduce:
Reproduce:
Find a folder with 1000+ messages. 
Select All
Shift+Delete

Actual Results:  

Visually, nothing happens - the program (and all of windows) becomes unresponsive. Memory continues to rise until program killed.

Expected Results:  
Ideally, the messages should instantly disappear (however fast the background imap delete takes). 

Used against a Dovecot server using Maildir. Quite a powerful server that was reporting loads of <1.00 during the time that thunderbird was frozen.

Comment 1

[Wayne Mery (:wsmwk)]

ref bug 218075, bug 296453

I recall seeing commentary from david somewhere on this, but maybe that was about copy/move, or marking junk?

Comment 2

[Gary Kwong [:gkw] [:nth10sd] (NOT official MoCo now)]

Daniel, could you please check the issue still occurs in the latest supported Thunderbird 2.0.0.x or trunk nightlies?

Comment 3

[Daniel Watts]

Using 2.0.0.12 

Well I don't have a folder with 1000+messages at the moment but just tried with 400+ messages and after about 20 seconds they all disappeared. Memory rose from 200k - 245k (and stayed there after the delete) but I'm not seeing my >1GB memory usage as I did before.

Possibly exponential rise in memory though so someone still needs to try with 1000+ messages. 

Comment 4

[Wayne Mery (:wsmwk)]

Daniel, thanks for checking. Are your figure MB or K?  

Anyway, Your results consistent with mine, so closing WFM...

tested version 3.0a1pre (2008041203)
- core duo laptop, wireless G, connected to cable modem (my slowest connection)
- imap account settings -  delete="move to trash", use idle, cache connections=5
- folder sort=threaded
- folder "lotsamsgs" is 23,478 messages, 91MB
                               WS     WS
                   cpu  WS     peak   private
after startup      :03  30140k 31276k 15612k
mouseover lotsamsgs     47MB
remove mouseover        36MB
after clicking fld :10  52460  52640  35960
select all         :13  52436  52764  35932
shift+del          :33  58584  67896  43048 ~20sec wall clock 

net change from delete - 6MB
 
HOWEVER, note this odd aspect of the results:
- after shift+del is done, folder stats show 7 remain but thread pane is empty
- leave folder and return to lotsamsgs, the subjects of the remaining msgs appear
- nothing unusual about these msgs that didn't get deleted, afaict