542747 - TDB Eating up the disk when try to open a mail with many images

Status: RESOLVED DUPLICATE of bug 545126

(Thunderbird :: Message Reader UI, defect)

Description

[durumdara]

User-Agent:       Opera/9.80 (Windows NT 5.1; U; hu) Presto/2.2.15 Version/10.10
Build Identifier: 

Yesterday I was tried to write a mail.
I pasted many pictures.
I pasted them carefully 32 pictures with only 640/480 pixels, and some descriptions about them.

I clicked on "send later". I wondered, because it have 30 MB size.
Today I tried to open it. The message body opened, but the images never shown.
Them localsettings/temp is full with nsmail files (html, with cids, and images), and tdb slowly eating up my disk with them - this is an infinite loop!

Same effect I saw when I try to open saved eml file... :-(

In the past I see same thing, but I never try to reproduce it.

The eml file can be opened in Free Eml Viewer.


Reproducible: Didn't try

Comment 1

[Ludovic Hirlimann [:Usul]]

What version of thunderbird are you using ?

How long do you wait for the image to load ?

Comment 2

[durumdara]

(In reply to comment #1)
> What version of thunderbird are you using ?

Mozilla/5.0 (Windows; U; Windows NT 5.1; hu; rv:1.9.1.7) Gecko/20100111 Thunderbird/3.0.1

> 
> How long do you wait for the image to load ?

I wait for 15-20 minutes, but the machine not stopped the disk image creations (nsmailnnn) only when the disk was out.

These files are "html" files (TDB rendered the mail as html?).

Possible I saw that help you: they are all ended in 32 MB, and with "<"...
But I deleted them all for avoid the problems...

Comment 3

[durumdara]

(In reply to comment #1)
> What version of thunderbird are you using ?
> 
> How long do you wait for the image to load ?

Today I tested this thing again.

With 5 GB empty disk the 30 MB email showing is 45 minutes.
While creation the disk heavy used, and many nsmail temp created.

Interesting that the in prev. case I have only 1,5 GB empty disk and it was not enough for open this mail...
What is that makes slow this operation? The Free Email Viewer can open it in 5 seconds - but it is not show the pictures...

Thanks for your work. If I can help you, please notify me private.
I don't want to publish my test mail, but if you check only, I can send it to you directly!

dd

Comment 4

[Wayne Mery (:wsmwk)]

same as bug 545126?

Comment 5

[WADA:World Anti-bad-Duping Agency]

> pasted them carefully 32 pictures with only 640/480 pixels
> I clicked on "send later". I wondered, because it have 30 MB size.

What kind of image data? BMP?
If BMP of color image, size is roughly 3bytes*640*480=922KB (I assume 24bit per pixel). As 32 pictures, totla size=29.5MB. As sent in base64 encoded, total data size in mail = 29.5MB*(4/3) = 39.3MB.

> Them localsettings/temp is full with nsmail files (html, with cids, and images), 
> and tdb slowly eating up my disk with them

Sound many garbage files(undeleted temporary file) due to unexpected termination after write of temporary file(cancel of composition, crash of Tb while mail composition, forced close of Tb, ...).
AFAIK, temporary file is normaly deleted after successful draft save/send later/send. Do you frequently cancel mail composition after attach of big data? Do you frequently close or kill Tb while mail compose window is open?

> - this is an infinite loop!

As sufix is used(xxx, and xxx-1 to xxx-9999) for temporary file, and max suffix seems 9999, Tb may search usable suffix number forever if there is no room in suffix number.
But, AFAIR, Tb reused such garbages if Tb is terminated and restarted. Do you use Tb without restart of Tb for many hours or many days? Do you use add-on which is relevant to mail composition?

> Today I tried to open it. The message body opened, but the images never shown.

It may be Bug 545126 as Wayne says.
POP3 or "Local Folders"? Do you have very many mail folders? Profile directory on network drive?
Create mail folder named "A"(lowest in sort by alphabetic order) and copy the big mail. Still "never shown" with mail in folder "A"?

Any way, do next.
1. Terminate Tb, delete very many gargage files with suffix in temp directory which are created by Tb, and restart Tb.
2. Dont attach too huge attachement data to a mail.
3. If picture, use compressed format such as jpeg instead of BMP if possible.

Comment 6

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #3)
> While creation the disk heavy used, and many nsmail temp created.

Heavey disk usage is possibly bug 539389. As write is requested for each mail data line(roughly 80 to 160 bytes) for mail data of 39.3MB due to bug, both write to temp directory and write to Outbox takes long and bad disk write performance is perhaps exposed.

Comment 7

[durumdara]

Hi!

(In reply to comment #5)
> > pasted them carefully 32 pictures with only 640/480 pixels
> > I clicked on "send later". I wondered, because it have 30 MB size.
> 
> What kind of image data? BMP?
> If BMP of color image, size is roughly 3bytes*640*480=922KB (I assume 24bit per
> pixel). As 32 pictures, totla size=29.5MB. As sent in base64 encoded, total
> data size in mail = 29.5MB*(4/3) = 39.3MB.

These pictures was JPEG files.

> 
> > Them localsettings/temp is full with nsmail files (html, with cids, and images), 
> > and tdb slowly eating up my disk with them
> 
> Sound many garbage files(undeleted temporary file) due to unexpected
> termination after write of temporary file(cancel of composition, crash of Tb
> while mail composition, forced close of Tb, ...).

That was.

> AFAIK, temporary file is normaly deleted after successful draft save/send
> later/send. Do you frequently cancel mail composition after attach of big data?
> Do you frequently close or kill Tb while mail compose window is open?

No, never.

> 
> > - this is an infinite loop!
> 
> As sufix is used(xxx, and xxx-1 to xxx-9999) for temporary file, and max suffix
> seems 9999, Tb may search usable suffix number forever if there is no room in
> suffix number.

Many suffix number was accessable in that time. Max. 100 files used as nsmail.

> But, AFAIR, Tb reused such garbages if Tb is terminated and restarted. Do you
> use Tb without restart of Tb for many hours or many days? Do you use add-on
> which is relevant to mail composition?
> 
> > Today I tried to open it. The message body opened, but the images never shown.
> 
> It may be Bug 545126 as Wayne says.
> POP3 or "Local Folders"?

IMAP.

> Do you have very many mail folders? 
Yes. More than 1000, but they are tree structured.

>Profile directory
> on network drive?

Local.

> Create mail folder named "A"(lowest in sort by alphabetic order) and copy the
> big mail. Still "never shown" with mail in folder "A"?

Sorry, but this machine reinstalled, and replaced with Win7/x64. So I cannot repeat the test.

> 
> Any way, do next.
> 1. Terminate Tb, delete very many gargage files with suffix in temp directory
> which are created by Tb, and restart Tb.
> 2. Dont attach too huge attachement data to a mail.
> 3. If picture, use compressed format such as jpeg instead of BMP if possible.

Thanks:
   dd

Comment 8

[Wayne Mery (:wsmwk)]

wada, incomplete?  or assume duplicate?

Comment 9

[Wayne Mery (:wsmwk)]

assuming duplicate of bug 545126 based on correlation of symptoms