513055 - Email viewing/Handling is extremely slow. Access to attachments is extremely slow.

Status: RESOLVED DUPLICATE of bug 539389

(Thunderbird :: General, defect)

Description

[cwitt]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729)
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Thunderbird/3.0b3

Viewing emails frequently hangs up Thrunderbird (email sizes this has occurred on vary between 12k and 7mb).

Opening/Saving attachments hangs up Thrunderbird and takes up to 3 minutes each (just to bring up the first dialog (open/save).  Attachment size has no effect.

Reproducible: Always




This "slowness" has never been encountered in prior releases (v2.0.0.23 and before).

Comment 1

[Ludovic Hirlimann [:Usul]]

Are you using imap or pop ?

Comment 2

[cwitt]

(In reply to comment #1)
> Are you using imap or pop ?

pop

Comment 3

[cwitt]

one additional detail..  we keep our "profiles" on a network drive (for easier backups).  The program runs locally.

Comment 4

[Wayne Mery (:wsmwk)]

try copying a couple messages to local account. is display problem the same?

offhand, such big changes aren't typically caused by thunderbird,

Comment 5

[cwitt]

I get the same delays/hangups when the profile is local.

If Thunderbird is not the cause, then why is version 2.0.0.23 (and earlier) able to use the same profile without the delays (local and on network)?

Comment 6

[WADA:World Anti-bad-Duping Agency]

(Q1) Is your problem reproduced with -safe-mode of Tb and newly created profile?
(because POP3 and issue while downloaded mail viewing, dummy POP3 account definition followed by mail folder file copy is sufficient for checking with new profile)

(Q2) Does path of non-existent server or drive is written in prefs.js?
> browser.download.dir
> browser.download.downloadDir
> messenger.save.dir

(Q3) How long does next take in your environment?
At command prompt. (server, directory of ABC, XYZ etc. doesn't exist.)
  NET VIEW
  NET VIEW \\ABC
  NET USE  \\XYZ\ABC

Comment 7

[Ludovic Hirlimann [:Usul]]

Can you also look into the eventvwr on windows and see if there is anything in there ?

Comment 8

[cwitt]

Sorry for the long wait..

Q1>
-safe-mode (existing profile) :: delays exist
-new profile :: delays are gone (local and network).   I moved a few existing mail folders over to test with.

Q2>
exists, local
exists, local
existence varies, network location (folders get renamed)

Q3>
Instant
~6 seconds
~9 seconds


Given the above, what is next?   If I have to re-make all my users' profiles I won't be upgrading (it's used office wide)..  Can we try to figure out what part of the existing profile is causing this?

Comment 9

[cwitt]

More info..

I just went and re-built my profile, then brought across all my mail folders.  The delays/hangups are back.   I think it has to do with the massive quantity of mail I have (using global mailbox settings for all accounts).

I will try another profile but set them as separate mailboxes to see if that helps.. (though I don't think it will as 95% of the email is for one account)

My email totals 9.2gigs (we have some users that exceed 20gigs).

Comment 10

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #8)
> Q2>
>(snip)
> existence varies, network location (folders get renamed)

This is probably main cause of "display of save dialog takes long". This entry isn't created upon new profile creation, so trying to access to non existent location doesn't happen.
However, "3 minutes" sounds too long because "NET ..." command takes only 5 to 10 seconds in your environment.

(A. For "save attachment")

Can you check next?
(1) Via Config Editor(in Tools/Options/Advanced/General)
> messenger.save.dir = existent, local, non root directory (C:\ABC\DEF...)
(2) Restart Tb, Save an attachment
How long does "save dialog open" take?

(3) Via Config Editor(in Tools/Options/Advanced/General)
> messenger.save.dir = non existent, network locaton (\\ABC\XYZ\..., X:\PQR\... etc.)
> (same situation to current)
(4) Restart Tb, Save an attachment
How long does "save dialog open" take?
Which directory is chosen at displayed save dialog?

(5) Via Config Editor(in Tools/Options/Advanced/General)
> messenger.save.dir = non existent, network locaton (\\ABC\XYZ\..., X:\PQR\... etc.)
> (same situation to current)
(6) Restart Tb with -safe-mode, Save an attachment
How long does "save dialog open" take?
Which directory is chosen at displayed save dialog?

(B. For "open attachment")

How many garbage files do you keep in your Temp directory?
At command propmt.
  DIR %TEMP% /S
Next may help your checking.
  DIR %TEMP% /S > C:\DIRLIST.TXT
  notepad.exe C:\DIRLIST.TXT

Comment 11

[cwitt]

This is all with the re-built profile.

A)
 2) (desktop)
    Dialog opens in ~1 second (save takes about 50 seconds, 500k file)

 4) \\ABC\XYZ
    Dialog opens in ~11 seconds, and redirects to desktop
 4) x:\ABC
    Dialog opens in ~1 seconds, and redirects to desktop

 6) \\ABC\XYZ
    Dialog opens in ~11 seconds, and redirects to desktop
 6) x:\ABC
    Dialog opens in ~1 seconds, and redirects to desktop
 6) (step 2, but in safe-mode)
    Dialog opens in ~1 second (save takes about 50 seconds, 500k file)

B)
  There were ~1gig of times files (~1,200 files).   I have since cleaned them up (~50 currently), with no noticeable speed difference.

Comment 12

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #11)
> This is all with the re-built profile.

Request to compare (3)/(4) and (5)/(6) is to know whether add-on(extension) is relevant to very long "3 minutes" or not. (some add-ons can produce problems, if Tb only is upgraded to Tb 3 beta.)
Do you still have profile you used when you wrote comment #0?
If yes, compare (3)/(4) and (5)/(6) using the profile. Can you reproduce very long "3 minutes" by (3)/(4)?

Comment 13

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #8)
> Q2>
> existence varies, network location (folders get renamed)

"folders get renamed" includes next?
  1. You save to \\ABC\PQR\XYZ.ext => messenger.save.dir=\\ABC\PQR
  2. Shared directory of ...\...\PQR is renamed at file share server.
     Software who controls file sharing doen't know rename of PQR.
  3. You try to save with messenger.save.dir=\\ABC\PQR.

Comment 14

[cwitt]

After further testing (and random discoveries) the delays increase as the size of the mail folder does.  IE: if you only have a few emails, there is no delay.  But of there are 20-30 emails (varying size from 10k to 6mb) the delays are very long.

Just thought I'd let you all know.

Comment 15

[Wayne Mery (:wsmwk)]

do you see this with antivirus software turned off?

Comment 16

[cwitt]

It's been determined (after the final v3 release) that it's caused by having the profile on a network drive.   I don't know what changed that caused this problem or why no one was able to fix it, but that is the way it is.

I've had to move all our email to local drives and come up with a ass-backwards way to create backups.

Comment 17

[Wayne Mery (:wsmwk)]

xref 
Bug 368111 -  compreg.dat and xpi.dat files slow to write on network drives
Bug 363479 Non-partial nightly updates incredibly slow on a networked dive

Comment 18

[Wayne Mery (:wsmwk)]

I forgot to mention
 Bug 232047 -  Frequent need to rebuild summary file(.msf) when mail folder is located on a different OS's sharing hard disk or network drive(timestamp inconsistency)

Comment 19

[Wayne Mery (:wsmwk)]

too bad we didn't fully "get" the network issue sooner, or we could have duped bug 539389 to you instead of the other way around :)