268954 - Building summary file gets into endless loop

Status: RESOLVED FIXED

(MailNews Core :: Database, defect)

Description

[Max Alekseyev]

Mozilla linux build 2004110906

MailNews now cannot finish building summary for some mail folders. The status
line show "Building summary file for <folder name>..." and the progress
indicator jumps like music spectrum analyzer. At the same time there is HDD
activity, so it really bulding something over and over again. And never stops.

Comment 1

[David :Bienvenu]

can you attach or e-mail me a folder that it does this for? Does removing the
.msf file beforehand fix the problem?

Comment 2

[Max Alekseyev]

Interestingly, this happens when MailNews offers to compact all folders to save
disk space. At the same time, manual request to compact the problematic folder
proceeds fine.

Comment 3

[Max Alekseyev]

Removing .msf file does not help.

So currently MailNews offers me to compact all forders to save disk space right
on its start up. If I accept this offer, it gets into an endless loops
rebuilding summary file for some folder. If I reject the offer, and then request
to Compact that folder manually it proceeds fine (actually, it's done
momentarily and I'm not sure if it really rebuilds .msf file).

Comment 4

[Max Alekseyev]

So the bug is reproduciable after removing .msf file and/or manual compacting of
that folder. Moreover, yesterday I observed similar problem with another folder,
so the (currently) problematic folder is not so much specific.

Comment 5

[David :Bienvenu]

if you do a file | compact folders, does the same problem happen? I can't
reproduce this myself. Are you sure it's not specific to a particular folder or
folders, or the contents thereof? Also, compact folder won't do anything if
there aren't any deleted messages in the folder.

Comment 6

[Max Alekseyev]

File -> Compact Folders does reproduce the bug.

I don't think the folder is *much* specific (though not every folder shows the
bug). I've just caught the bug under another profile on another folder.

Try this folder: ftp://[e-mail]/268954.zip

Comment 7

[Max Alekseyev]

btw, while the folder is beeing rebuilt, Mozilla sometimes crashes unexpectedly.
The crash is a kind of strange since no TalkBack agent appears. In the strace
output I see the following:

mailCharsetLoadListener: KOI8-R
[{WIFEXITED(s) && WEXITSTATUS(s) == 6}], 0) = 10142
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
--- SIGCHLD (Child exited) @ 0 (0) ---
waitpid(-1, 0xbffff4ac, WNOHANG)        = -1 ECHILD (No child processes)
sigreturn()                             = ? (mask now [])
rt_sigaction(SIGINT, {SIG_DFL}, {0x8079bd0, [], 0}, 8) = 0
rt_sigprocmask(SIG_BLOCK, NULL, [], 8)  = 0
read(255, "exitcode=$?\n\n## Stop addon scrip"..., 5215) = 91
rt_sigprocmask(SIG_BLOCK, NULL, [], 8)  = 0
rt_sigprocmask(SIG_BLOCK, NULL, [], 8)  = 0
...

Comment 8

[David :Bienvenu]

I can recreate this and am working on a fix...thx for reporting this.

Comment 9

[David :Bienvenu]

Attachment: proposed fix

the folder always has to be the listener for folder parsing, so that it can
mark the summary valid. So we have to use the reparse listener when the caller
wants to be a listener as well.

Comment 10

[Max Alekseyev]

Attachment: Status bar

David, the bug is indeed gone. But there is a minor consequence.
When compating folders is done, if i click on the folder that previously caused
the bug then the progress indicator bar in the status line appears in the
middle state (see attached screenshot). Switching to other folder does not
affect the progress indicator. The only way to reset the indicator is to
File->Compact Folders. But clicking to the problematic folder bring the
indicator into the middle state back.

Comment 11

[Max Alekseyev]

*** Bug 246615 has been marked as a duplicate of this bug. ***

Comment 12

[Max Alekseyev]

(In reply to comment #10)
> Created an attachment (id=165722)
> Status bar
> 
> David, the bug is indeed gone. But there is a minor consequence.

That seems to be bug 267695

Comment 13

[koohlar]

Hrello Max and others.  I am experiencing what I believe to be the same bug.  I am using TB 1.5.  I have recently imported mail from another TB account using the drag and drop mail files approach.  All mail imported ok except 1 file of about 300MB.  TB runs fine until I add this file and restart TB.  Then it just hangs on "building summary".  I am not a programmer and could be asking the wrong people for advise.  I apologise if this is the case.  If you are able to help I would greatly appreciate it.  Incidentally some of the other mail files that "imported" successfully were larger than this one - just in case size was a factor?

Regards

Koohlar

Comment 14

[David :Bienvenu]

Does the hang happen when you open the folder? You might try a 1.5.0 nightly branch build - ftp://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-mozilla1.8.0