Closed Bug 260447 Opened 20 years ago Closed 20 years ago

Getting new mail results in a "Folder is Being Processed" Error

Categories

(Thunderbird :: General, defect)

Product:
Thunderbird
Component:
General
Platform:
x86
Windows XP
Type:
defect
Priority:
Not set
Severity:
critical

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: kenneth, Assigned: Bienvenu)

References

Details

(Keywords: fixed-aviary1.0)

Attachments

(1 file)

proposed fix
8.49 KB, patch
mscott
: superreview+
Details | Diff | Splinter Review 
User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20040913 Firefox/0.10
Build Identifier: Version 0.8 (20040913)

I cannot get new mail with a POP mail account.  Each time I try I get a "This
folder is being processed.  Please wait until processing is complete to get
messages." message.

At first I thought it was caused by the new "Global Inbox" functionality, but I
just realized that even after deleting my profile and creating a new one (in
each-account-has-its-own-set-of-folders style), Thunderbird only downloaded
about 50 of the 154 messages I had on my server, then stopped sending and
receiving.  Trying to hit the Send/Receive button again results in the message
popping up.


Reproducible: Always
Steps to Reproduce:
I have the same problem. Here follows a session trace that ends up in a 'Folder
is Being Processed' error. The only way I found to unfreeze Mozilla mail is by
deleting the offending message by a WebMail interface.

+OK POP3 server ready

AUTH

-ERR Unknown command

CAPA

-ERR Unknown command

USER yyy

+OK luc is welcome.

PASS xxx

+OK mailbox locked

STAT

+OK 2 16211

LIST

+OK 2 messages 16211 (octets)

1 597
2 15614
.

UIDL

+OK

1 10193606200384
2 10325806200398
.

RETR 1

+OK 597 octets.

Received: from [67.100.156.254] by wilbur.contactoffice.com (NTMail
5.06.0016/NY4689.00.6bac6091) with ESMTP id seowiaaa for luc@contactoffice.com;
Tue, 21 Sep 2004 12:19:36 +0200
Received: from 35.20 200.204.215.90 (HELO RPYMBR) by 67.100.156.254
(8.12.11/8.12.11) with SMTP; Tue, 21 Sep 2004 06:21:59 -0500
Message-ID: <siDe1PgOkkCIvSGT.kMlmw@KLAXVJ>
Content-Type: text/html; charset="us-ascii";
From: zokkuplnvhvhjtf@microchipsonline.com
To: luc@contactoffice.com,patrick@contactoffice.com
X-Fix: NTMail fixed non RFC822 compliant EMail message
Date: Tue, 21 Sep 2004 12:19:36 +0200
.


I can confirm that this problem is present in Thunderbird 0.8.  I believe,
however, that it does have something to do with the new Global Inbox
functionality.  There are plenty of others who have described the problem in
detail in the following threads:

http://forums.mozillazine.org/viewtopic.php?t=127114
http://forums.mozillazine.org/viewtopic.php?t=127442

It seems to me that once one account has taken control of the Global Inbox, it
blocks other accounts (that may be downloading at the same time) from accessing
the same Inbox.

One solution might be to download all mail accounts in serial as opposed to all
at once?  Isn't this how Outlook Express handles it?  It's been a while since I
used OE, so I can't remember.

Anyway, this problem is a bit annoying and makes the Global Inbox feature -
something that has the potential to be very useful - not so useful.
we do serialize the get new mails...I don't know why this error is happening.
Assignee: mscott → bienvenu
Status: UNCONFIRMED → NEW
Ever confirmed: true
(In reply to comment #3)
> we do serialize the get new mails...I don't know why this error is happening.

Hmm, interesting.  I had assumed that the problem was due to a locking issue of
some sort as well, because I only seem to get the message when more than 1 of my
accounts have new mail.  I am using the global inbox, so I figured that there
was a synchronization issue with doing multiple mail downloads at once.  I'll
pay extra attention to when it happens next time to try to narrow it down.

This bug occurs for me as well.  Some notes:

It occurs at startup if multiple accounts have mail.

It occurs if I press ^s-T (control-shift-T).  This is the means I normally
retrieve email (from past use of TBird, Mozilla).

It does NOT occur if I press ^T (control-T).  This does serialize and queries
all accounts for the current folder.
It's definitely a global inbox problem. Using my Easy Get Mail Button extension
to  get all mail also produces the error, but only when using the global inbox,
which is effectively useless while this bug persists.

Also, judging by
https://bugzilla.mozilla.org/show_bug.cgi?id=260664
it's not restricted to Windows (the poster is using Linux).

I'm using version 0.8 (20040908) on Windows 2000 Professional. All my accounts
are POP3.
Flags: blocking-aviary1.0?
ah, sorry, my mistake, we serialize the get new mail across accounts at startup,
but not get all new messages across all accounts via the button/menu command.
I'll fix that.

I can't promise that your extension is going to work, depending on what it does...
Status: NEW → ASSIGNED
(In reply to comment #7)
> ah, sorry, my mistake, we serialize the get new mail across accounts at startup,
> but not get all new messages across all accounts via the button/menu command.
> I'll fix that.
> 
> I can't promise that your extension is going to work, depending on what it does...

David, it's at startup that I get the error message.  I do have both deferred
accounts set to check for new mail at startup.

Just looked at lxr and EGMB uses exactly the same method as the Get All New
Messages dropdown. Looks like I was ahead of my time!
Tommy, I'm not sure what you're seeing. I just tested .8 with the following setup:

2 pop3 accounts, both deferring to the local inbox, both set to download new
mail at startup. I sent both of them the same two large messages, and started up
tbird. The two accounts were checked in order, serially. That sounds like your
setup as well.

I'm going to fix the get new mail code to act like the download on startup code,
which will probably involve rewriting the js function GetNewMessages...
(In reply to comment #10)
> Tommy, I'm not sure what you're seeing. I just tested .8 with the following setup:
> 
> 2 pop3 accounts, both deferring to the local inbox, both set to download new
> mail at startup. I sent both of them the same two large messages, and started up
> tbird. The two accounts were checked in order, serially. That sounds like your
> setup as well.
> 
> I'm going to fix the get new mail code to act like the download on startup code,
> which will probably involve rewriting the js function GetNewMessages...

Hmm. . . that is my setup exactly, nevertheless I do get the message pretty
regularly.  I'll monitor the behavior closely and try to get you some more info.
Tommy, is one of the two pop3 accounts configured as your default account? In
theory, the local folders account should probably be the default account in your
scenario, but that doesn't look like it is enforced...in any case, the logic for
serializing pop3 servers at startup ignores the default server/account because
that's handled separately.
(In reply to comment #12)
> Tommy, is one of the two pop3 accounts configured as your default account? In
> theory, the local folders account should probably be the default account in your
> scenario, but that doesn't look like it is enforced...in any case, the logic for
> serializing pop3 servers at startup ignores the default server/account because
> that's handled separately.

I bet that's it.  I'm not at home right now but if I'm not mistaken my "home"
account is the default - NOT local folders.  I didn't see a reason to change the
default account when I setup the global inbox, but you may have just given me
one.  Actually, I don't think it ever occured to me that the local folders
"account" could even be the default.  At any rate, I'll give it a shot but it
sounds like TB should either:

1) Not be dependent on having any particular account as the default, or 
2) Enforce that the "correct" account actually be the default.  

Kudos to you for digging into this so quickly. 


I was able to recreate the problem you see by setting one of my deferred
accounts as the default...
How I fix this depends on how we treat the default account w.r.t. prompting for
a password at startup, even if it's deferred. If we'll prompt for the password,
then I need to make the default account play better with the other accounts
somehow, while still prompting for the password.
David, could you briefly explain the implications of making an account the
default?  I personally only use it as a means to make sure that when I click
"New Message", the resulting message comes from my default account. Why the need
for special handling of it in the code?
Attached patch proposed fix — — Splinter Review 
make get all new messages do the same kind of coalescing of pop3 servers and
inboxes that get new mail on startup does, and add the default server to the
coalescing that happens on startup, if it's deferred or deferred to.
Attachment #160256 - Flags: superreview?(mscott)
Comment on attachment 160256 [details] [diff] [review]
proposed fix

David, can you check it into both branches?
Attachment #160256 - Flags: superreview?(mscott) → superreview+
fixed on aviary branch
Keywords: fixed-aviary1.0
Tommy, to answer your question, yes, there are other reasons to set the default
account, as you say. The checked in patch should handle that case now.
Status: ASSIGNED → RESOLVED
Closed: 20 years ago
Resolution: --- → FIXED
Flags: blocking-aviary1.0?
It's fixed so it probably doesn't matter, but I got the problem today on TB 0.8.
 It occurred because I had two messages with 4 MB attachments each.  As soon as
the 2 messages were downloaded, everything started working fine.

BTW, I gathered from another post that after hitting the "Get New Messages"
button, the status bar apparently displays the message for the default account.
 I don't believe that this is the correct behaviour.  The status bar should
display the status of the currently selected account.  So if I switch between
accounts, I should see what's happening with that account.
I still get this bug.
 
David, I think your fix may have caused bug 276610, could you have a look
sometime please?
(In reply to comment #22)
> David, I think your fix may have caused bug 276610, could you have a look
> sometime please?

David, bug 276610 is now resolved as a WFM, so no need for you to look at it.
I found that the inbox file (located at C:\Documents and
Settings\***\Application
Data\Thunderbird\Profiles\llxfazet.default\Mail\pop.*****.com\) continues to
grow in size even if I've deleted all of the emails in the inbox.  I created a
text file named inbox, removed the extension and replaced the inbox file.  This
solved the problem of it taking up to 15 minutes for my inbox to be "processed"
and the pop up window appearing. Should this file decrease in size as I delete
emails from my inbox? It was 1.5 Gigs when I replaced it.

(In reply to comment #0)
> User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3)
Gecko/20040913 Firefox/0.10
> Build Identifier: Version 0.8 (20040913)
> 
> I cannot get new mail with a POP mail account.  Each time I try I get a "This
> folder is being processed.  Please wait until processing is complete to get
> messages." message.
> 
> At first I thought it was caused by the new "Global Inbox" functionality, but I
> just realized that even after deleting my profile and creating a new one (in
> each-account-has-its-own-set-of-folders style), Thunderbird only downloaded
> about 50 of the 154 messages I had on my server, then stopped sending and
> receiving.  Trying to hit the Send/Receive button again results in the message
> popping up.
> 
> 
> Reproducible: Always
> Steps to Reproduce:


Hi there,
sorry - but I have a doubt... if this bug is "resolved-fixed" then how come I still get it?

Thunderbird: 1.5.0.4 (20060516)

Is there something I have to do to "inlcude" the bug-fix??

Bst rgds
Vitus
vitus@vitus.org
Ok, someone has set this as resolved [comment #- but if you (someone?) could please look at this I think you will find that it is _not solved_!

Setup and Error Specs:
====================================
* TB version 1.5.0.5 (20060719)
* Using global inbox
* No antivirus installed
* No rules/filters are running
* 13 eMail accounts (POP3)
* Not compacting folders when the error occurs
* Problem occurs regardless of what key or click combination 
  I use to initiate check-mail
* Problem occurs when no mail is present - i.e. account A is NOT 
  downloading msg nor is B - but error still occurs, while 
  checking - and MIXING the sequence - of the 2 accounts [ps. refer 
  to below screenshots and comment].

In short - I think I've covered most of the issues in this comment track and also in this mozillaZine article (http://kb.mozillazine.org/Thunderbird_:_Issues_:_Folder_Being_Processed).


Anyway - maybe this can help...
-----------------------------------------------
I have Tb Progress History Extension 0.1.6 [Homepage: http://www.supportware.net/mozilla/#ext20] installed.
Now, _ASSUMING_ that this extension shows what _REALLY_ takes place [sequence-wise when checking eMail] then according to the two linked screenshots ( www.vitus.org/tb_folder_err/folder_being_processed_serialization_1.jpg and
www.vitus.org/tb_folder_err/folder_being_processed_serialization_2.jpg ) of the extensions output window - which I have anonymized - but still preserved in such a way that the "trail" can still be followed the issue of serialization has NOT been resolved.
NB! I made two screenshots - because "1" shows that an account is downloading eMail - but "2" shows (to fend of that comment already) that even w/no download on any accounts the error still occurs.


Further, the [Rob Hannah's Comment #5: Ctrl-T - "This does serialize..."]
Does not appear to serialize for me... I.e. the error occurs whether or not I use CTRL-T, CTRL-SHIFT_T, Click on icon, etc.


Now - what do I have to do to re-open this problem?! Do you think that I should open a new case? That sounds "wrong" since the old case obviously is not solved...

Anyone??!?!?

Bst rgds
Vitus
Vitus in comment #26
>Do you think that I should open a new case? 

Vitus
May be simpler, easier in a separate new (or existing) bug. Also, given your apparent expertise and detail you seem to be able to provide, it might help if you could test on it trunk


>I have Tb Progress History Extension 0.1.6 [Homepage:
>http://www.supportware.net/mozilla/#ext20] installed.

Does this work for you on trunk?  (Note: I'm not sure http://www.supportware.net/mozilla/#ext20 does not point to version 0.1.6 of this extension)

(In reply to comment #27)
> Vitus in comment #26
> >Do you think that I should open a new case? 
> 
> Vitus
> May be simpler, easier in a separate new (or existing) bug. Also, given your
> apparent expertise and detail you seem to be able to provide, it might help if
> you could test on it trunk
> 
> 
> >I have Tb Progress History Extension 0.1.6 [Homepage:
> >http://www.supportware.net/mozilla/#ext20] installed.
> 
> Does this work for you on trunk?  (Note: I'm not sure
> http://www.supportware.net/mozilla/#ext20 does not point to version 0.1.6 of
> this extension)
> 

(In reply to comment #27)
> Vitus in comment #26
> >Do you think that I should open a new case? 
> 
> Vitus
> May be simpler, easier in a separate new (or existing) bug. Also, given your
> apparent expertise and detail you seem to be able to provide, it might help if
> you could test on it trunk
> 
> 
> >I have Tb Progress History Extension 0.1.6 [Homepage:
> >http://www.supportware.net/mozilla/#ext20] installed.
> 
> Does this work for you on trunk?  (Note: I'm not sure
> http://www.supportware.net/mozilla/#ext20 does not point to version 0.1.6 of
> this extension)
> 

Trunk...
What is "trunk"?? [I am sorry - I know what "trunk" (the word) means) but in this context the meaning escapes me ;-)]


File new bug...
I did not (yet) file a new bug, with v.2.0 just around the corner, I don't think anyone is going to pay attention to new bugs for pre-2.0. So, when we have v.2.0 and if the problem persists, I will file a new bug for that.


Extension Link... [below is copy/paste (second item) from the page the link links to]
==================== *** =====================
Thunderbird Status Msg History 0.0.8

An extension that records all status messages from all TB windows in a list

The extension also displays status information on downloads and uploads in a 'xx of yy Kb' format

This extension is currently only available for TB versions newer than 1.0+ due to it propensity to CRASH TB versions older than than.. Sorry 
==================== *** =====================

ok so far? ;-=)
bst rgds
Vitus
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: