Closed Bug 275132 Opened 17 years ago Closed 16 years ago

Can't filter/move messages to Inbox that is busy, results in loss of moved messages when Global Inbox(mail is not moved to it) under TB Ver. 1.0 (20041206)

Categories

(MailNews Core :: Filters, defect)

x86
Windows 98
defect
Not set
critical

Tracking

(Not tracked)

RESOLVED EXPIRED

People

(Reporter: thunderbird_tester, Assigned: sspitzer)

References

Details

User-Agent:       Mozilla/5.0 (Windows; U; Win98; de-DE; rv:1.7.5) Gecko/20041108 Firefox/1.0
Build Identifier: Mozilla/5.0 (Windows; U; Win98; de-DE; rv:1.7.5) Gecko/20041108 Firefox/1.0 ; Mozilla Thunderbird Version 1.0 (20041206)

Hi,
hope it is ok to create a new Bug entry for these one.

The Basic problem is as in Bug Nr. 168648
(https://bugzilla.mozilla.org/show_bug.cgi?id=168648) but I think I found out
that these TB Bug/Behaviours results in loss of the been filter/move messages to
Inbox under TB Ver. 1.0 (20041206).


If You have lets say three POP3 accounts two not using the "Global Inbox" but
filtering/moving its received messages to 'Inbox on Local Folder' and the third
one using the "Global Inbox" and all of them setup to "Check for new messages at
startup" and you have prior of starting TB in each POP3 Mailbox 10 Messages of
~20 kB and you then start TB you will get a couple auf times the MsgBox "The
messages could not be filtered to folder 'Inbox' because another operation is in
progress". Ok so fare as I understand not new to Bug Nr. 168648, but now in TB
1.0 for each appearing MsgBox the corresponding messages/mail is been lost for
ever ! Because instead of finding 30 new mails in "Inbox" there are only around
12 or 14 Messages instated of the supposed to be 30 (3x10) and exactly that
amount less massages then MsgBox did appear during downloading.

Reproducible: Always

Steps to Reproduce:
1. Setup a new Profile 'Tester' and create tree new accounts ('pop3_T1@***',
'pop3_T2@***', 'pop3_T3@***') with 'pop3_T1@***' and 'pop3_T2@***' not using the
"Global Inbox" and 'pop3_T3@***' as using the "Global Inbox"  

2. Send and received one eMail to each of them, to store the Password for them.

3. Setup each account for "Check for new messages at startup", 'Check for new
messages every 10 minutes' and 'Automatically download new messages'

4. Create a filter rule 'Filter T1' for the 'pop3_T1@***' account with the rule
'Match all off the following' with 'To' 'ends with' 'pop3_T1@***' and as perform
action 'Move to folder:' 'Inbox on Local Folder'

5. Create a filter rule 'Filter T2' for the 'pop3_T2@***' account with the rule
'Match all off the following' with 'To' 'ends with' 'pop3_T2@***' and as perform
action 'Move to folder:' 'Inbox on Local Folder'

6. Closedown or end TB 

7. Create and than send 10 messages to the account 'pop3_T1@***' with 'Subject'
'Test eMail POP3 T1.xx', were xx is the number of the messages (01 to 10), and
of a messages size of ~20 kB using an attached image, do these using another TB
profile.

8. Do the same as in 7. for 'pop3_T1@***' and with 'Subject' 'Test eMail POP3
T2.xx'.

9. Do the same as in 7. for 'pop3_T2@***' and with 'Subject' 'Test eMail POP3
T3.xx'.

10. Start TB Ver. 1.0 (20041206) with profile 'Tester' and there by start
receiving and downloading the previously send 30 new messages (3x10).

11. Each time a MsgBox appears "The messages could not be filtered to folder
'Inbox' because another operation is in progress", press immediately 'OK' and
keep counting the times these warning did appear.

12. After TB tells you messages were downloaded check if all 30 messages were
properly received in 'Inbox on Local Folder'.
Actual Results:  
Now You will seen that there are NOT ! 30 new messages but maybe only 12 or 14
(as in my two trail runs via 1x64K-ISDN) and you will see that exactly 30 minus
number of times MsgBox did appear mails are there.

Big Question is now were are the missing ones ?

Because the three accounts ('pop3_T1@***', 'pop3_T2@***' and 'pop3_T3@***') at
the server are meanwhile empty, but in your TB folders there are also not to be
found.

I would think TB 1.0 simply moved then into digital Nirvana, with out user
approval !

You will see that all ten messages for 'pop3_T3@***' account are there but only
a few of 'Test eMail POP3 T1.xx' or/and 'Test eMail POP3 T2.xx' and there are
only the upper/last ones like 'T2.09' and 'T2.10' or so.

Expected Results:  
Finding all 30 new received and downloaded messages in 'Inbox on Local Folder'
or at leased finding 30 new messages in any of the three 'Inbox' Folders but not
only 12 or 14 new messages in 'Inbox on Local Folder' and none in the 'Inbox' of
'pop3_T1@***' and 'pop3_T2@***', with the other messages been loosed with out
any trace of them.

Hints :

I believe these behaviour of TB Ver. 1.0 is new and was not there in maybe lets
say 7.x or so.

There are other users which have report similar behaviour at
'forums.mozillazine.org' (http://forums.mozillazine.org/viewtopic.php?t=181286)
and at the German ‘www.thunderbird-mail.de/forum’
(http://www.thunderbird-mail.de/forum/viewtopic.php?t=5455).



Magnus Baumgard
[Berlin - Germany]
Sorry,

there were a mix up of numbers in my previous 'Steps to Reproduce:'

Please Note Nr. 8 and 9. should be as following :


8. Do the same as in 7. for 'pop3_T2@***' and with 'Subject' 'Test eMail POP3
T2.xx'.

9. Do the same as in 7. for 'pop3_T3@***' and with 'Subject' 'Test eMail POP3
T3.xx'.


Magnus Baumgard
[Berlin - Germany]
please change summary from "lose of moved messages" to "loss of moved messages"
Magnus Baumgard, watch Bug 275190, please.
See also Bug 267361 Comment #1. 
Magnus Baumgard, isn't this same problem as Bug 215349?
(In addition to comment #4)
If yes, probably DUP of Bug 168648, since Bug 235122 is already closed as DUP
Bug 168648.
Hello WADA,

it would bee nice if you could check the steeps stated at "Reproducible", to say
if you can verify that not all messages are been found in the folders and there
by prove TB looses messages under these conditions.

Regarding all of You "isn't this same problem as", "DUP" hints (attempts?) sorry
to say to You "NO". Because the main and most only issue of these Bug report is
that TB 1.0 (20041206) looses (kills!) the massages during filtering of it to an
Inbox/Folder that is been busy and as fare as I read non of Your forwarded Bug's
losses messages.
( ".. - so no dataloss occurred." -
https://bugzilla.mozilla.org/show_bug.cgi?id=168648#c15 ).

To make it clear again :

                          ! MASSAGES ARE BEEN LOSSED !


(It would be nice if TB can fast (parallel) download messages from
different/multiply accounts and filter/move there after these, but I personally
rather get a MsgBox saying "currently not possible" and find the message
unfiltered/unmoved still the wrong old Inbox/Folder, RATHER THEN HAVING AN
UNREAD MASSAGES LOSSED or having them a bit slower downloaded by sequential
means but again 100% save.)

Sorry to bee a bit direct to You, but I'm wondering why no one from the mozilla
team meanwhile hat a look at these "critical" Bug (Assigned To: *** (not reading
bugmail)). Or is it because I may have posted it under the wrong Product name
(Core) and not Thunderbird (but Bug Nr. 168648 where posted these way).

Also please excuse my improper English spelling, as "Ekhart" comment correctly
please do change summary to ".. loss of moved messages ..", so that more other
users can easily find these Bug report and there by avoid possible DUP's.


Magnus Baumgard
[Berlin - Germany]
I've understood that your target of this bug is "loss of mail" only.
See next bugs.
 (1-A) Bug 168648
       As you know, "Move to folder" of message filter fails
       if target folder is busy.
       This is independent from "Global Inbox" or "Non Global Inbox" as you see.
 (1-B) Conditions of Bug 273778, Bug 274330, Bug 275467 
       In addition to Bug 168648 case(folder busy),
       "Move to folder" of message filter fails too when ;
         - Bug 273778 : target folder is deleted
         - Bug 274330 : target folder is in compress (similar to bug 168468)
         - Bug 275467 : target folder is renamed (similar to Bug 273778)
       This is also independent from "Global Inbox" or "Non Global Inbox".
 
 (2) Problem of Bug 273778, Bug 274330, Bug 275467 
     If "Non Global Inbox", (1-A) and (1-B) won't cause "mail loss"
     because user can see Inbox of the account.
     But when "Global Inbox", the unmoved mails will never be moved to Global
     Inbox(this is tha problem), then unmoved mail remain in accounts's Inbox.
     Since accounts are hidden when Global Inbox, user can not see Inbox of
     the account, then mail will be "lost".

Above (2) is your "mail loss", I think.
Is it right?
If yes, your case is 4-th pattern(when Bug 168648).
(See Bug 273778 for how to check whether unmoved mails are kept in hidden Inbox
or not). 

By the way, read thru next Thunderbird FAQs at Knowledge Base of MozillaZine
before try to execute additional test or recovery from problem.
 http://kb.mozillazine.org/index.phtml?title=Thunderbird_:_FAQs_:_Global_Inbox
 http://kb.mozillazine.org/index.phtml?title=Thunderbird_:_FAQs_:_Filters
Summary: Can't filter/move messages to Inbox that is busy, results in lose of moved messages under TB Ver. 1.0 (20041206) → Can't filter/move messages to Inbox that is busy, results in loss of moved messages under TB Ver. 1.0 (20041206)
WADA,
unfortunately this is much more serious. I don't have any hidden or global
inboxes, and my experience http://forums.mozillazine.org/viewtopic.php?p=1084534
proves that the mail is not just hidden but actually destroyed, albeit "only"
partially in my case.
(In reply to comment #8)
> I don't have any hidden or global inboxes

You say as follows in "Steps to Reproduce:" of your comment #0 ;
> 1. Setup a new Profile 'Tester' and create tree new accounts
>   ('pop3_T1@***', 'pop3_T2@***', 'pop3_T3@***')
>    with 'pop3_T1@***' and 'pop3_T2@***' not using the "Global Inbox"
>    and 'pop3_T3@***' as using the "Global Inbox"
Doesn't it mean "pop3_T3@***" use Global Inbox?

What is your real account definition?  
WADA, you're confusing me, Ekhart, and Magnus. I don't use my local folders at
all. (In fact, i never understood what they were for when i installed TB, and
this is one of the most confusing things about TB for new TB users.) I have five
separate accounts in the same profile. As i explained in
http://forums.mozillazine.org/viewtopic.php?p=1084534
two messages destined for two different accounts were downloaded in each account
as identical copies of the same "amalgameted" message consisting of one message
combined with a truncated version of the second message, *and the second message
disappeared from the server*!
(In reply to comment #10)
> WADA, you're confusing me, Ekhart, and Magnus. 
Oh sorry, Ekhart.
I mistook the comment was response from bug reporter.

Ekhart( not Magnus :-) ), your case sounds ; 
 A truncated mail is deleted from server when moved to other folder
 even though you do non't request delete from server.
and seems to be problem around next bugs.
 Bug 248742 : Loss of header-only message (junk, offline, dragged)
 Bug 249361 : Header-only mail was lost if the mail was automatically deleted
              from server by option settings before additonal download.
 Bug 274798 : When "header only" mail was moved to Junk by Junk filter,
              mail was deleted before additional(full) download,
              even though no option for automatic deletion is requested
These are completely different problems from this bug.
WADA, none of these bugs apply. I don't download only headers, and i get no junk
on either of these accounts. 

What destroyed the second message was that TB was filtering a different message
on a different account at the same time and got mixed up so badly doing this
that it amalgamated messages from different accounts into one message and then
sent this message to both accounts. The truncated message starts at the end of
the first message in the same message body and in the middle of a sentence of
the second message.

I believe my problem is the same as Magnus's because it's caused by buggy filter
handling, and i believe it is an indication of a more serious and fundamental
flaw in TB. I.e. i believe the filter problem is due to a TB flaw in handling
simultaneous tasks. Therefore, the knowledge base articles about disappearing
mail and about compacting folders should include the important warning to first
go offline! 
Ekhart, when filtering from different accounts into different folders, there's
no global data involved, and furthermore, the actual moving of data happens
synchronously on the one and only UI thread, so there's no possibility that the
operations will happen at the same time. I.e., the whole message is moved at
once from the incoming Inbox to the filter destination folder. This has
drawbacks because it does lock the UI, but it's safer  than what I suspect you
imagine is going on.
Ekhart, a few questions - have you set things up so that your pop3 servers share
the same local directory? (We disallow that now from the UI but old profiles can
be set up that way, or you can edit prefs.js by hand...) Do you have a virus
checker installed? Are you filtering across accounts, or within the same account?
David, what do you mean with local directory? If you mean TB's Local Folders, i
don't use those except as a repository for my old mail that i imported from OE
and Eudora (latter worked very badly BTW; full of html code junk). 

My computer is spanking clean with AVG, Spybot, SpywareBlaster, Ad-Aware,
Sygate, and others installed and updated neurotically often.

I have separate filters for each account. One of the two amalgamated messages
was meant for an account that has no filters; the other message was subject to a
filter. Interestingly, it was the unfiltered message that was truncated and
attached to the one that should have been filtered - this one instead ended up
in the inbox (of both accounts)

> when filtering from different accounts into different folders...the actual
moving of data happens synchronously on the one and only UI thread, so there's
no possibility that the operations will happen at the same time. I.e., the whole
message is moved at once from the incoming Inbox to the filter destination
folder. This has drawbacks because it does lock the UI, but it's safer  than
what I suspect you imagine is going on.

How then is it possible that part of a message addressed to one account ended up
*inside* a message addressed to a different account? And that this was then sent
to both inboxes?

Add term of "Global Inbox" in summary to avoid confusing.
Summary: Can't filter/move messages to Inbox that is busy, results in loss of moved messages under TB Ver. 1.0 (20041206) → Can't filter/move messages to Inbox that is busy, results in loss of moved messages when Global Inbox(mail is not moved to it) under TB Ver. 1.0 (20041206)
Fix for similar situation is now available(Bug 273778 has been FIXED.)
Is the problem resolved by the patch for Bug 273778?
This is an automated message, with ID "auto-resolve01".

This bug has had no comments for a long time. Statistically, we have found that
bug reports that have not been confirmed by a second user after three months are
highly unlikely to be the source of a fix to the code.

While your input is very important to us, our resources are limited and so we
are asking for your help in focussing our efforts. If you can still reproduce
this problem in the latest version of the product (see below for how to obtain a
copy) or, for feature requests, if it's not present in the latest version and
you still believe we should implement it, please visit the URL of this bug
(given at the top of this mail) and add a comment to that effect, giving more
reproduction information if you have it.

If it is not a problem any longer, you need take no action. If this bug is not
changed in any way in the next two weeks, it will be automatically resolved.
Thank you for your help in this matter.

The latest beta releases can be obtained from:
Firefox:     http://www.mozilla.org/projects/firefox/
Thunderbird: http://www.mozilla.org/products/thunderbird/releases/1.5beta1.html
Seamonkey:   http://www.mozilla.org/projects/seamonkey/
This bug has been automatically resolved after a period of inactivity (see above
comment). If anyone thinks this is incorrect, they should feel free to reopen it.
Status: UNCONFIRMED → RESOLVED
Closed: 16 years ago
Resolution: --- → EXPIRED
Product: Core → MailNews Core
You need to log in before you can comment on or make changes to this bug.