289683 - Using filters to copy an incoming message first and move it afterwards brokes the filter engine

Status: RESOLVED FIXED

(Thunderbird :: General, defect)

Description

[Lukas Kull]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.6) Gecko/20050317 Firefox/1.0.2
Build Identifier: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.6) Gecko/20050317 Firefox/1.0.2

I tested Tb 1.0 and 1.0.2 under Linux and Windows and got the same error. To try
to get a message from the Inbox to 2 different folders, I use a copy-filter and
a move-filter (in this order). The filter condition may be "sender isn't 'a'" or
something similar to get all messages filtered.
When the filters are installed and I receive the first new mail, I get an EMPTY
message in the folder where the message should be moved to. The message will
then be correctly moved to the folder I specified in the move-filter.
When the second message comes in, the message is moved only.

Reproducible: Always

Steps to Reproduce:
1. Delete all kind of old profiles
2. Install Thunderbird 1.0.2
3. After starting Tb, create a new POP-account (I used the global Inbox, but as
far as I've tested, that should not matter)
4. Create 2 new folders (e.g. backup and myfolder)
5. Set up a new message filter for your_new_account (not local folder):
condition="sender isn't 'a'" (or any filter that match all mails), copy to local
folder->backup
6. Set up a second message filter for your_new_account (not local folder):
condition="sender isn't 'a'", move to local folder->myfolder
7. Check that the copy-filter is above the move-filter.
8. Send yourself a test-mail
9. Get Mail (and you should find an EMPTY message instead of your message in
backup and your message in myfolder)
10. Send yourself another test-mail
11. Get Mail (and the copy-filter doesn't work at all)
Actual Results:  
The message is not copied, just moved. There is an empty message in backup that
should not be there.

Expected Results:  
Copy the message first (to backup) and then moved (to myfolder)

The problem doesn't occur in the nightly builds since they just removed the
copy-action in the message filters. That makes Thunderbird  unusable for me. You
can contact me via email: [e-mail]

Comment 1

[CatBui2002]

Same problem on Thunderbird 1.5 beta 1 build 20050908 on Windows.  Can move and
copy but not at the same.  If create 2 filter, copy first and then move, then
the copy is blank with date 12/31/1969 4:00pm.

Comment 2

[WADA:World Anti-bad-Duping Agency]

Problem when first copy by filter became clear in Bug 384735(problem while first copy by filter or just after first copy by filter). And phenomenon after the problem became slightly clear than before.

Same or similar phenomenon after problem described in Bug 384735?
Is there JS Error of Bug 384735 Comment #4 in Error Console?
What do you mean by "brokes the filter engine" in bug summary?

Putting Bug 384735 in "Depends on:".

Comment 3

[WADA:World Anti-bad-Duping Agency]

It sounds that phenomenon described in comment #0 is combination of Bug 384735 and Bug 376235.
Developer has started analysis of problem when "copy then move" case in Bug 376235.
> Bug 376235 – Filters won't move mail after copying it
Watch Bug 376235 also, please.   

Comment 4

[WADA:World Anti-bad-Duping Agency]

Bug 384735 has been fixed.
To Lukas Kull(bug opener):
Does problem still occur with latest trunk nightly?

Comment 5

[WADA:World Anti-bad-Duping Agency]

I tested with Thunderbird trunk nightly 2007/9/30 build(Win-XP SP2), and problem was still be re-created.

(Filter Rules)
Filter Rule-1 : If subject contains XXX, Then Copy to folder-1
Filter Rule-2 : If subject contains XXX, Then Move to folder-2
(Result)
 A) Mails in folder-1(copied by filer)
    Became phantom mail, no subject & Date / Received = 1970/01/01 09:00.
    Mail data itself in mail folder file was original data itself.
    So, when "Rebuild Index" was executed, phantom mails disappered,
    and copied mails appeared properly. And, when already deleted mails existed
    in folder-1, and if "Compact Folder" was executed for folder-1,
    copied mail data by filter were removed from mail folder file for folder-1,
    because .msf doesn't know about these copied mail data.
 B) Mails in folder-2(moved by filer)
    No problem. Mails were processed normally/properly.
 C) Problem of aang/wait/locking etc. on related mail folders was not observed.
    Even after problem of A), any folder could be accessed. 

Above result was same as my test result of "copy then move in a filter rule" case, which is Bug 376235's case. 
David has started analysis of problem when "copy then move in a filter rule" in Bug 376235. Please watch Bug 376235.

Setting dependency to Bug 376235 instead of Duping to Bug 376235, in order to avoid loss of "copy by a filter rule & move in other filter rule" case, and because this bug is older discovery of the problem(looks first one for me), and for ease of tracking. 
 

Comment 6

[WADA:World Anti-bad-Duping Agency]

I've opened Bug 398498 for problem of Comment #5.

Comment 7

[WADA:World Anti-bad-Duping Agency]

Bug 398498 was FIXED by Bug 376235. Closing as FIXED.
Note:
There is a remaining issue. If both copy & move is specified in single filter rule, Bug 448337 occurs.