message duplicated when copied or moved from filter
Categories
(MailNews Core :: Filters, defect)
Tracking
(Not tracked)
People
(Reporter: toddgleason, Unassigned, NeedInfo)
References
Details
Comment 1•16 years ago
|
||
| Reporter | ||
Comment 2•16 years ago
|
||
Comment 3•16 years ago
|
||
Comment 4•16 years ago
|
||
| Reporter | ||
Comment 5•16 years ago
|
||
Comment 6•16 years ago
|
||
Comment 7•16 years ago
|
||
| Reporter | ||
Comment 8•16 years ago
|
||
Comment 9•16 years ago
|
||
| Reporter | ||
Comment 10•16 years ago
|
||
Comment 11•15 years ago
|
||
Comment 12•15 years ago
|
||
Comment 13•14 years ago
|
||
Comment 14•13 years ago
|
||
| Reporter | ||
Comment 15•13 years ago
|
||
| Reporter | ||
Comment 16•13 years ago
|
||
| Reporter | ||
Comment 17•13 years ago
|
||
Comment 18•13 years ago
|
||
Comment 19•13 years ago
|
||
Comment 20•13 years ago
|
||
Comment 21•13 years ago
|
||
Comment 22•13 years ago
|
||
| workaround | ||
Comment 23•13 years ago
|
||
Comment 24•13 years ago
|
||
Comment 25•12 years ago
|
||
Comment 26•12 years ago
|
||
Comment 27•9 years ago
|
||
Comment 28•9 years ago
|
||
Updated•8 years ago
|
Comment 29•7 years ago
|
||
Comment 30•7 years ago
|
||
| Reporter | ||
Comment 31•7 years ago
|
||
Comment 32•7 years ago
|
||
| Reporter | ||
Comment 33•7 years ago
|
||
| Reporter | ||
Comment 34•7 years ago
|
||
| Reporter | ||
Comment 35•7 years ago
|
||
Comment 36•7 years ago
|
||
Updated•7 years ago
|
Comment 37•4 years ago
|
||
Still seeing this issue as described in my comment on Bug 752237.
I am not using a Unified Folder View so with hindsight this would have been a better place to post the comment. The workaround described above appears to solve the issue.
| Reporter | ||
Comment 38•4 years ago
|
||
I am also still seeing this issue, but it is intermittent. Here are two messages that end up in the Junk mail. The first one appears just once. The second is duplicated. The rule execution in filterlog.html looks identical to me for the actual messages, but it looks as though for the second one, it believes it is also seeing a message with no from, no subject, and no date (or 1969 as date). The actual end result in my Junk folder though is the same message twice, with roughly the date at the beginning of the log message. There is no 12/31/1969 message in my Junk folder nor do I see a blank sender. This strikes me as a concurrency issue.
--- First the non-duplicated message:
<p>
[4/8/2021, 7:09:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Xeric <contact@m.xeric.com> - DRUMROLL PLEASE 🥁And the Instagram Photo Contest WINNER Is . . . at 4/8/2021, 7:07:52 AM
junk score
</p>
<p>
[4/8/2021, 7:09:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Xeric <contact@m.xeric.com> - DRUMROLL PLEASE 🥁And the Instagram Photo Contest WINNER Is . . . at 4/8/2021, 7:07:52 AM
moved message id = im5hlJgPS1uMf3ZSBoKscQ@geopod-ismtpd-1-0 to mailbox://nobody@Local%20Folders/Junk
</p>
<p>
[4/8/2021, 7:09:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Xeric <contact@m.xeric.com> - DRUMROLL PLEASE 🥁And the Instagram Photo Contest WINNER Is . . . at 4/8/2021, 7:07:52 AM
execution stopped
</p>
--- and now one that was duplicated:
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Interesting Information <interesting-information-space@quora.com> - Why cursive handwriting is good for your brain - among other things. This handwriting by Prakriti Malla from Nepal won the title of “The Most Beau... at 4/8/2021, 11:05:04 AM
junk score
</p>
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Interesting Information <interesting-information-space@quora.com> - Why cursive handwriting is good for your brain - among other things. This handwriting by Prakriti Malla from Nepal won the title of “The Most Beau... at 4/8/2021, 11:05:04 AM
moved message id = Aeq-VxDMfUa5PIHegKoOsIpkj_wOwtxtpXBmfpKwJrPjO2FtPqNpQ2HZeZ7fwrQ_c0OpAt5gQBXgD6SUBHkgYWyWeOOgs1aIzXfXKkHCirhvXBDS7fx_MS7VGAKpJCYBmbYU8w2Bn2vMmuT9TgABAgA=@t2.msgid.quoramail.com to mailbox://nobody@Local%20Folders/Junk
</p>
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Interesting Information <interesting-information-space@quora.com> - Why cursive handwriting is good for your brain - among other things. This handwriting by Prakriti Malla from Nepal won the title of “The Most Beau... at 4/8/2021, 11:05:04 AM
execution stopped
</p>
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from - at 12/31/1969, 5:00:00 PM
junk score
</p>
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from - at 12/31/1969, 5:00:00 PM
moved message id = to mailbox://nobody@Local%20Folders/Junk
</p>
<p>
[4/8/2021, 11:05:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from - at 12/31/1969, 5:00:00 PM
execution stopped
</p>
Updated•3 years ago
|
Comment 39•1 year ago
|
||
Todd, Jim, gitman (and anyone else)
Still see this after updating to version 128?
| Reporter | ||
Comment 40•1 year ago
|
||
(In reply to Wayne Mery (:wsmwk) from comment #39)
Todd, Jim, gitman (and anyone else)
Still see this after updating to version 128?
Hard to say. The closest I have seen recently is that on 9/27 I had 2 messages listed in my junk folder from the same time, with the same-looking content except that one has the junk flag and the other doesn't. They're rendered differently possibly because of the junk flag. I can't find any message filters that either mark as junk or move to the junk folder without doing all 3 of marking as junk, moving to the junk folder, and stopping filter execution, so I don't see how the issue would be with my filters.
It feels like the bug is nearly but perhaps not completely squashed.
| Reporter | ||
Comment 41•1 year ago
|
||
(In reply to toddgleason from comment #40)
(In reply to Wayne Mery (:wsmwk) from comment #39)
Todd, Jim, gitman (and anyone else)
Still see this after updating to version 128?
Hard to say. The closest I have seen recently is that on 9/27 I had 2 messages listed in my junk folder from the same time, with the same-looking content except that one has the junk flag and the other doesn't. They're rendered differently possibly because of the junk flag. I can't find any message filters that either mark as junk or move to the junk folder without doing all 3 of marking as junk, moving to the junk folder, and stopping filter execution, so I don't see how the issue would be with my filters.
It feels like the bug is nearly but perhaps not completely squashed.
Just saw this again. I'd had Thunderbird off for nearly a day and about 30 messages came through. All the ones that landed in Junk got duplicated into 2 versions: ones with full HTML formatting (and which are not actually marked as junk), and ones with nothing but hyperlinks (which are marked as junk). I'm not sure if this is a startup-only issue now, perhaps something where an event handler isn't properly set up on the initial mail fetch.
| Reporter | ||
Comment 42•14 days ago
|
||
The bug is very much still alive. Here's an example of the issue. In my msgFilterRules.dat is a "Temporary" filter that looks something like this:
name="Temporary"
enabled="yes"
type="17"
action="Copy to folder"
actionValue="mailbox://nobody@Local%20Folders/Folders/Temporary"
action="Move to folder"
actionValue="imap://[...]/Temporary"
action="Stop execution"
condition="[lots of OR conditions] OR (from,ends with,lowes.com) [lots more OR conditions]"
At the end I have a catch-all filter that looks something like this:
name="Suspected Spam (unfiled messages)"
enabled="yes"
type="32"
action="JunkScore"
actionValue="100"
action="Copy to folder"
actionValue="mailbox://nobody@Local%20Folders/Junk"
action="Move to folder"
actionValue="imap://[...]/Spam"
action="Stop execution"
condition="AND (from,doesn't contain,bogussender_really_match_all_messages_hack) AND (date,is after,02-Jan-1970)"
(I couldn't tell you what the from condition was for, probably due to some other bug, and no idea if it's necessary now or not)
As far as I understand, matching the Temporary filter ought to prevent later filters from running. But here's what actually happened:
[12/26/2025, 7:30:26 AM] Applied filter "Temporary" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM copied message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to mailbox://nobody@Local%20Folders/Folders/Temporary
[12/26/2025, 7:30:26 AM] Applied filter "Temporary" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM moved message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to imap://[...]/Temporary
[12/26/2025, 7:30:26 AM] Applied filter "Temporary" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM execution stopped
[12/26/2025, 7:30:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM junk score
[12/26/2025, 7:30:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM copied message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to mailbox://nobody@Local%20Folders/Junk
[12/26/2025, 7:30:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM moved message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to imap://[...]/Spam
[12/26/2025, 7:30:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM junk score
[12/26/2025, 7:30:26 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM copied message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to mailbox://nobody@Local%20Folders/Junk
[12/26/2025, 7:30:27 AM] Applied filter "Suspected Spam (unfiled messages)" to message from Lowe’s Home Improvement <lowes@e.lowes.com> - Holiday clearance✨Up to 75% OFF at 12/26/2025, 7:30:17 AM moved message id = 8d75b199-adb1-4321-9fc2-991e0b702901@las1s04mta948.xt.local to imap://[...]/Spam
If I remove the step where the Suspected Spam filter copies to my local email, I don't get a duplicate, just the one on the IMAP Spam folder. So 2 things are going wrong:
- The Suspected Spam filter is running after the Temporary filter, despite me including the "Stop execution" action.
- The Suspected Spam filter is duplicating the message, copying it twice into the local Junk folder.
Only one copy ends up in the IMAP Spam folder.
The issue isn't specifically triggered by the Temporary rule either. It seems to be happening for all my email. My other rules all use the same pattern of copying to a local folder, then moving the message to the IMAP folder where I want it. (This allows me to see a limited view of messages with my phone, but have everything filed the way I want it on my PC.)
I'm guessing that the copy in the first rule (Temporary in this case) triggers, despite using "Stop execution", the Suspected Spam filter to run, and that it somehow runs against 2 copies (even though the rule is only defined against the IMAP account, not against the local folders).
Description
•