529164 - Message Filtering fails for some messages

Status: RESOLVED DUPLICATE of bug 124641

(MailNews Core :: Filters, defect)

Description

[IU]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091116 Shredder/3.0.1pre

Shredder is unable to filter certain messages.  I'm not sure what the issue is, but I have a detailed STR.

I first encountered this when I was trying to filter email where the From field contained non-word characters.  However, now I've encountered the issue with the normal-looking subject line of a bugzilla email, and it turns out the problem is with something else in the message.


Reproducible: Always

Steps to Reproduce:
PHASE I

1. Download and unzip the attached message
2. Drag-and-drop the extracted message to your Shredder Inbox
3. Create a message filter as follows:
a) Click Tools --> Message Filters...
b) Select the Inbox where you dropped the message and choose New...
c) Filter name: test
d) Apply filter when: Check Mail or Manually Run
e) Match all of the following: {Subject} {is} [Bug 524434] Bugs found during testing of Thunderbird 3.0 RC1 - (3.0rc1)
f) Note in Step e that you are to match the whole subject *EXACTLY* as it appears in the email.
g) Perform these actions: Delete Messsage
h) Click OK
4. Highlight the filter you've just added and click "Run Now"
5. Nothing happens.

PHASE II

1. In your Inbox, select the message then click Message --> Edit Message As New
2. Click File --> Save
3. Close the message
4. Move the message from Drafts to the same Inbox as the original
5. Return to Message Filters and highlight the filter
6. Click "Run Now"
7. The edited message is successfully deleted.  The original... NOT.

Comment 1

[IU]

Attachment: test case: bugzilla email with my email address edited out

Comment 2

[IU]

Note: This appears to be a long-standing bug, rather than a regression.

I've tested as far back as I was willing to check and the bug exists there: version 3.0a1pre (2008010204).

Comment 3

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #1)
> test case: bugzilla email with my email address edited out

Subject: header is multi-line header. ( {CRLF}==0x0D0A )
> Subject: [Bug 524434] Bugs found during testing of Thunderbird 3.0 RC1 -{CRLF}
>  (3.0rc1){CRLF}

(In reply to comment #0)
> e) Match all of the following:
> {Subject} {is} [Bug 524434] Bugs found during testing of Thunderbird 3.0 RC1 - (3.0rc1)

What will happen if subject header is changed to single line header?
> Subject: [Bug 524434] Bugs found during testing of Thunderbird 3.0 RC1 - (3.0rc1){CRLF}

Comment 4

[IU]

Well, I didn't create the email.  That's how it came from Bugzilla, with the exception of me editing out my email address.

Furthermore, since I've experienced similar issues with other fields in other emails, it's up to Thunderbird to handle whatever issues exist, since the recipient user generally can't control what someone else sends.

Comment 5

[Mark Banner (:standard8)]

This doesn't seem to be a big use case so we wouldn't block on it, however bienvenu did say he'd take a look at it.

Comment 6

[David :Bienvenu]

The subject string in the DB has a CRLF in it. I'm a little surprised that Bugzilla isn't using a tab to start the second line of the subject, but fixing that doesn't seem to fix the issue.

Comment 7

[IU]

(In reply to comment #6)
> The subject string in the DB has a CRLF in it.

Do note that I see this issue with other fields too -- not just the subject.  I've got here a spam message that's breaking up many fields the same way (including the To: field) and, if that's the issue, would make filtering on such fields impossible.

Comment 8

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #6)
> The subject string in the DB has a CRLF in it.

This bug is probably a specific case("is" case when multi-line header) of Bug 124641.

Comment 9

[Wayne Mery (:wsmwk)]

as in bug 474851.
duping to bug 124641