Provide hooks to control calculation of bayesian filter traits

RESOLVED FIXED in Thunderbird 3.0b3

Status

enhancement
RESOLVED FIXED
11 years ago
11 years ago

People

(Reporter: rkent, Assigned: rkent)

Tracking

(Blocks 1 bug)

Trunk
Thunderbird 3.0b3
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(1 attachment, 2 obsolete attachments)

With the recent generalization of the bayesian filters to classify arbitrary message traits, we need mechanisms to decide when to apply these calculations. Currently, we never apply the calculations to folders that make no sense for junk mail calculations (drafts, sent, trash). But if additional non-junk traits are enabled, then the calculations are done for most other folders. This has performance implications, including not only the calculation time, but also the decision to download the message body. Users and extensions need ways to enable and disable these calculations.

Since currently the only way to enable non-junk trait calculations is through an extension, the scope of this current bug will be to provide the backend support to control when non-junk traits are calculated, without any user interface to those methods.
Depends on: 478360
Blocks: 179984
This patch is fully working (after application of the patch for bug 478360) but has not been fully checked by me. I mainly post it to show the use of inheritedFolderProperties in allowing hooks for precise control of the application of the bayesian filter processing.

Note I've also enabled bayesian filter calculation in rss and news here, controlled by an inheritedStringProperty in callFilterPlugins()
Depends on: 481676
This provides precise control of application of the bayes filter, including supporting RSS and nntp. RSS has an issue, if you set the option to link to the web page, then the summary information is stored as alternate content in an iframe, which is not passed through the serializer. I added a hack for that controlled by the preference. For nntp, we get tokens, but the headers are not broken out, so there are no header-specific tokens. It still works, though is less than ideal. That should probably be fixed, if possible, before fully enabling support for junk in nntp (which is not done by this patch.)

You need to apply the current patch for bug 476389 before applying this patch, because they bitrot each other.
Attachment #363002 - Attachment is obsolete: true
Attachment #368556 - Flags: superreview?(bienvenu)
Attachment #368556 - Flags: review?(bugzilla)
Status: NEW → ASSIGNED
Whiteboard: [needs r standard8, sr bienvenu]
Target Milestone: --- → Thunderbird 3.0b3
Comment on attachment 368556 [details] [diff] [review]
Add hack for RSS iframe tokenizing

>   if (serverType.EqualsLiteral("rss") ||
>+     (mFlags & nsMsgFolderFlags::Newsgroup && !filterNewsForJunk) ||
>      (mFlags & (nsMsgFolderFlags::Junk | nsMsgFolderFlags::Trash |
>              nsMsgFolderFlags::SentMail | nsMsgFolderFlags::Queue |
>              nsMsgFolderFlags::Drafts | nsMsgFolderFlags::Templates |
>              nsMsgFolderFlags::ImapPublic | nsMsgFolderFlags::ImapOtherUser)
>      && !(mFlags & nsMsgFolderFlags::Inbox)))

urgh. This is a nice confusing mix of styles (not caused by you). Can you adjust it please? I think this would be slightly cleaner:

if (serverType.EqualsLiteral("rss") ||
    (mFlags & nsMsgFolderFlags::Newsgroup && !filterNewsForJunk) ||
    (mFlags & (nsMsgFolderFlags::Junk | nsMsgFolderFlags::Trash |
               nsMsgFolderFlags::SentMail | nsMsgFolderFlags::Queue |
               nsMsgFolderFlags::Drafts | nsMsgFolderFlags::Templates |
               nsMsgFolderFlags::ImapPublic |
               nsMsgFolderFlags::ImapOtherUser) &&
     !(mFlags & nsMsgFolderFlags::Inbox)))

>+  /*
>+   * We'll use inherited folder properties for the junk trait to override the
>+   * standard server-based specification of junk processing. This provides a
>+   * hook for extensions to customize the application of junk filtering.
>+   * The general format for the property is "dobayes." + trait ID for the
>+   * trait, with values "true" or "false" to override defaults.
>+   */
>+  nsCAutoString junkEnableOverride;
>+  GetInheritedStringProperty("dobayes.mailnews@mozilla.org#junk", junkEnableOverride);

The comment is slightly confusing wrt the code. From what the comment is saying, I'd expect the code here to be checking all dobayes.* properties, but it isn't, that happens later on. Maybe rearrange how the comments work?
Attachment #368556 - Attachment is obsolete: true
Attachment #369445 - Flags: superreview?(bienvenu)
Attachment #369445 - Flags: review?(bugzilla)
Attachment #368556 - Flags: superreview?(bienvenu)
Attachment #368556 - Flags: review?(bugzilla)
Attachment #369445 - Flags: superreview?(bienvenu) → superreview+
Comment on attachment 369445 [details] [diff] [review]
Fixed Standard8's issues

That's better. There was one bit of bitrot where bug 471559 and this one were removing the same block/line, so I ignored that ;-)

I've checked this in: http://hg.mozilla.org/comm-central/rev/b9ddff83f2ed
Attachment #369445 - Flags: review?(bugzilla) → review+
Status: ASSIGNED → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Whiteboard: [needs r standard8, sr bienvenu]
You need to log in before you can comment on or make changes to this bug.