Closed Bug 193084 Opened 22 years ago Closed 21 years ago

Junk Filtering Does Not Run

Categories

(MailNews Core :: Filters, defect)

Product:
MailNews Core
Component:
Filters
Platform:
x86
All
Type:
defect
Priority:
Not set
Severity:
major

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: erikmarcus, Assigned: sspitzer)

References

Details

User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.3b) Gecko/20030210 Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.3b) Gecko/20030210 Junk filtering never runs for me. I've marked the "Enable Junk Controls" checkbox. And I have hand-selected a couple hundred emails as junk. But when new emails arrive, they always get a "junk-questionmark" icon while the emails are coming in, and then the icon changes to non-junk. Additionally, when I select a range of emails I know are junk, but haven't yet marked, and choose, "run junk mail controls on selected messages," nothing happens. I'm guessing I'm having this problem because I've set up a second email account, and I'm not using my "local folders" for email, since I don't want my Usenet posts to have the same email that I use for my primary email account. MozillaMail is working perfectly for me, except that it seems incapable of analyzing my email for spam. Reproducible: Always Steps to Reproduce: 1.hit "get messages" button, or select some messages and choose "run junk mail controls" menu option. 2. 3. Actual Results: Get messages properly retrieves my emails, but does not trigger junk mail analysis. "Run junk mail controls" does not trigger analysis either. Expected Results: it should have performed an analysis of which emails were junk. I enabled the "junk mail log" when I downloaded the software, but the log is always empty. On a different matter, I suggest changing "run junk mail controls" to "analyze mail for junk" or "run junk mail analysis." Either phrase would be clearer in terms of indicating the action that the user should expect to occur.
I can confirm this with 1.3b, Linux; I am using an imaps-folder for my mails and not the local folders. Junk filtering does not work at all and junk filtering log keeps empty all the time.
I have this same problem. I'm running Mozilla 1.3b, Build 2003021008 on WinXP.
Okay, this is bizarre. When the confirmation of my update to this bug report arrived, *it* got filtered into the junk folder! Unlike those important messages about online gambling, etc...
I installed 1.3a and used the junk controls. I installed 1.3b and used the junk controls. I then formatted my partition and did a full re-install of Mandrake 9.0. I installed 1.3b but I used my local mail folders from my previous install (that I had backed up before I re-formated). I did not however save any of my mozilla configuration information, just the mail folders. I use junk controls on my imap mail folders and only use my local folders to save copies of sent messages. I can mark messages as Junk and they will keep that status but if I apply junk filters to the messages they are not moved to the Junk folder as I configured Mozilla to do. In addition new messages are never marked as junk. The only way I can get them marked at junk is to do it manually. This is really frustrating as the most excellent junk filter was one of the main reasons I used mozilla mail!
I seem to have this problem (as described in comment 4) whenever I alter the junk mail controls. It seems to fix itself after I manually move the marked junk mail to the Junk folder, exit mozilla and restart it.
I did as suggested in comment 5 but it didn't make any difference. When I download mail nothing is ever marked as junk. If I mark things as junk manually, select the junk mails and run junk controls on selected messages all that happens is that the mails that were marked as junk have their junk flags turned off. I have not been able to get Junk filtering working in any capacity since I did a reform and full reinstall of Mandrake 9.0 and Mozilla 1.b.
I'm seeing the same problem: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4a) Gecko/20030226 To clarify a bit: if I run the junk-mail controls manually (select a bunch of messages, and the do a 'Tools | Run junk mail controls on selected ...', everything works as expected. But the junk mail controls *never* seem to be run automatically upon the arrival of new mails - neither is the Mail classified as junk, nor is it moved to the 'Junk' folder, as I configured it. Additionally, the junk log stays empty, even though I enabled it. One thing that might perhaps be related: I'm using fetchmail to retrieve my mail from several POP-servers, and then movemail to get it into Mozilla. Anybody else here using movemail? Could it be that movemail somehow doesn't trigger the junk mail controls? I suggest that the owner of the bug (or someone with sufficient priviledges) change 'OS: all', since this by now has been reported on NT, XP and Linux. CC-> self
Testsystem: Linux, latest nightly Build (20030222): I can not confirm everything running correctly when checking for spam manually on selected messages. No message is tagged as spam and manually tagged as spam messages get detagged again. The junk mail log keeps empty all the time and new mail does not seem to be scanned for spam automatically (using imaps).
I've been having this problem. After using the junk mail filtering in 1.3 for a while, I reinstalled my OS (XP) without saving my Mozilla configuration. After reinstalling Mozilla, the junk mail controls have the behavior described; no new messages are marked as junk, marking messages as junk has no effect (marking as junk and then running junk mail controls on the marked messages just removes the junk marking). I've found a fix that's somewhat obscure. Since there couldn't be any state left on my machine after reformatting, the problem must be with the mail folders stored on the machine (since I use IMAP). I looked through my mbox file, and sure enough, I found that Mozilla tags messages that have been marked with an "X-Keywords:" header, which is either blank or contains the word "Junk" or "NonJunk". In addition, there is an "X-IMAPbase:" header which also contains the words "Junk" and "NonJunk". I removed all the lines containing "X-Keywords:" and the line containing "X-IMAPbase:", deleted the Mozilla subfolder in my Application Data folder, and set up my mail account from scratch using the cleaned out mbox, and it appears to have worked; junk mail filtering is now marking spam as junk and moving it to the junk mail folder. Once I got junk mail filtering working on just the inbox, then I cleaned up my other mail folders. I strongly suggest making backup copies of your mailboxes before you try this since you may end up corrupting them.
I can not reproduce the fix mentioned in #9. Here the junk mail log keeps empty and no filtering is done. I have thought about the problem and imho it seems not to depend on the OS and not on the kind of install but on imap. I have looked in my imaps settings and found the following options that may be not common and may (it is just a guess) cause problems: - I am using imaps (so SSL encryption is used) - I am using a imap server directory - I am not using IMAP namespaces (and disabled them completly) The training.dat file gets bigger and bigger, when I mark messages as junk, so at least this is working. But no automatically detection is running and the junk mail log keeps empty all the time. A manually tagged messages gets detagged when running junk control manually with this message (but no logging?!). When I leave this folder and enter it again, the detagged messages is still shown as tagged. This seems to be a new behaviour with the latest nightly (2003030222). I would heavily recommend to fix this bug until 1.3 is released.
Per comment #10 my training.dat file also grows larger but only if I manually mark messages as junk. I tested this out inadvertantly by not marking any messages I received for several days as junk and the training.dat file didn't change. I then manually marked a few messages and sure enough it grew bigger. But also as described in comment #10 and in the other comments no messages are every automatically marked and if I run the junk filter marked messages are unmarked. I am also using IMAP without SSL but otherwise have left all my IMAP settings on the default values including namespace mapping.
I was the initiator of this bug report. Since writing it, I've seen numerous additional comments from people suggesting the bug might be linked to their IMAP mail server. When I wrote my initial bug report, I was using POP rather than IMAP for email. So it seems that both email standards can generate this bug.
OS: Windows XP → All
I can attest that this is also an issue in Win2k and FreeBSD builds. I wondered if it was just me until I checked in here.
Inspired by comment 9 I decided to try an experiment. Although I use IMAP I only have a single folder (inbox) that actually has content. I made sure all the other folders were empty and then I moved the entire contents of the inbox into a local folder. This should mean that there are now no headers in my mailbox having any relationship to Mozilla. I then killed all instances of mozilla and restarted. Unfortunately the result is the same 'no junk marking' behavior described by everyone on this list. Perhaps there is other IMAP information being stored some place on the server other than the e-mails?
Well, I do not know, what is happening here now. Just some minutes ago, the spam tagging seems to start to work. I got 3 false positives (at least it does something) and the logfile shows these messages. My guess about this is: Junk filtering seems to work with my nightly build (which I have installed about 4 days ago) and does not work with the official 1.3b here. I know junk filtering needs some learning time, but I used 1.3b for several weeks without any success. I'll watch it the next days, we will see, if junk filting will filter some real spam message.
The problem seems to be fixed for me with the latest nightlies (at the moment I am using 2002020222). Junk filtering started working after some days of learning time and is working correctly now.
I just installed the official 1.3 release and nothing has changed. Junk Filtering is still completely non-functional. Just for kicks I created a new profile and re-entered all of my mail configuration information to see if maybe my profile is corrupted but that changed nothing, the filters still didn't work.
*** Bug 194621 has been marked as a duplicate of this bug. ***
With the official release 3.1, junk filtering stopped working for me. But BugID <a href="http://bugzilla.mozilla.org/show_bug.cgi?id=188232">188232</a> gave me a hint and finally I was able to fix the problem. This is what I did: 1.) Deleted (moved) training.dat, so a new training.dat will be generated 2.) First marked two non junk mails and selected "Mark as non junk" 3.) Selected all existing junk mails and mark them as junk 4.) Restarted mozilla and waited for the first mails appearing and, voila, junk mail detection is working now. I do not know, why the existing training.dat did not work even I marked some non junk mails as non junk like in step 1 above. So, maybe this bug is duplicate of 188232, at least I think it will be related for many users. Just give it a try.
Unfortunately, this didn't work for me - several times, starting from the initial landing of JMC, I have completely retrained the filter by deleting training.dat, marking a corpus of 300 mails as 'Not Junk', then marking am spam corpus of approx. 300 mails as 'Junk' - actually, last time I tried was yesterday, with a current CVS build. I'm sure training was successful, since starting JMC manually yields correct classification. But JMC is still not run upon fetching new mail.
The trick worked for me. What I did: 1. Delete training.dat 2. I selected ALL mails in my inbox (which contained about 100 mails, most of which were junk) and marked them as NOT JUNK. 3. I then completely closed down Mozilla (both browser, mailer, etc.) 4. I restarted Mozilla and went to mail where I manually marked Junk mails as junk but didn't delete them. 5. I then waited for new mail to come in. Sure enough, the junk mail folder kicked in and marked appropriate mails as "junk" and moved them to my Junk folder. 6. I then deleted all the original Junk mails (the ones from step 4) from my inbox. So far things seem to be operating normally. So at least in my case running the stable release of Mozilla 1.3 on Linux the problem does seem to be the previously described training error. Note, however, that I did not view my training.dat file to determine if I had the zeros before I executed the previously described fix.
I can confirm the workaround on 7 different installations, on 4 different machines, all windows 2000. - 1 installation was official 1.3a - 2 installationa was official 1.3b - 4 installations are 1.3 final Before reading this I've solved the problem passing the training.dat coming from an installation where junk filter was working. The working installation was a Mozilla 1.3b official release. On that installation maybe I've marked some message as non junk before beginning marking junk mail. Now I've tried the workaround proposed: - Mozilla started - training.dat deleted - Mail&News started - First fo all, marked a non-junk message as NON JUNK - Mozilla and Mail&News restarted - Marked some junk message AS JUNK - The filter is now working Maybe would be a good idea to release an empty but working trainig.dat file...?
mass re-assign.
Assignee: naving → sspitzer
Has anyone seen this with a trunk build dated 20030324 or newer? In these builds, bug 194238 was fixed.
bug 194238 is resolved as fixed on 2003-03-15. Reporter (Erik Marcus), please test with a newer build. Resolve this bug as dupe of 194238 if junk filter works for you.
This seems to be happening with mozilla 1.5 release version. I thought I noticed it with the 1.5 preview but now i'm sure its not happening with moz 1.5 release.
I use Mozilla 1.5 release on Windows 98 with IMAP. The junk filter does not catch incoming mail ("Enable junk mail controls" is selected), only when I do "Run Junk Mail Controls on Folder" from the menu.
I have no idea why, but now it works, although I still use the same version.
Could any reporters here actually be seeing bug 219975? If arriving mail is being filtered out of the Inbox, and into the folder being viewed, those messages will not be filtered with JMC.
no response from reporter (Erik Marcus) to comment 26 -> wfm
Status: NEW → RESOLVED
Closed: 21 years ago
Resolution: --- → WORKSFORME
Product: MailNews → Core
Product: Core → MailNews Core
You need to log in before you can comment on or make changes to this bug.