Open Bug 1366461 Opened 7 years ago Updated 2 years ago

Filter Log not updated when rule is run "before junk"

Categories

(Thunderbird :: Filters, defect)

52 Branch
defect

Tracking

(Not tracked)

UNCONFIRMED

People

(Reporter: mymail2013, Unassigned)

References

()

Details

User Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:53.0) Gecko/20100101 Firefox/53.0
Build ID: 20170504105526

Steps to reproduce:

- Create a filter to move mails received in the Inbox to Trash under some condition like "Subject" contains the word "deal"

- At filter rule creation/modification time, use default options for the "Apply filter" ticked ON:
1 - When manual execution
2 - When receiving mail + Filter BEFORE check of Junks

- Activate the Filter log
- Receive a mail that contains "deal" in the Subject


Actual results:

The Filter log does NOT log the triggered filter action


Expected results:

Instead:
- At filter rule creation/modification time,  use these options for the "Apply filter" ticked ON:
1 - When manual execution
2 - When receiving mail + Filter AFTER check of Junks

The Filter log will be updated with the triggered filter action
Group: mail-core-security
I'm a little confused by this report.

So you're saying that a "before junk" filter on the subject moving a message to the trash doesn't report the action in the log. However, an "after junk" filter does report the action as it should, right?

Are you receiving the message into an IMAP inbox or via POP? If it's an IMAP inbox, is it synchronised for offline use? Please provide this information since we don't want to test all possible variations.
A "before junk" filter on the subject (or from or else) moving a message to the trash doesn't report the action in the log. However, an "after junk" filter does report the action as it should, right?
-> Yes this is what I am saying and have verified.

To receive the mails from my different provider accounts I use their POP servers.

It's easy to reproduce:
- set up a filter with default options "When receiving mail + Filter BEFORE check of Junks" with a given tag in the subject to move the message to the trash folder,
- activate the log
- send to yourself a message with this tag in the subject
- receive mails
- check that the filter worked and if the log reflects the filter action(it does NOT for me)

Then
- modify the filter option "When receiving mail + Filter AFTER check of Junk"
- resend to yourself the message with this tag in the subject
- receive mails
- check that the filter worked and if the log reflects the filter action(it does for me)

Please note that a MANUAL execution of the filter(s) is NOT concerned by this issue.
Hmm, I can't reproduce this. I have a filter that moves read receipts (Read: or Gelesen: etc.) to the Trash.

Here's the filter log:
[20/05/2017, 19:32:24] Applied filter "Junk Receipts" to message from Jörg Knobloch <jorgk@jorgk.com> - Gelesen: huhu at 20/05/2017, 19:32:14 deleted

[20/05/2017, 19:35:24] Applied filter "Junk Receipts" to message from Jörg Knobloch <jorgk@jorgk.com> - Gelesen: huhu2 at 20/05/2017, 19:35:18 moved message id = 9f61f162-3f4d-fe09-778c-df5772f3d744@jorgk.com to mailbox://jorgk%40jorgk.com@mail.jorgk.com/Trash

Between two executions I changed the rule from "Delete" to "Move Message to Trash".

There must be something special on your system. Do you get the undesired effect when you switch off all add-ons, see Help menu?
I have de-activated all extensions (ImportExportTools & Toolbar Buttons) and plugins (none active).

Turned my test filter to "When receiving mail + Filter BEFORE check of Junks" and no item in the log file.

Turned back this filter to "When receiving mail + Filter AFTER check of Junks" and yes, the item is in the log file.

[20/05/2017 20:01:41] Filtre « Sujet contient : test de filtrage 1 » appliqué au message de mymail2013@orange.fr - test de filtrage 1 le 20/05/2017 20:01:27 message id = fe5faa07-d5f4-e9c1-684f-d91f0c0fcbd2@orange.fr déplacé vers mailbox://nobody@Local%20Folders/Trash

I do not recall any particular set up for Thunderbird, always used standard install. I just have a dedicated location for the files "F:\Documents\@Dossier de stockage Thunderbird" for years.

Too bad you can't reproduce. I will ask some people to make this test on a PC forum I use to read & post.
With the US English version:
[20/05/2017 21:33:26] Applied filter "Mot TESTFILTRE dans le sujet" to message from mymail2013@orange.fr - Ceci est le mot TESTFILTRE at 20/05/2017 21:33:19 moved message id = bed9dd9e-ddb8-28e2-7fcb-2f138f3eaade@orange.fr to mailbox://nobody@Local%20Folders/Trash
Hmm, is this the "after junk" version that always works or the "before junk" version that doesn't work for you?
Correct
Sorry,
This the "after junk" version that always works and the "before junk" version that doesn't work
Well, we seem to be misunderstanding each other here.

I asked:
is this the "after junk" version that always works *or* the "before junk" version that doesn't work for you?

We established that "after junk" always works for you, so the log in comment #5 is from running the "after junk" rule or are you trying to say that in the en US version, the "before junk" rule also works. Please clarify.
Indeed, we do not understand each others very well.

The question you ask:
"is this the "after junk" version that always works *or* the "before junk" version that doesn't work for you?"
does not make sense to me as I would rather expect a question like:
"is this the "after junk" version that that doesn't work *or* the "before junk" version that doesn't work for you?"

To answer your question for each part of it, as I wrote:
1 - this the "after junk" version that always works (there is no problem here, that's ok, no issue, it works)
*and*
2 - the "before junk" version that doesn't work (this is where is the issue, this is the problem I'm experiencing)

I did not comment anything about the US Version of the log I added, this was just to match your English examples and show and English example too instead of the French one.
On the other hand, if it's too complicated to exchange about this little simple thing, it's not a big deal for me to step back and cancel this report, as I know what's the workaround for this misbehavior. FYI, I replaced all type="17" by type="48" in my rules file to change this "before" by "after" to make the log working.

I've spent a lot of time testing, identifying, reporting, asking for test with descriptions an so on here and in the other forum.
If I get updates from other people, I will let you know. You can make it invalid if you think you do not have the full comprehensive picture.

Thanks & Best Regards
FYI, at present time, there is one person who did the test I detailed to reproduce and reports the same (mis)behavior as the one I describe in this ticket. (It's in French, do you want the link of the discussion ?)

Other people will hopefully do this test and if so, I will advise whether or not they faced the same issue.
(In reply to JP from comment #12)
(It's in French, do you want the link of the discussion ?)
Oui, je parle français ;-)
A 2nd tester says he always got the log for the 2 options (no problem for him). And a third one reports several issues, not easy to conclude precisely about the log in this case.
The issue I reported is on my desktop with an installed version of Thunderbird.
I also have a laptop with the portable version of Thunderbird.
Testing on the laptop gives the same result, i.e. no log for the option "Filter before...".
At least for me it is consistent.
Thanks for persisting with this issue. As I said, the filter log works for me. I looked through the French forum posts and people don't state whether they use POP or IMAP. The processing in TB is completely different. I tested POP and I know you're using POP, but I don't know what the forum posters are using.

BTW, is this the only filter for this account? Maybe there are side effects of another filter execution. I'm happy to fix the bug, if I could only reproduce it. So someone needs to find a reproducible case. Not to be understood as criticism: Instead of getting others involved where we don't know their exact setup, it might be better to work on your own setup and narrow down the problem.
Note that I have no process for these junk mails. BTW I do not understand what is behind this "Filter before junk" or "Filter after junk" option. I do not see any option in the Thunderbird menus that would filter the junks, except by pro-actively creating a filter and taking the condition from the junk status in the list. And in this case the "Filter before junk" or "Filter after junk" would contradict the filter logic which is to be processed in sequence based on their rank in the list.
Ok let's give up. It might really be very complex to look at Thunderbird code so you requests proofs of proofs :)
I have the issue on my 2 PCs, different systems and different installations of the soft, but I will take your assumption that this is a configuration issue :)).
Cheers
JP
Junk filtering in TB is a complicated matter, but there is a system you can train to detect junk, Tools > Account Settings, Junk Settings.

So of course you need to decide whether a filter runs before or after the internal junk filter. Manual run is always an "after junk" run, only "before junk" is different, as you experienced. "Before junk" happens as the message is received and not "incorporated" into a mailbox yet, "after junk" always runs on a folder into which the message was placed already. If you use "after junk", you need to compact your inbox since all messages will pass through the inbox before they are moved elsewhere. If you use "before junk" the message goes to the desired mailbox (or trash) straight away.

So far my assumption has to be that there is a problem influenced by individual configuration (since it works for me an one poster to the forum). Unless we can find the cause, I won't be able to fix it, and sadly I have no time to experiment myself. I have at times done remote sessions on user's machines to pin-point problems in the past.
I'm so surprised with myself that I've only used one of two magic spells ;-)
The first one is "Try with add-ons disabled", the second one is "Try in a new profile" (start Thunderbird -p to create one).

So please try on a new profile.
Summary: Filter Log not updated → Filter Log not updated when rule is run "before junk"
If you cannot reproduce, indeed it's not easy.
Anyway, this is not important at all, no worry.
Thanks for your time.
Best Regards
JP
Status: UNCONFIRMED → RESOLVED
Closed: 7 years ago
Resolution: --- → INVALID
Summary: Filter Log not updated when rule is run "before junk" → Filter Log not updated
Hmm, you have time to communicate on a forum and not five minutes to set up a new profile to try it? After that, I'll mark it invalid? Take your time ;-)
Status: RESOLVED → UNCONFIRMED
Resolution: INVALID → ---
Summary: Filter Log not updated → Filter Log not updated when rule is run "before junk"
OK I will. I'm not at home for 1 week or 2. I should have regular internet in 3 days.
On my laptop, I have launched the portable version of Thunderbird with the option -p and indeed the filter action while receiving mails is now logged in the log file.

As I am not sure what this option is for, can I run it as well on my desktop PC which contains all my accounts, folders and mails without breaking anything ?
With the -p option on the portable version, there is no prompt at opening time and I keep my accounts and folders.
With the -p option on the installed version, I am prompted to create (or rename or delete) a new profile but, of course when creating a new profile I loose everything.
So I don't know why this difference between the 2 versions and what was actually done in the portable version with the -p option that affected the log.
We don't support the portable version. In the installed version, you can create a new profile and use it for a while for testing. I have 5+ profiles and never lost anything. When you're done with testing, remove the testing profile.

You can create a new POP profile for testing, just make sure you download all e-mail to the "production" profile before you do. Then configure the new testing profile to leave messages on the server, so you can still download them in the production profile later.
Using a brand new profile with 1 account for test on the installed version, the log is indeed written for the "Before junk" default option.
with 1 POP account for test
Yes, as your survey already showed, the log works for some/most people. So it would really be good to know what the condition is that makes it fail.
And just to confirm, back to the initial profile testing again, the log is NOT written for the "Before junk" default option.
Up to you, if you consider this has more than a tiny importance and wish to investigate, I can grant you access to my PC whenever you wish (Teamviewer or other) or send you any part of my 3GB profile that could be isolated.
As I am using quite a lot the filters to push the spams into the trash with precise and controlled criteria, I have accumulated plenty of filters along the years. This is why I had to make an Excel 2013 tool to report on the filters activity and clean up those which appear not to be used anymore (works for French & English only so far, parsing of the log is language dependent).
Here it is: https://forum.pcastuces.com/thunderbird_5211_journal_de_filtrage_vide-f23s37684.htm?page=1&#5687512
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.