1467047 - I use the Message filter of greater than days with a 7 setting and it does not filter existing messages when new messages come in

Status: VERIFIED DUPLICATE of bug 864187

(Thunderbird :: Filters, defect)

Description

[Jarrod]

Attachment: CronJobEmail.png

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0
Build ID: 20180516032328

Steps to reproduce:

I create a new message filter , on my mailbox , Apply filter when set ticked on Manually and Getting new mail I then set match all the following in the drop down i use "Age In Days" ---- "is greater than "  and a value of "7 "    I choose "OK" and in message filters I set filer logs on and clear them , I return to run selected filers on my "INBOX" and  I click "Run  NOW"   later once tested I will set flagged as read to Delete 


Actual results:

I check the Filter Logs and have no entries , No messaged flagged as " Read" in my inbox ,


Expected results:

All messages older than 7 Days should be flagged as read and there should be filter logs entries with all the ones flagged,

Comment 1

[Jarrod]

Attachment: CronThunderrelease.png

Version Branch As per Help About

Comment 2

[Wayne Mery (:wsmwk)]

Can you screen shot the filter?
Reproduces in safe mode? 
  https://support.mozilla.org/en-US/kb/safe-mode-thunderbird

Comment 3

[Jarrod]

Attachment: Filter Safe mode logs not showing that filter worked .

Result of Filter Manual Run does not show records of what filter was run.

Comment 4

[Jarrod]

Attachment: Filter set to mark greater than (Days) to Unread ( production Delete)

When running filter manually the Logs do not show messages that have been changed by the filter , especially delete

Comment 5

[Jarrod]

Attachment: The Filter used that does not show up in Filter log.( but does delete in Safe mode but no Log info )

If I run this filter manually  they  are deleted (in Safe Mode ) BUT do not show up in the filter logs .

Comment 6

[Wayne Mery (:wsmwk)]

pop account? Or imap?

Comment 7

[Jarrod]

I map Account , It seems that it will not automatically do the rule ,

Comment 8

[Jarrod]

Sorry the prev may not have been clear    IMAP   account

Comment 9

[Wayne Mery (:wsmwk)]

Jarrod, can you reproduce this on a test of a folder under Local Folders?


> If I run this filter manually  they  are deleted (in Safe Mode ) BUT do not show up in the filter logs .

Aceman, does this ring a bell of an old or still open issue?

Comment 10

[Wayne Mery (:wsmwk)]

Jarrod.

Can you reply please to comment 9 and also report results of using version 60??

Comment 11

[Jarrod]

I have the rule to delete old message that are more than a week old and it doesnt seem to delete them automatically when mail comes into the box , I have set it to delete messages older than 2 days and i still have messages older than 5 days and i do not see anything in the log , This is on version 60.0 32 bit  latest and i am on the release Channel

Comment 12

[:aceman]

Wait, you expect new (just incoming) messages be deleted immediately based on this rule?
Maybe the "age" of a message is determined on how long it already is in you mailbox, not on their (sometimes fake) Date header.
I'd need to check the code.

Also, you say when you run the filter manually on a folder, then messages are deleted correctly?

Comment 13

[Jarrod]

I have a rule on my mail box in Version 60 , 
apply filter on getting new Mail:

match all of the following 

Age in Days ... is greater than  ............. 2 



Perform action 
Delete message .



What I expected  
I have a external Cron service that sends me a message every Hour for the full 24 hours a day every day 24/7, 

So every hour a new message is received and the rule should run and delete all messages that are in my box that are older than 2 days keeping a record of those incoming mails from now back for 2 days . no extra messages past 2 days , 


If I look in my mail box I have more than 10 days of messages and if i ook later no messages are deleted and the box fills by 24 messages a day , it should stay constant at 48 messages Approx , 

If i run it manually they are deleted .

Comment 14

[Jarrod]

"Comment 9 :   Jarrod, can you reproduce this on a test of a folder under Local Folders?" 

My mail comes into my mail box and I would like to delete them automatically from the mail box as I access this Mail box from multiple machine and multiple places ,  How would i get to my mail in the local folders "A" from   another site or machine "B" 
So loading the messages to a local folder will not suit my application the Cron Log Service i am running.

Comment 15

[Jarrod]

If I run Manually in the log i get that the filter was Applied and the mail was actually deleted .

If I leave the mail box and come back to it then it has no entries in the log and no messages are deleted .


LOG:
[2018-10-01, 12:24:38] Applied filter "Cron Service [e-mail]" to message from "(Cron Daemon)" <[e-mail]> - Cron <iotguotj@trunks> links http://www.iotguru.co.za/client_area/notificationsend.php at 2018-09-29, 12:00:04 deleted   ....... 
                                       multiple deletes 

I thought that when i opened up my mail again it would check that there are new incoming messages and run the filter and delete the messages leaving only 48 messages in the box for me to check. 

regards

Comment 16

[:aceman]

(In reply to Jarrod from comment #13)
> So every hour a new message is received and the rule should run and delete
> all messages that are in my box that are older than 2 days keeping a record
> of those incoming mails from now back for 2 days . no extra messages past 2
> days , 

Aha. So no, the filter will only apply on the one incoming message, not on others lying in your inbox already. What you expect is not how the incoming filters work.
To re-check existing messages, you must run the filters manually, which you say does work.

So to get the result you want, we actually need time based/periodic filters.
This is already covered by bug 864187.

Comment 17

[Jarrod]

I am not Sure I agree with you entirely , 

If I set the Apply filter when :   -->   getting New Mail  

Then Shouldn't my Filter run when I get new mail in my box , 
So if I open Mozilla fresh it gets mail and if there is new mail for that boxes filter it should trigger the filter and delete my old mail , Just like I clicked the manual button.

If i have the mail box open and i get new mail then it should trigger the filter on new incoming mail.

Simply put Triggering the filter would be the same as Clicking the manual button After i have opened up Mozilla from it being closed an it receives new mail into my box .. then the App should run the filter just like i clicked the manual button. 

If i leave Mozilla open and new mail comes into that box then it should trigger the filter ( run the same method as the manual button click ) 

Do other filters not trigger when I receive new mail , 

I am Confused , Help me out ..

Comment 18

[:aceman]

(In reply to Jarrod from comment #17)
> I am not Sure I agree with you entirely , 
> 
> If I set the Apply filter when :   -->   getting New Mail  
> 
> Then Shouldn't my Filter run when I get new mail in my box , 

Yes it does, but only on the just received messages, NOT old existing ones.

> So if I open Mozilla fresh it gets mail and if there is new mail for that
> boxes filter it should trigger the filter and delete my old mail , Just like
> I clicked the manual button.

No.
 
> If i have the mail box open and i get new mail then it should trigger the
> filter on new incoming mail.

Yes it does, but only on the just received messages, NOT old existing ones.
 
> Simply put Triggering the filter would be the same as Clicking the manual
> button After i have opened up Mozilla from it being closed an it receives
> new mail into my box .. then the App should run the filter just like i
> clicked the manual button. 

No, the filters are not designed this way and they intentionally only run on the just received messages.
For many people running these filters on all messages would be slow and even dangerous to remove messages unexpectedly.
 
> If i leave Mozilla open and new mail comes into that box then it should
> trigger the filter ( run the same method as the manual button click ) 

No.
 
> Do other filters not trigger when I receive new mail , 

Only those trigger that have "Apply filter when: --> getting New Mail" set.

Comment 19

[Wayne Mery (:wsmwk)]

Aceman is absolutely correct :)

Comment 20

[:aceman]

(In reply to Jarrod from comment #17)
> If i leave Mozilla open and new mail comes into that box then it should
> trigger the filter ( run the same method as the manual button click ) 

What if no new mail comes in? Do you not want the filter to run and clean up old messages automatically even in that case?

That is why we implement those triggers (incoming email and periodic run) separately so that the user can choose what he wants (you can set the same filter to run at both events).

So the periodic runs are to be implemented in bug 864187.

Comment 21

[Jarrod]

(In reply to Wayne Mery (:wsmwk) from comment #19)
> Aceman is absolutely correct :)

Only those trigger that have "Apply filter when: --> getting New Mail" set. 

My filter is set to "Apply filter when: --> getting New Mail" set.

Comment 22

[Jarrod]

(In reply to :aceman from comment #20)
> (In reply to Jarrod from comment #17)
> > If i leave Mozilla open and new mail comes into that box then it should
> > trigger the filter ( run the same method as the manual button click ) 
> 
> What if no new mail comes in? Do you not want the filter to run and clean up
> old messages automatically even in that case?
> 
> That is why we implement those triggers (incoming email and periodic run)
> separately so that the user can choose what he wants (you can set the same
> filter to run at both events).
> 
> So the periodic runs are to be implemented in bug 864187.

Yes what my filter is trying to do is just leaving the last 2 days of messages in my mail box , 
I suppose its the same as Archiving all messages older than 2 days , but in my case i delete and not archive , 

So I always just have 2 days of messages with Alert in the subject.

My period is on new mail coming in delete any more than 2 day old mail  .

Comment 23

[Jarrod]

(In reply to :aceman from comment #16)
> (In reply to Jarrod from comment #13)
> > So every hour a new message is received and the rule should run and delete
> > all messages that are in my box that are older than 2 days keeping a record
> > of those incoming mails from now back for 2 days . no extra messages past 2
> > days , 
> 
> Aha. So no, the filter will only apply on the one incoming message, not on
> others lying in your inbox already. What you expect is not how the incoming
> filters work.
> To re-check existing messages, you must run the filters manually, which you
> say does work.
> 
> So to get the result you want, we actually need time based/periodic filters.
> This is already covered by bug 864187.

I see a result that when i run it manually it goes through my Whole mail box and applies the filter to old and new mails,
Will the filter only be applied to the "one" new mail coming in to the Mail box.
I thought the filer applies to all mail in the box , or does it only apply filters to all mail in the box when you run it manually.

Comment 24

[:aceman]

(In reply to Jarrod from comment #23)
> I see a result that when i run it manually it goes through my Whole mail box
> and applies the filter to old and new mails,
> Will the filter only be applied to the "one" new mail coming in to the Mail
> box.

Yes, the filter only applies to the ONE message currently incoming.

> I thought the filer applies to all mail in the box , or does it only apply
> filters to all mail in the box when you run it manually.

When you run the filter manually, it applies to all messages in the folder.

If you do not want to trigger the filters manually but have TB do it for you automatically in some period, you want bug 864187 :)