1297763 - email sent from an address in mailman "Sender filters" to be automatically discarded unexpectedly held for moderation

Status: RESOLVED INVALID

(Infrastructure & Operations :: Infrastructure: Mail, task)

Description

[Wayne Mery (:wsmwk)]

dev-apps-thunderbird is an unmoderated list, open to posting from non-subscribers.

[e-mail] is in https://lists.mozilla.org/admin/dev-apps-thunderbird/privacy/sender "List of non-member addresses whose postings will be automatically discarded".

But messages from this address are not being discarded.  https://lists.mozilla.org/admindb/dev-apps-thunderbird?details=all shows the emails from this address which have been held for moderation.  (note, this happened before I added ^.*@c40foolprooflist\.biz to the end of the sender discard list)

So I am wondering why. And, whether https://lists.mozilla.org/admin/dev-apps-thunderbird/privacy/spam is taking precidence because the held messages do meet the criteria spam rule 4 and 5.  It would be unfortunate if the spam rule takes precidence.

Comment 1

[Wayne Mery (:wsmwk)]

Still accumulating moderation requests for [e-mail]

Comment 2

[Wayne Mery (:wsmwk)]

Chris do you have any insight on how mailman does/should behave in this area?

I haven't found anything that discusses precedence of privacy categories. Even http://www.list.org/mailman-admin/node20.html

Comment 3

[Chris Ilias [:cilias]]

(In reply to Wayne Mery (:wsmwk, NI for questions) from comment #2)
> Chris do you have any insight on how mailman does/should behave in this area?

Not really. I rarely create filters to auto-discard spam. The lists I moderate get so many different kinds of spam, I find creating filters for specific spam addresses not worth it. I just delete the notifications, and once a day, purge the moderation que.

I do know that the filters in /privacy/sender/ don't apply to incoming newsgroup messages, which is why I usually use /privacy/spam/.

I'll add [e-mail] to the /privacy/sender/ filters on the test mailing list, and see what happens.

Comment 4

[Wayne Mery (:wsmwk)]

This is still happening. This morning I have 

Pending posts:
From: [e-mail] on Fri Sep 16 20:18:39 2016
Subject: Welcome To The Team
Cause: The message headers matched a filter rule

Comment 5

[Ed Lim [:limed]]

I can ask mailman about this, I am unsure if there is a precedence for that non-subscriber vs spam list. If this is becoming a problem I have no issues just blacklisting the c40foolprooflist.biz domain as well if it truly becomes an issue

Comment 6

[Ed Lim [:limed]]

It appears that spam checks do take precedence

Comment 7

[Chris Ilias [:cilias]]

I added [e-mail] to https://lists.mozilla.org/admin/test/?VARHELP=privacy/sender/discard_these_nonmembers a couple of days ago, and that seems to have worked on today's batch.
Note that the latest ones us admin@ instead of contact@

Comment 8

[Wayne Mery (:wsmwk)]

Thanks for double checking all this for me.  I can't believe one can't simply blacklist an address in mailman, and I don't find a bug report on it at https://bugs.launchpad.net/mailman

(In reply to Ed Lim [:limed] from comment #5)
> I can ask mailman about this, I am unsure if there is a precedence for that
> non-subscriber vs spam list. If this is becoming a problem I have no issues
> just blacklisting the c40foolprooflist.biz domain as well if it truly
> becomes an issue

I have no desire to deal with these addresses on a daily basis. So it would be great if were to blacklist the domain

Comment 9

[Wayne Mery (:wsmwk)]

filed https://bugs.launchpad.net/mailman/+bug/1625599

Comment 10

[Wayne Mery (:wsmwk)]

https://bugs.launchpad.net/mailman/+bug/1625599/ states mailman's behavior is intentional and working as designed. Citing from the bug ....

If you want to do membership tests (moderation and non-member tests)
before header filter rules, you can configure that by putting the
following in mm_cfg.py.

GLOBAL_PIPELINE.remove('Moderate')
GLOBAL_PIPELINE.insert(GLOBAL_PIPELINE.index('SpamDetect'), 'Moderate')

You could also address this with a header_filter_rules rule of the form

regexp: ^From:.*\WX@Y\.Z(\W|$)
action: discard

ahead of your other rules.