1303132 - Trying to find source of duplicate emails.

Status: RESOLVED FIXED

(Infrastructure & Operations :: Infrastructure: Mail, task)

Description

[Justin Dolske [:Dolske]]

Attachment: email headers

I admin/moderate the [e-mail] list. Recently I've noticed that when a particular person is posting an update, the list is getting 2 duplicate messages.

The author is sending a single message in Thunderbird, to [e-mail] and the newsgroups mozilla.dev.platform and mozilla.tools.

The email headers (attached) of one of the duplicates seems to indicate it's coming in by way of the mozilla.tools group. There's a "To: [e-mail]" header that's not in the other (which looks like a normal email to firefox-dev).

jlin took a look, but doesn't see firefox-dev subscribed to the mozilla-tools@ list (which was my guess), so I'm not sure what's causing this duplicate to be sent to firefox-dev. Ultimately I would like to stop this. :)

Comment 1

[Jonathan Lin - Not watching NI/offline [:jlin] [[e-mail]]]

the lists in question are

https://mail.mozilla.org/listinfo/firefox-dev

and

https://lists.mozilla.org/listinfo/tools

Comment 2

[Justin Dolske [:Dolske]]

Attachment: normal headers

Oh, and just in case it's useful, here are the normal headers from the expected email.

Comment 3

[Wayne Mery (:wsmwk)]

aryx wrote on irc "the sheriffs mailing list" had multiples. I don't know details

Comment 4

[Ariel Poliak]

This is still occurring on at least one list ([e-mail]):
```
Received: from mail-qt0-f197.google.com (mail-qt0-f197.google.com
	[209.85.216.197])
	by mailman1.mail.scl3.mozilla.com (Postfix) with ESMTPS id 3AA5EC0216
	for <[e-mail]>; Mon,  3 Oct 2016 22:01:56 +0000 (UTC)
Received: by mail-qt0-f197.google.com with SMTP id 38so130477065qte.0
	for <[e-mail]>; Mon, 03 Oct 2016 15:01:56 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
	d=1e100.net; s=20130820;
	h=x-original-authentication-results:x-gm-message-state:subject:to
	:references:from:message-id:date:user-agent:mime-version:in-reply-to
	:content-transfer-encoding;
	bh=UdgXynNLIjsSr9HkFTXPOu9qHDbUFxmR4XWWmCba4p0=;
	b=aFBMLPfDSb1kxDwqFB5QLu6VgJKtjhV/EH2/eDI88oV/Hwc9xPneZ3XxP4Zh5EjKc8
	wkmYGVmreDmJHBA3zcNkr+GDdy3wi1LAzQHYSbXIRlCGpw4VOdvx1HXSS1Pi+WlKtHux
	ejYl3T06MIzxyZ2Qzu82FC5r8c5rtQesKptzmCDW3YAkSKwfhMeMkLi77bQzwDr7vhwX
	94o+fYfPciRyJo9kLhcLqCJORi7woTCinLBHuHcrTeChOtvOVvXz2ReNTLyeCpEa7f44
	jWpHCQph+CFg/BpSxLIq4ijK+KCEnGQ3Haryh62lPL9Ttw0YuZjLnnZtPanKLmpnHVVu
	cCmw==
X-Original-Authentication-Results: mx.google.com;
	spf=pass (google.com: domain of
	[e-mail] designates 177.86.143.130 as
	permitted sender) smtp.mailfrom=[e-mail]
X-Gm-Message-State: AA6/9RnTdq+snpBhGo397PcBV2TFaEio/oBpI0n4tBQ2jIrozycIL8xpGPZc0S7mhp1CtCM2dr/DMfTL7qR8G8mDROAUkUf/HKN3qYkZjPTkZ/PdEdRooTOnYqH0g4xED6a+cXesyVgvS9fa+lcuCDSSuEEQ6rPGiILQMJpdiVUfOErxzR7fq6ZTs/GCwNqLc8aQnVoa+sPJCBQKFKpG
X-Received: by 10.55.111.2 with SMTP id k2mr307317qkc.188.1475532115224;
	Mon, 03 Oct 2016 15:01:55 -0700 (PDT)
X-Received: by 10.55.111.2 with SMTP id k2mr15054685qkc.188.1474023259168;
	Fri, 16 Sep 2016 03:54:19 -0700 (PDT)
Received: from hades.almg.gov.br (hades.almg.gov.br. [177.86.143.130])
	by mx.google.com with ESMTPS id y34si7882506qta.127.2016.09.16.03.54.18
	for <[e-mail]>
	(version=TLS1 cipher=AES128-SHA bits=128/128);
	Fri, 16 Sep 2016 03:54:19 -0700 (PDT)
...
Message-ID: <[e-mail]>
```

Looks like messages are bouncing within Google's infrastructure (MX for mozilla.org is Google), finally ending at the Mailman server.
This may need to be addressed at Google's end (unless something like https://mail.python.org/pipermail/mailman-users/2002-January/016687.html is implemented)

Comment 5

[Andrew Sutherland [:asuth] (he/him)]

I think comment 4 might be referring to bug 1302978 (which is also happening for "List-Id: WebVR Discussion <web-vr-discuss.mozilla.org>") which seems to be a different problem than comment 0.

Comment 0 sounds like a multi-path problem that results in duplicates immediately rather than messages being duplicated 2+ weeks later.

Comment 6

[Ariel Poliak]

(In reply to Andrew Sutherland [:asuth] from comment #5)
> I think comment 4 might be referring to bug 1302978 (which is also happening
> for "List-Id: WebVR Discussion <web-vr-discuss.mozilla.org>")

At first glance, both bugs looked about the same issue, so because this one mentioned the source of the duplicates, I posted here.
I'll post this there as well, if it's where it should go.

Comment 7

[Justin Dolske [:Dolske]]

Yeah, this bug is about a specific issue with messages to mozilla-tools immediately duping on firefox-dev. Getting dupes unrelated to mozilla-tools weeks later is a different issue.

(Although, FWIW, that issue _also_ hit firefox-dev over the weekend. Service Desk had me file INC0021401, but there have not yet been any updates there.)

Comment 8

[Ed Lim [:limed]]

So it looks like there are 2 messages that I managed to track down that is causing the duplicates and in both cases the header looks like this:

to: [e-mail]
X-Original-To: [e-mail]

As you mentioned or at least what I'm seeing is mail is intended to go to [e-mail] but also ends up to [e-mail]. All other emails seem to be sending normally?

CC'ing sender of emails, :armenzg I'm curious how are you sending these emails? "Subject: Usability improvements for Firefox automation initiative - Status update #4" and "Subject Usability improvements for Firefox automation initiative - Status update #5". I'm curious as to why your header looks like that

Comment 9

[Armen [:armenzg]]

I use Thunnderbird.

In the email I set the field "Newsgroup" for mozilla.tools and mozilla.platform while firefox-dev@ I use the "To" field.

I could use "To" for all the fields if prefered (and use instead firefox-dev@, tools@ and dev-platform@)

Comment 10

[Ed Lim [:limed]]

(In reply to Armen Zambrano [:armenzg] (EDT/UTC-4) from comment #9)
> I use Thunnderbird.
> 
> In the email I set the field "Newsgroup" for mozilla.tools and
> mozilla.platform while firefox-dev@ I use the "To" field.
> 
> I could use "To" for all the fields if prefered (and use instead
> firefox-dev@, tools@ and dev-platform@)

If thats possible yea, it seems like its sort of causing duplicate emails (although duplicate isn't a big issue) it does cause some confusion.

Comment 11

[Greg Cox [:gcox]]

Since mailman and the nttp gateway have been decom'ed (AND it sounds like it was sorta-resolved before), closing this out.