379415 - lists.mozilla.org lists are sluggish (delays of up to 8 hours)

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

This is similar to bug 372009, but I'm filing a new bug.  I probably should have noticed this before Damon mentioned it to me, since my 8AM moderation messages were coming through very late today (and maybe yesterday too).

Messages sent to lists on lists.mozilla.org are taking a long time to get through.  Damon's message yesterday to dev-planning was stuck for 3 and a half hours before hitting mailman and another 4 and a quarter in mailman, as shown by the following *consecutive* headers:

Received: from notorious.mozilla.org (localhost.localdomain [127.0.0.1])
        by lists.mozilla.org (Postfix) with ESMTP id 7FE2B58057;
        Tue,  1 May 2007 01:39:50 -0700 (PDT)
X-Original-To: [e-mail]
Delivered-To: [e-mail]
Received: from dm-mail01.mozilla.org (dm-mail01.mozilla.org [10.2.74.105])
        by lists.mozilla.org (Postfix) with ESMTP id AD29D5802E
        for <[e-mail]>;
        Mon, 30 Apr 2007 21:23:49 -0700 (PDT)
Received: from [10.250.2.196] (corp-242.mountainview.mozilla.com
        [63.245.220.242]) (Authenticated sender: [e-mail])
        by dm-mail01.mozilla.org (Postfix) with ESMTP id D0E716A8EF5
        for <[e-mail]>;
        Mon, 30 Apr 2007 17:54:17 -0700 (PDT)

Comment 1

[Dave Miller [:justdave]]

OK, turns out the existing cron job was still dealing adequately with the mime parse problem that I assumed was causing this.  The real cause this time was that the nameserver for rsz.jp seems to have dropped off the planet, and victory/maki/whatever his name is this week is on almost every list, and DNS lookups were killing it trying to process the outbound queue.  I did some fiddling with the DNS configuration in mailman and postfix so that the DNS lookups are deferred until after the messages are separated by destination in the postfix queue, and now we have 2300 messages in the postfix queue instead of the mailman queue (but the mail for everyone else is no longer delayed by waiting for rsz.jp lookups to time out)