Closed Bug 422874 Opened 16 years ago Closed 16 years ago

dm-webtools03.mozilla.org reporting "Insufficient disk space"

Categories

(mozilla.org Graveyard :: Server Operations, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: joduinn, Assigned: justdave)

References

Details

Just got 4 different emails all saying dm-webtools02 could not send email because of insufficient disk space. I dont know who should look at this. If this is not for IT, do you know who to reassign this to?


-------- Original Message --------
Subject: [build] Warning: could not send message for past 4 hours
Date: Thu, 13 Mar 2008 23:25:36 -0700
From: Mail Delivery Subsystem <MAILER-DAEMON@dm-webtools02.mozilla.org>
To: <build@mozilla.org>

    **********************************************
    **      THIS IS A WARNING MESSAGE ONLY      **
    **  YOU DO NOT NEED TO RESEND YOUR MESSAGE  **
    **********************************************

The original message was received at Thu, 13 Mar 2008 19:14:00 -0700
from dm-mail02.mozilla.org [10.2.74.99]

   ----- Transcript of session follows -----
... while talking to dm-webtools03.mozilla.org.:
>>> MAIL From:<build@mozilla.org> SIZE=43299 BODY=7BIT
<<< 452 4.4.5 Insufficient disk space; try again later
tinderbox-daemon@dm-webtools03.mozilla.org... Deferred: 452 4.4.5 Insufficient disk space; try again later
Warning: message still undelivered after 4 hours
Will keep trying until message is 5 days old
That's 03, not 02.  And I bet this is what MXR/LXR's problem is, too.
Assignee: server-ops → justdave
Summary: dm-webtools02.mozilla.org reporting "Insufficient disk space" → dm-webtools03.mozilla.org reporting "Insufficient disk space"
/me adds the obviously-missing nagios test
(In reply to comment #1)
> That's 03, not 02.  
Good catch, yes. 02 reported having problems connecting to 03. 


> And I bet this is what MXR/LXR's problem is, too.
Very plausible.

Blocks: 422860
OK, freed up disk space by removing the not-yet-configured mozillasvn tree from MXR, and about 20 GB worth of spam out of the rejected mail folder on tinderbox-stage.  Added a weekly cron job to nuke anything older than 14 days out of tinderbox-stage's rejected mail queue.  Things should be working again now.
Status: NEW → RESOLVED
Closed: 16 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.