Closed Bug 474600 Opened 16 years ago Closed 16 years ago

Build Infrastructure Outage - 2009-01-21

Categories

(Mozilla Messaging Graveyard :: Server Operations, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: gozer, Unassigned)

Details

This is a tracking bug for today's rolling build infrastructure outage.
Waiting for currently running builds to complete before moving ahead.
Buildbot masters *not* scheduling new builds anymore
Tree closed, buildbot master done.
spreadthunderbird.com going down for a reboot
buildbot unittest master back up
Linux unittest slave back up
Win32 unittest slave back up
Linux bloat slave back up
Win32 bloat slave back up
spreadthunderbird.com was back a while ago, forgot to mention it.
Mac OS X builders still down, the X-Serve is still rebooting/upgrading itself.
Mac OS X unittest slave back up
Mac OS X bloat slave back up
Nagios is all GREEN. So all systems back to normal.
Waiting for things to turn green and cycle a little before re-opening the tree.
Linux comm-central build just had a connection timeout. New build forced.
Win2k3 comm-central trunk build is still offline.

(In reply to comment #13)
> Linux comm-central build just had a connection timeout. New build forced.

Now green again.
Restart is now complete and tree open, I'll file bugs on any remaining problems in the morning once the trees have settled down and cycled a bit.
Status: NEW → RESOLVED
Closed: 16 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.