Closed Bug 578688 Opened 14 years ago Closed 14 years ago

Massive disconnects/reconnects from external-to-mv-office-sources to mozilla servers

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Type:
task
Priority:
Not set
Severity:
blocker

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: aakashd, Assigned: dmoore)

Details

There's a ton of remotees disconnecting/reconnecting to irc.mozilla.org for the past 20 minutes. 

The people in the MV office are not being disconnected, but internet/intranet pages are slow to load.
dmoore and mrz are already working on it.  From outside it appears that one of the main upstream network links is flapping.
Assignee: server-ops → dmoore
Severity: critical → blocker
And it took me a while to submit that, it finally went through. :)  Current status: the unstable peers have been dropped, and it appears the upstream links are starting to stabilize as the routes reconverge. We're still having some issues with services hosted behind the Ace load balancer.
I believe this to be resolved.
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
I wonder why we always have such problems on days when we have new release builds available. It happened mostly all the time at the exact day in the last months.
The issue has re-appeared. I'm still getting major disconnects / reconnects.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
I don't think this is 100% fixed.  I am still having intermittent issues connecting to tinderbox.mozilla.org.
And it also took me 2 tries to submit the above comment to this bug.
This has been resolved for all locations. Please see bug 578698 for tracking of
the MPT-PHX fiber cut.
Status: REOPENED → RESOLVED
Closed: 14 years ago → 14 years ago
Resolution: --- → FIXED
Getting same problems today as yesterday.
Laura,

Could we see traceroute or mtr output from your location? We haven't received any other reports of poor performance since yesterday, so I'd like to try and identify where your bottleneck is.
We did push 3.6.7 to beta last night, so there will be many users hitting ftp.mozilla.org directly to get that update.
It's back now.  If it happens again I'll do a traceroute, thanks Derek.
beta traffic is usually insignificant and doesn't cause a lot of network load.
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.