291425 - the host ftp swaps mirrors with nightly builds from different dates

Status: RESOLVED FIXED

(mozilla.org :: FTP: Mirrors, task)

Description

[Alexander Rabtchevich]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8b2) Gecko/20050419
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8b2) Gecko/20050419

Trying to download nightly build from  
http://ftp.mozilla.org/pub/mozilla.org/mozilla/nightly/latest-trunk/
often leads to download errors. The host ftp submits different mirrors, but many
of them contain outdated builds. So if the download interrupts and download
manager tries to continue downloading, it receives other file from the other mirror.

Reproducible: Always

Comment 1

[Dave Miller [:justdave]]

rediris.es and uni-erlangen.de are the two that are having problems.  Both have
been removed from the FTP round-robin.  uni-erlangen is having problems with
system load due to the Wikimedia-DVD and SuSE 9 releases, and can't keep up with
the rsyncs.  I'm not sure what Rediris's problem is, but they seem to be a fair
bit behind as well.

Comment 2

[Alexander Rabtchevich]

I've seen outdated builds twice today after the bug was closed.

Comment 3

[Dave Miller [:justdave]]

Indiana and ISC have been pulled.

* indicates hosts not currently live in the DNS round-robin
Reference time from stage.mozilla.org: Sat Apr 23 05:25:00 PDT 2005
*ftp.scarlet.be                     615 minutes
*mozilla.ussg.indiana.edu           615 minutes
ftpmoz.newaol.com #4 (Dulles VA)    5 minutes
*mozilla.oregonstate.edu            404 Not Found
ftpmoz.newaol.com #2 (Manassas VA)  5 minutes
*mozilla.cs.utah.edu                100 minutes
mozilla.mirrors.tds.net             10 minutes
*mozilla.isc.org                    615 minutes
*trillian.cc.gatech.edu             615 minutes
*zeppo.rediris.es                   615 minutes
*ftp.uni-erlangen.de                800 minutes
ftpmoz.newaol.com #3 (Columbus OH)  5 minutes
*ftpmoz.newaol.com #5 (Reston VA)   25 minutes

Comment 4

[Alexander Rabtchevich]

The bug is not fixed. I've seen today the ftp http://www.ftp.uni-erlangen.de/
with builds from 22 of April. Some other mirrors provide outdated files too.

Comment 5

[Dave Miller [:justdave]]

(In reply to comment #4)
> The bug is not fixed. I've seen today the ftp http://www.ftp.uni-erlangen.de/
> with builds from 22 of April. Some other mirrors provide outdated files too.

uni-erlangen was pulled earlier this morning for that reason.  For some reason
the zone update didn't take.  I just kicked it again, I'll re-close this bug as
soon as I confirm that the zone update has gone out.

I also just now pulled scarlet.be and rediris.es because they're also starting
to lag.

Comment 6

[Dave Miller [:justdave]]

* indicates hosts which are currently disabled in the DNS round-robin

Retrieving bouncer/marker.txt
Reference time from stage.mozilla.org: Tue Apr 26 09:10:00 PDT 2005
*zeppo.rediris.es                   20 minutes
trillian.cc.gatech.edu              20 minutes
*ftp.uni-erlangen.de                725 minutes
ftpmoz.newaol.com #3 (Columbus OH)  10 minutes
ftpmoz.newaol.com #5 (Reston VA)    40 minutes
mozilla.cs.utah.edu                 10 minutes
mozilla.ussg.indiana.edu            20 minutes
*ftp.scarlet.be                     110 minutes
mozilla.isc.org                     30 minutes
ftpmoz.newaol.com #4 (Dulles VA)    10 minutes
mozilla.mirrors.tds.net             10 minutes
ftpmoz.newaol.com #2 (Manassas VA)  10 minutes

scarlet, rediris, and uni-erlangen are staying out permanently now until I hear
from them that they've fixed their sync schedules.

Comment 7

[Alexander Rabtchevich]

I couldn't download the latedst trunk again due to mirrors with outdated builds.
The problem will not be solved until there hvae been written some script to
check mirrored builds dates before submitted mirror links to download manager.

Comment 8

[Dave Miller [:justdave]]

(In reply to comment #7)
> I couldn't download the latedst trunk again due to mirrors with outdated builds.
> The problem will not be solved until there hvae been written some script to
> check mirrored builds dates before submitted mirror links to download manager.

But we have such a script, and all of the mirrors that are out of date do get
pulled when they get behind.

Reference time from stage.mozilla.org: Fri May 13 08:10:00 PDT 2005
*zeppo.rediris.es                   80 minutes
trillian.cc.gatech.edu              30 minutes
*ftp.uni-erlangen.de                555 minutes
*ftpmoz.newaol.com #3 (Columbus OH) 70 minutes
*ftpmoz.newaol.com #5 (Reston VA)   60 minutes
mozilla.cs.utah.edu                 30 minutes
mozilla.ussg.indiana.edu            30 minutes
*ftp.scarlet.be                     40 minutes
mozilla.isc.org                     30 minutes
*ftpmoz.newaol.com #4 (Dulles VA)   70 minutes
mozilla.mirrors.tds.net             10 minutes
ftpmoz.newaol.com #2 (Manassas VA)  10 minutes

* indicates servers that are currently pulled from the rotation, and as you can
see, there's nothing without a * that's more the 30 minutes behind.

Are you sure the nightly build you're looking for just hasn't been uploaded?

Comment 9

[Alexander Rabtchevich]

I save yesterday builds regarding to newer available several times. It was
enough time for the mirrors to download the latest build. is it possible to show
the real ftp address at the download page as the 
ftp://ftp.uni-erlangen.de/mirrors/mozilla.org/mozilla/nightly/latest/
does? This could have simplified the process of finding the outdated mirror.