394064 - Very slow Connection with Mirror Servers in Japan

Status: RESOLVED WONTFIX

(mozilla.org :: FTP: Mirrors, task)

Description

[Carsten Book [:Tomcat]]

During a Test for some Major Updates i noticed very slow connections to Mirror Servers in JP during Software Updates

mozilla-mirror.naist.jp: only a download rate of 4 kb/s 
and timeout mozilla.hongo.wide.ad.jp

at the same time the connection to other FTP Mirrors was up to 330 kb/s, so it was no problem with my connection.

Are this jp mirrors throttle speed to connections outside of japan (like in my case to europe ?)

Comment 1

[Carsten Book [:Tomcat]]

FWIW: We have seen the same on the Firefox 2.0.0.7 Live Updatetesting and i also get the slow connection to the jp server on the Gran Paradiso Alpha8 Live Testing. 

mozilla.hongo.wide.ad.jp 2 kb/s
our mirror in .za 200 kb/s 

So this is still a problem.

Comment 2

[Carsten Book [:Tomcat]]

-> setting to major since i see also user comments about the download rate of 2,5kb in the Gran Paradiso M8 Feedback

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

I just tried downloading at the same time as Kohei, who's actually in Japan. From the UK I got about 4 KB/s, while Kohei's got about 2 MBps (this was a Fx2007 mac .dmg which finished "in a few seconds"). Similar results for both sites in comment #0, so they could both be throttling connections to non-Japanese sites. Is that correct, and the expected behaviour Justin ?

In bouncer, both these sites have quite a high bandwidth rating (sixth equal by sort) and are in the Asia region. morgamic, does bouncer have any controls that we can use to make these sites more Japan specific ? Or anything you have coming down the pipeline ? If not, maybe we can reduce the rating so they are less likely to be returned by bouncer.

Comment 4

[Gen Kanai [:gen]]

I'm pretty sure that is not the expected behavior.

I don't think Bouncer has any geo-specific setting but I'd love to hear otherwise.

I will contact the admins at both of these locations as soon as I have more news.

Comment 5

[Justin Fitzhugh]

(In reply to comment #3)
> I just tried downloading at the same time as Kohei, who's actually in Japan.
> From the UK I got about 4 KB/s, while Kohei's got about 2 MBps (this was a
> Fx2007 mac .dmg which finished "in a few seconds"). Similar results for both
> sites in comment #0, so they could both be throttling connections to
> non-Japanese sites. Is that correct, and the expected behaviour Justin ?

We have no control over throttling mirrors may do.  We aren't doing any throttling, and are sending the weighted amount of traffic.  If you like, I can lower the weight (or totally remove) this mirrow...

> In bouncer, both these sites have quite a high bandwidth rating (sixth equal by
> sort) and are in the Asia region. morgamic, does bouncer have any controls that
> we can use to make these sites more Japan specific ? Or anything you have
> coming down the pipeline ? If not, maybe we can reduce the rating so they are
> less likely to be returned by bouncer.

We have geo-ip stuff in the works (i.e. send a user to the closest mirror to them, rather than a random one), but that's a ways away.  For now, we can only lower their weight - let me know if this is something you'd like me to do.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

(In reply to comment #5)
> We have geo-ip stuff in the works (i.e. send a user to the closest mirror to
> them, rather than a random one), but that's a ways away.  For now, we can only
> lower their weight - let me know if this is something you'd like me to do.

That's sounds like a good plan to me, at least until we hear back from them.

Comment 7

[Nick Thomas [:nthomas] (UTC+12)]

Just changed the rating of these two mirrors from 1000 to 200 ahead of the 2.0.0.8 release.

Comment 8

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

I just got punted to mozilla.mtk.nao.ac.jp while downloading 2.0.0.8, and was getting around 20K/s.  I cancelled and got ftp-mozilla.netscape.com the next time, and was getting around 300-400K/s.  Does bouncer do any resolution of the requesting IP?  It might be possible to prefer .jp mirrors for .jp domains (or at least score higher any mirrors that have the same TLD as you)... but the dns resolution would probably be slow.

Comment 9

[Gen Kanai [:gen]]

We're in process to contact the admin of this mirror.  

Does Bouncer have any kind of visual or otherwise interface so we can see what nao.ac.jp is doing vs. other mirrors?

Comment 10

[Gen Kanai [:gen]]

Attachment: traffic graph from nao.ac.jp

traffic graph from mozilla mirror at mozilla.mtk.nao.ac.jp

Comment 11

[Gen Kanai [:gen]]

So we've contacted the admin at mozilla.mtk.nao.ac.jp and he's provided us a traffic graph of recent traffic.  He tells us that traffic is moving and that there's no slowdown from his side.

nao.ac.jp is on the Japanese national 10 Gb backbone that is also used to move large files for Japanese government agencies (in this case nao.ac.jp probably moves data to and from the Japanese national observatory on the Big Island of Hawaii to Japan but that's my speculation.) My point here is that nao.ac.jp is a fast network and I'm not sure why it's slow from the UK or the US but it's really fast here in Japan.

I do think this highlights the fact that Bouncer could benefit from geo-specific capabilities.

Comment 12

[Justin Fitzhugh]

agreed - not much we can do here - closing this wontfix, and I'll keep pushing on the geo-ip stuff :-)