270545 - dmg.gz is served as text/plain

Status: RESOLVED FIXED

(mozilla.org :: FTP: Mirrors, task)

Description

[timeless]

[timeless@viper public_html]$ HEAD
http://130.206.1.5/pub/mozilla.org/thunderbird/nightly/latest-trunk/thunderbird-mac-MachO.dmg.gz
200 OK
Connection: close
Date: Thu, 18 Nov 2004 06:15:39 GMT
Accept-Ranges: bytes
ETag: "6b26807-be3d2e-419b9226"
Server: Apache/1.3.31 (Unix) PHP/4.3.8 mod_perl/1.29
Content-Encoding: x-gzip
Content-Length: 12467502
Content-Type: text/plain
Last-Modified: Wed, 17 Nov 2004 18:02:14 GMT
Client-Date: Thu, 18 Nov 2004 06:14:12 GMT
Client-Peer: 130.206.1.5:80
Client-Response-Num: 1

it's one of ftp.eu.mozilla.org (spain)

Comment 1

[Henri Sivonen (:hsivonen)]

Also seen with
http://ftp.mozilla.org/pub/mozilla.org/mozilla/releases/mozilla1.8a5/mozilla-mac-1.8a5.dmg.gz

Comment 2

[Daniel Wang]

also
ftp.mozilla.org/pub/mozilla.org/thunderbird/releases/0.9/contrib-localized/thunderbird-0.9.fr-FR.mac.dmg.gz

Comment 3

[Dave Miller [:justdave]]

*** Bug 273474 has been marked as a duplicate of this bug. ***

Comment 4

[Dave Miller [:justdave]]

OK, the correct MIME-type for .dmg is application/octet-stream, according to bug
222492 comment 9.

Since this has been a repeated issue in the past with other mirrors, we should
add this to the mirroring.html page in the setup instructions.

Comment 5

[Mark Mentovai]

Hi, Dave (and others.)

The title is confusing.  This needs to be fixed for .dmg too, not just .dmg.gz.
 This is important now that .dmg zlib compression is being used rather than
gzipping uncompressed .dmg images.  For example, see bug 242845.

This will begin affecting the masses more as soon as there's a non-dev release
that is packaged as a .dmg, since more servers seem to have problems with .dmg
than with .gz.

Three of the ftp.mozilla.org servers give a MIME type of text/plain instead of
the proper value for .dmg files, application/octet-stream.  This includes both
ftp.eu.mozilla.org servers.  .gz should be application/x-gzip.  Some servers use
application/octet-stream instead, which has less practical importance because
the browser still handles the file properly.

$ dig +short ftp.mozilla.org
155.98.64.83
156.56.247.196
204.152.184.113
207.200.85.49
216.165.129.134
64.12.168.243
130.206.1.5
130.207.108.135
131.188.3.71
$ curl -s -I
http://155.98.64.83/pub/mozilla.org/firefox/nightly/latest-trunk/firefox-1.0+.en-US.mac.dmg|grep
Content-Type
Content-Type: text/plain; charset=ISO-8859-1
$ curl -s -I
http://131.188.3.71/pub/mozilla.org/firefox/nightly/latest-trunk/firefox-1.0+.en-US.mac.dmg|grep
Content-Type
Content-Type: text/plain; charset=UTF-8
$ curl -s -I
http://130.206.1.5/pub/mozilla.org/firefox/nightly/latest-trunk/firefox-1.0+.en-US.mac.dmg|grep
Content-Type
Content-Type: text/plain

155.98.64.83 is mozilla.cs.utah.edu.
131.188.3.71 is ftp.uni-erlangen.de.
130.206.1.5 is ftp.rediris.es.  This server also returns text/plain for .gz!
Also: ftp.scarlet.be.

ftp.scarlet.be is listed as a primary mirror at
http://www.mozilla.org/mirrors.html that but is not listed in the
ftp.mozilla.org or ftp.eu.mozilla.org records.  (Ditto for mozilla.osuosl.org,
which uses application/x-apple-diskimage.  That's very rare but since most or
all browsers won't recognize it, the "what do you want to do with this?"
download dialog should appear.)

I'm passing a pointer to this bug to [e-mail] as a courtesy.

Mark

Comment 6

[Mark Mentovai]

Fixed for:

mozilla.cs.utah.edu
ftp.uni-erlangen.de
ftp.rediris.es
ftp.scarlet.be

As far as these go, WFM or FIXED.

However, there are still some mirrors that are not listed in the DNS entry for
ftp.mozilla.org or as primary mirrors at http://www.mozilla.org/mirrors.html but
will still be redirected to by download.mozilla.org.  These should be audited as
well, because not all of them use the correct MIME types.  download.mozilla.org
can redirect to ftp.rz.tu-bs.de, for example, but ftp.rz.tu-bs.de uses
text/plain for .dmg.

Is there a complete list of mirrors that download.mozilla.org will redirect to,
so that they may be audited?

Mark

Comment 7

[Scott Kveton]

Contact me off-bug for the list.  We can pull it right out of the bouncer.

For what its worth, Bouncer v2.0 will remove a mirror if it has the wrong
mime/type for a file extension and also notify the mirror.  Bouncer v2.0 is
scheduled to be released sometime this month.

Comment 8

[Scott Kveton]

We polled all of the mirrors and believe we have this problem solved at this
time.  The Bouncer is checking each mirror for the correct mime-type now and
disabling if the .dmg is not handled correctly.