879764 - Downloading a gzipped attachment from bugzilla.mozilla.org with a browser results in a doubly-compressed file

Status: VERIFIED FIXED

(bugzilla.mozilla.org :: Infrastructure, defect)

Description

[Florian Quèze [:florian]]

This happened in bug 879743, and I have no idea of what caused it. I put a copy of the file online on my webserver instead (see bug 879743 comment 2).

Comment 1

[:glob ✱]

works for me; i had no issues downloading and decompressing both of your attachments.

Comment 2

[:glob ✱]

side note - the attachment size limit is 10m, so you could attach your file uncompressed :)

Comment 3

[Florian Quèze [:florian]]

(In reply to Byron Jones ‹:glob› from comment #1)
> works for me; i had no issues downloading and decompressing both of your
> attachments.

The attachment can be downloaded, and successfully decompressed. But the decompressed file contains only garbage.

The md5 of the file I attached is 400062c340a1e24ec02eab351933d9ad
The md5 of the downloaded attachment is c883599e80fce032d52c859f14da50ff

Comment 4

[:glob ✱]

sorry, i should have been clearer - the file decompresses fine, and the contents are not garbage.

~/tmp $ wget -qO test.txt.gz https://bugzilla.mozilla.org/attachment.cgi?id=758534
~/tmp $ md5 test.txt.gz
MD5 (test.txt.gz) = 400062c340a1e24ec02eab351933d9ad

Comment 5

[Florian Quèze [:florian]]

(In reply to Byron Jones ‹:glob› from comment #4)

That's interesting. If I wget the file, it's not corrupted. If I download it with Firefox (tested both with Firefox 21 and with an up to date nightly), it's corrupted.

Comment 6

[:glob ✱]

(In reply to Florian Quèze [:florian] [:flo] from comment #5)
> (In reply to Byron Jones ‹:glob› from comment #4)
> 
> That's interesting. If I wget the file, it's not corrupted. If I download it
> with Firefox (tested both with Firefox 21 and with an up to date nightly),
> it's corrupted.

i see the same across multiple browsers, reopening.

when you download the file with firefox it's is double-compressed; gunzip it again to see your text.

Comment 7

[:glob ✱]

passing --header="accept-encoding: gzip" with wget also results in a doubly gzipped file.

here's the response headers:
  HTTP/1.1 200 OK
  Server: Apache
  X-Backend-Server: web5.bugs.scl3.mozilla.com
  Vary: Accept-Encoding
  Content-Type: application/x-gzip; name="fake-leak-dmd.txt.gz"; charset=
  Content-Encoding: gzip
  Date: Wed, 05 Jun 2013 15:53:48 GMT
  Keep-Alive: timeout=5, max=997
  X-xss-protection: 1; mode=block
  Transfer-Encoding: chunked
  X-content-type-options: nosniff
  Content-disposition: inline; filename="fake-leak-dmd.txt.gz"
  Connection: Keep-Alive

bugzilla isn't doing the gzip content-encoding, over to IT to see if apache can be configured to not gzip responses which have the application/x-gzip content-type.

Comment 8

[Shyam Mani [:fox2mike]]

We probably have compression enabled on Zeus.

Comment 9

[Shyam Mani [:fox2mike]]

Removed the following mime-types for compression from Zeus, after talking with glob over IRC: 

application/x-tar-gz 
application/x-gzip 
application/x-gunzip 
application/x-tar

Comment 10

[:glob ✱]

(In reply to Shyam Mani [:fox2mike] from comment #9)
> Removed the following mime-types for compression from Zeus, after talking
> with glob over IRC: 

this didn't fix the issue.

Comment 11

[Kendall Libby [:fubar] (he/him)]

I think this is bug 610679#c5

Comment 12

[:glob ✱]

(In reply to Kendall Libby [:fubar] from comment #11)
> I think this is bug 610679#c5

i don't think this is the case as is can reproduce this issue with wget.

Comment 13

[Eric Rahm [:erahm]]

Any word on this? We're making design decisions in some of our external tools (bug 1042247) to use bzip2 rather than gzip as a workaround, but would prefer not to have to do that.

Comment 14

[Kendall Libby [:fubar] (he/him)]

I was fairly certain that I'd tested w/ curl or wget, but I no longer remember. Soonest I'll be able to dig into this will be some time next week, unfortunately.

Comment 15

[Kyle Huey (Exited; not receiving bugmail, old account, do not use)]

Who do I need to bribe with a nice bottle of liquor to get this fixed?

Comment 16

[Kendall Libby [:fubar] (he/him)]

So Shyam had it right in comment 9, but was missing the bit where BMO uses the bugXXXXXXX.bugzilla.mozilla.org domain to pull attachments, etc. I removed the same list of mime-types from the wildcard zeus virtual server, et voila. Downloading the attachement via FF and wget with --header="accept-encoding: gzip" results in a singly-gzipped file.

:khuey, assuming no other issues, I enjoy port and Speyside whiskies. ;-)

Comment 17

[Kyle Huey (Exited; not receiving bugmail, old account, do not use)]

(In reply to Kendall Libby [:fubar] from comment #16)
> So Shyam had it right in comment 9, but was missing the bit where BMO uses
> the bugXXXXXXX.bugzilla.mozilla.org domain to pull attachments, etc. I
> removed the same list of mime-types from the wildcard zeus virtual server,
> et voila. Downloading the attachement via FF and wget with
> --header="accept-encoding: gzip" results in a singly-gzipped file.

I tested downloading https://bugzilla.mozilla.org/attachment.cgi?id=8493600 and it worked!

> :khuey, assuming no other issues, I enjoy port and Speyside whiskies. ;-)

Might have to wait until Portland since it seems to be illegal to direct ship liquor in MA but there will be a bottle for you at some point.

Comment 18

[Shyam Mani [:fox2mike]]

(In reply to Kendall Libby [:fubar] from comment #16)
> So Shyam had it right in comment 9, but was missing the bit where BMO uses
> the bugXXXXXXX.bugzilla.mozilla.org domain to pull attachments, etc. I
> removed the same list of mime-types from the wildcard zeus virtual server,

FML, for missing that simple step which would have solved this a whole year ago. SADFACE.