265329 - (http, chunked) Attempting to download any file over 4GB results in corrupted data

Status: RESOLVED EXPIRED

(SeaMonkey :: Download & File Handling, defect)

Description

[WC -Sx- Jones]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a3) Gecko/20040817
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a3) Gecko/20040817

this is a follow-up to 
https://bugzilla.mozilla.org/show_bug.cgi?id=263967

However this bug addresses the issue where file size < 4GB slows down but
succeeds without error -- just roughly 30% slower.

Additionally, my tests off a SUN Solaris 9 Ultrasparc ---> to a WinXP client
attempts to download files greater than 4GB not only slow down but end in
"Network checksum error -- data corrupt?"  error.

I created three test files, all binary, first <1GB, second >2GB<4GB, and third
one >4GB...

After testing this on both Solaris 9 and Debian Sarge 3.1 (Ultrasparc) the
outcomes are repeatable -

<1GB = successful.
>2GB<4GB - slow but successful.
>4GB = cupport data? error.

I am using thnis Mozilla version:
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a3) Gecko/20040817

My internal network is 100MB full duplex.  Attempts at downloading over the
public Internet have mostly all failed.


Reproducible: Always
Steps to Reproduce:
1. see details above
2. create a file larger than 4GB
3.  try to download it using Download Manager

Actual Results:  
progress indicators result in negative displays.  Where file size < 4GB slows
down but succeeds without error -- just roughly 30% slower.

Additionally, my tests off a SUN Solaris 9 Ultrasparc ---> to a WinXP client
attempts to download files greater than 4GB not only slow down but end in
"Network checksum error -- data corrupt?"  error.

I created three test files, all binary, first <1GB, second >2GB<4GB, and third
one >4GB...

After testing this on both Solaris 9 and Debian Sarge 3.1 (Ultrasparc) the
outcomes are repeatable -

<1GB = successful.
>2GB<4GB - slow but successful.
>4GB = cupport data? error.

I am using thnis Mozilla version:
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a3) Gecko/20040817

My internal network is 100MB full duplex.  Attempts at downloading over the
public Internet have mostly all failed.


Expected Results:  
files should succeed, even if progress indicator is negative.

My recommendation would be to see if the remote site gives the file size and
abort if greater then 2GB (your call not mine obviously.)

This real error occured on the FC2 DVD download -- the remote server stated that
the download was only 72MB (I know, strange.)

Things went badly after that.

At any rate - the work around is (hopefully) expect DVD authors would provide
DVDs in a torrent format to help control download issues.

-Sx-

Comment 1

[Antej Nuhanovic]

if I may add: one of the bug reports claims that 4GB bug was fixed but I just
downloaded FireFox on Windows 2000 (I know, but I made a mistake of buying a US
Robotics Wireless card and I can't get the acx100 driver to work so I'm stuck)
and tried downloading Fedora DVD (4.4GB) and it cut off the download at 4GB.
This could be a file system limit (I heard FAT and FAT32 have 4GB limit while
NTFS doesn't), so I don't think Firefox should have a hack for it but instead
simply warn the user about to check the file system and switch to linux :)
Thanks.

Comment 2

[Christian :Biesinger (don't email me, ping me on IRC)]

>if I may add: one of the bug reports claims that 4GB bug was fixed but I just
>downloaded FireFox on Windows 2000 

it's probably not fixed in the current firefox release

Comment 3

[WC -Sx- Jones]

I verified bug - as reported regarding data curruption when download is greater
than 4GB -- also exists on latest Mozilla beta for Ultrasparc and tested on
Solaris 10 (Ultrasparc) and Solaris 10 definitely supports file sizes over 4GB.

-Sx-

Comment 4

[Christian :Biesinger (don't email me, ping me on IRC)]

> latest Mozilla beta for Ultrasparc

which beta? do you mean 1.8alpha4?

Comment 5

[WC -Sx- Jones]

I mean 1.8a3

Ill test again on a4
-Sx-

Comment 6

[Christian :Biesinger (don't email me, ping me on IRC)]

oh, hm... this probably did not change between a3 and a4. Was it an FTP or HTTP
url that you tried downloading? can you find out whether the server sent
Content-Encoding: chunked? (for example using http://livehttpheaders.mozdev.org,
or using a network sniffer)

Comment 7

[WC -Sx- Jones]

Via HTTP and Chunked near as i can tel from the site:

http://download.fedora.redhat.com/pub/fedora/linux/core/2/i386/iso/

GET /pub/fedora/linux/core/2/i386/iso/ HTTP/1.1
Host: download.fedora.redhat.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a5) Gecko/20041025
Accept:
text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive

HTTP/1.1 200 OK
Date: Sat, 30 Oct 2004 00:02:02 GMT
Server: Apache
Cache-Control: max-age=21600
Expires: Sat, 30 Oct 2004 05:50:57 GMT
Last-Modified: Fri, 14 May 2004 18:35:57 GMT
Etag: "c65e2-1000-40a5118d"
Content-Type: text/html
Age: 665
X-Cache: HIT from server3.download.phx.redhat.com, MISS from
download.fedora.redhat.com
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Transfer-Encoding: chunked


The URL:
http://download.fedora.redhat.com/pub/fedora/linux/core/2/i386/iso/FC2-i386-DVD.iso

Comment 8

[Christian :Biesinger (don't email me, ping me on IRC)]

ah, chunked... it's possible that I didn't fix that.

Comment 9

[boris tabenkin]

Hi all, 

I would like to know if there are plans to fix this. I am planning on writting
my own applet to get arround the 4GB issue. It's broken on IE as well, but
perhaps if mozilla fixes it maye M$ will too. Any comments?

Comment 10

[Gervase Markham [:gerv]]

This is an automated message, with ID "auto-resolve01".

This bug has had no comments for a long time. Statistically, we have found that
bug reports that have not been confirmed by a second user after three months are
highly unlikely to be the source of a fix to the code.

While your input is very important to us, our resources are limited and so we
are asking for your help in focussing our efforts. If you can still reproduce
this problem in the latest version of the product (see below for how to obtain a
copy) or, for feature requests, if it's not present in the latest version and
you still believe we should implement it, please visit the URL of this bug
(given at the top of this mail) and add a comment to that effect, giving more
reproduction information if you have it.

If it is not a problem any longer, you need take no action. If this bug is not
changed in any way in the next two weeks, it will be automatically resolved.
Thank you for your help in this matter.

The latest beta releases can be obtained from:
Firefox:     http://www.mozilla.org/projects/firefox/
Thunderbird: http://www.mozilla.org/products/thunderbird/releases/1.5beta1.html
Seamonkey:   http://www.mozilla.org/projects/seamonkey/

Comment 11

[Gervase Markham [:gerv]]

This bug has been automatically resolved after a period of inactivity (see above
comment). If anyone thinks this is incorrect, they should feel free to reopen it.