331647 - Downloading of files > 4 GB fails at the 4 GB mark on NTFS / Windows XP SP2

Status: RESOLVED FIXED

(Core Graveyard :: File Handling, defect)

Description

[Jon Watte]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1

This does not appear to be a dup of https://bugzilla.mozilla.org/show_bug.cgi?id=243974
This does not appear to be a dup of https://bugzilla.mozilla.org/show_bug.cgi?id=184452

When I purchased Elder Scrolls IV: Oblivion from Direct2Drive.com, and downloaded it, the download went for a few hours, and then failed with a disk write error ("could not write the file to this location, try saving it elsewhere").

The downloaded file is actually somewhat larger than 4 GB, and the failure was consistent with a failure at the 4 GB point; the file created was also 4 GB in size after the write error.

Because of the error message and the symptoms, I believe this to be different from the other two bugs mentioned.

Reproducible: Always

Steps to Reproduce:
1. Purchase Oblivion from Direct2Drive.com (on WXP SP2 machine running NTFS).
2. Download in Mozilla (rejecting their custom ActiveX download control).
3. Wait a few hours while downloading. 

Actual Results:  
Get error about not being able to write in the download directory, suggesting trying to save elsewhere.

Expected Results:  
Download of file > 4 GB should complete correctly, or, absolutely worst case, give me the error up-front.

Given that this was a file write error, I think the problem is with the file output part, not with the network reading part.

Comment 1

[Dave Townsend [:mossop]]

What is the URL of the file you are downloading?

Comment 2

[Steve England [:stevee]]

NTFS has a 4GB file limit?

Comment 3

[Steve England [:stevee]]

OK Ignore comment 2, the limit is for FAT32. Which leads me to ask, were you downloading to a FAT32 partition?

Comment 4

[Jon Watte]

As I said, I'm using NTFS on Windows XP SP2. No FAT anywhere.

Comment 5

[Christian :Biesinger (don't email me, ping me on IRC)]

that testing this requires a purchase first makes it somewhat hard to debug :(

Comment 6

[David Bradley]

My first thought was that something probably wasn't using the extended size of a Win32 API function, but I would expect that to have just processed a small part of the file. So probably something a little less straight forward. 

I would suspect a quick test would be to host a >4gb file on a local web server and then try and download it. I wouldn't think that would be all that hard.

Comment 7

[Frank Wein [:mcsmurf]]

Ok, i did some tests here on Windows 2000 with a NTFS drive with a current SeaMonkey trunk build. I created a test file for this with "cat /dev/zero>4_gb.test".
First test: Download a 4,76 GB (5.119.916.032 Bytes) file from file:///I:/4_gb.test to I:\4_gb.test2.test (I: is a NTFS drive), so local download. At the size of 3,99 GB (4.294.967.295 Bytes) it stops the download with "Finished, -1 KB downloaded" (in the download progress window).
Second test: Download the same file from an Apache 2.0.55 server via http://localhost/i/4_gb.test. At the size of 4,00 GB (4.294.967.296 Bytes) you get a alert "I:\4_gb.test3.test.part could not be saved, because an unknown error occoured. Try saving to a different location."
Third test: Download the same file from a Apache 2.0.55 server via http://localhost/i/4_gb.test, but this time with wget. The download works fine.

Feel free to repeat those tests with Windows XP if you want.

Comment 8

[Frank Wein [:mcsmurf]]

*** Bug 334496 has been marked as a duplicate of this bug. ***

Comment 9

[Mime Čuvalo]

This 4GB limit size is a problem that I've run into in developing FireFTP.  It seems the problem lies with nsIBinaryOutputStream.writeBytes:

Error: [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIBinaryOutputStream.writeBytes]" nsresult: "0x80004005 (NS_ERROR_FAILURE)" location: "JS frame :: chrome://fireftp/content/js/connection/dataSocket.js :: anonymous :: line 258" data: no]

Comment 10

[dispater42]

Can be confirmed trying to download the x64-version of Windows Vista beta 2, exceeding 4 GB by 13,7 MB.

Comment 11

[Steve Chapel]

(In reply to comment #10)
> Can be confirmed trying to download the x64-version of Windows Vista beta 2

Can you give the URL of this file?

Comment 12

[Stephen Heumann]

(In reply to comment #11)
> (In reply to comment #10)
> > Can be confirmed trying to download the x64-version of Windows Vista beta 2
> 
> Can you give the URL of this file?
> 

The URL is http://download.windowsvista.com/dl/preview/beta2/en/x64/iso/vista_5384.4.060518-1455_winmain_beta2_x64fre_client-LB2CxFRE_EN_DVD.iso

I ran into the same problem trying to download this (with Firefox 1.5.0.4, Windows XP SP2, NTFS) -- it fails at exactly 4GB.

Comment 13

[Masatoshi Kimura [:emk]]

Fixed by bug 340956.