231361 - download manager doesn't show downloaded filesize after 1MB if the filesize is "unknown"

Status: RESOLVED FIXED

(Toolkit :: Downloads API, defect, P4)

Description

[Žiga Sancin]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7a) Gecko/20040115 Firebird/0.8.0+
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7a) Gecko/20040115 Firebird/0.8.0+

For example, PHPmyadmin offers exporting of the database-files and after
choosing some properties the file begins to download, which actually has an
"unknown" size. MozillaFirebird shows the correct size till the downloaded size
reaches 1MB and then the text showing the downloaded filesize disappears
(there's only: at [speed], ??? remain).
Nevertheless the download finishes as expected and everything is OK with the
downloaded file.

Reproducible: Always

Steps to Reproduce:
1. download a file with an "unknown" filesize
2. wait till the downloaded filesize reaches 1MB
3. the downloaded filesize disappears

Actual Results:  
MozillaFirebird doesn't show the downloaded filesize after 1MB.

Expected Results:  
MozillaFirebird should show the downloaded filesize after 1MB.

Comment 1

[Ashley Smith]

WFM, using:

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6b) Gecko/20040102
Firebird/0.7+

I tried to download:

ftp://ftp.mozilla.org/pub/mozilla.org/firebird/nightly/latest-0.8/FirebirdSetup.exe

I watched the filesize reach 2MB/6MB no problem.

Žiga, can you post the URL you are having problems with to help further debug
your problem?

Comment 2

[Žiga Sancin]

Attachment: before 1MB

Comment 3

[Žiga Sancin]

Attachment: after 1MB

Comment 4

[Žiga Sancin]

Yes, but the given Firebirdsetup.exe file has a known file size (ca. 6,4MB). 
I have uploaded two files, which should show, what I mean. Unfortunately I can't
give you access to my phpmyadmin, because it's password-protected for security
reasons. I'll try to find a "public" webpage, which generates files with unknown
file size.

Comment 5

[noririty]

Right. Reproduced on trunk.

Comment 6

[Ashley Smith]

noririty - can you add the URL you used to reproduce the bug to the ticket
please - it will help others to reproduce the bug, and the confirm it is working
when it is fixed.

Comment 7

[noririty]

I'm sorry but I can't.
I used the password protected test case uri given by reporter to reproduce this
bug. So we need to find other test case out.
-> qawanted (test case needed)

Oh, and I also tested on 0.7 but download progress dialogbox and download
sidebar doesn't have this problem.

Comment 8

[Žiga Sancin]

I have just attached an URL, which shows the bug. Click on the link "LINK" and
firebird will start downloading a 3,82MB big mpeg file (blackhumor.mpeg ;)). 

(behind the download.htm file there is, as you might see, a file called
download_mpeg.php, which "gives" the order to download blackhumor.mpeg")

Comment 9

[Sebastian Brocks]

I get this bug with Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7a)
Gecko/20040115 Firebird/0.8.0+

Comment 10

[PikeUK]

The example file is causing the code to hit the undefined state in
DownloadProgressListener._formatKBytes in DownloadProgressListener.js.

Just adding another clause to the if/elseif block to deal with this situation
seems to work OK, i.e. something like:

else if (progressHasMB && !totalHasMB) {
    // Download progress is > 1MB but filesize is unknown
    format = this._statusFormatMBMB;
    format = this._replaceInsert(format, 1, (aKBytes / 1000).toFixed(1));
    format = this._replaceInsert(format, 2, aTotalKBytes);
}

Comment 11

[Benoit]

May I suggest to change the wording too? It currently says "xx of 0 KB at yy
KB/sec; ??? remain"

What about "xx KB at yy KB/s; unknown total size" or something?

Comment 12

[Bradley Chapman (not reading bugmail, still gone but not forever)]

I can't find the testcase link to see if this appears under Linux.

Comment 13

[Žiga Sancin]

Hum, the testcase link is listed above and it works -
http://www.pikslar.com/temp/Bisi/firebird/download.htm

Benoit: this would be a nice long-term solution (like IE handling of unknown
file size downloads).

Comment 14

[Bradley Chapman (not reading bugmail, still gone but not forever)]

OS -> All requested, I triggered the bug on Linux.

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7a) Gecko/20040126 Firebird/0.8.0+
(.:MrC:.)

Comment 15

[Bradley Chapman (not reading bugmail, still gone but not forever)]

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7a) Gecko/20040201 Firebird/0.8.0+
(daihard: XFT+GTK2; optimized for P4/SSE-2)

Triggered it again, this time on a trunk build.

Comment 16

[Yann Cochard]

*** Bug 235614 has been marked as a duplicate of this bug. ***

Comment 17

[Bradley Chapman (not reading bugmail, still gone but not forever)]

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7b) Gecko/20040403 Firefox/0.8.0+
(daihard: XFT+GTK2; opt. for P4/SSE-2)

Still present, with the original testcase.

Comment 18

[Žiga Sancin]

Attachment: temp fix (pike's proposal)

I've made a temporary patch, following pike's comment, which works with my own
firefox build. I'll try to find&create a long-term solution as soon as
possible.

Comment 19

[Bradley Chapman (not reading bugmail, still gone but not forever)]

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8a) Gecko/20040428 Firefox/0.8.0+
(daihard: XFT+GTK2; opt. for P4/SSE-2)

Still present, with the original testcase.

blocking1.0? indeed.

Comment 20

[Ali Ebrahim]

taking qa

Comment 21

[Ben Goodger (use ben at mozilla dot org for email)]

+ing to invoke review

Comment 22

[Žiga Sancin]

Attachment: before 1MB (new)

Comment 23

[Žiga Sancin]

Attachment: after 1MB (new)

Comment 24

[Žiga Sancin]

Attachment: patching downloads.properties

Adding statusFormatUnknown for KB and MB, changing statusFormat (removed
"remain" after #3)...

Comment 25

[Žiga Sancin]

Attachment: patching DownloadProgressListener.js

Changing function DownloadProgressListener (adding statusFormat for unknown
filesize in KB/MB), the "update time remaining" part of the script (adding "
remain" to the downloads with known filesize; changing ??? to unknown filesize
for the downloads with unknown filesize) and the function _formatKBytes (adding
else if for progressHasMB && !totalHasMB and changing the if [actually now it's
an else if, but that's not important] for !progressHasMB && !totalHasMB).

Comment 26

[PikeUK]

*** Bug 243775 has been marked as a duplicate of this bug. ***

Comment 27

[Bradley Chapman (not reading bugmail, still gone but not forever)]

Does anyone have a rough idea of when attachments 147988 and 147989 will be
reviewed and checked in?

Comment 28

[PikeUK]

*** Bug 246466 has been marked as a duplicate of this bug. ***

Comment 29

[PikeUK]

*** Bug 248929 has been marked as a duplicate of this bug. ***

Comment 30

[PikeUK]

*** Bug 250683 has been marked as a duplicate of this bug. ***

Comment 31

[Žiga Sancin]

oops, forgot to set the PR blocking flag. There are also some l10n issues. I'll
try to fix those issues till tomorrow and hope I didn't miss 1.0PR...

Comment 32

[chris hofmann]

any progress on this? think we need the patch this week if it is going to make PR1

Comment 33

[chris hofmann]

trying to shut down for PR next week. is a patch ready?  thanks

Comment 34

[Žiga Sancin]

sorry for the delay, I had some problems with my motherboard. I'll upload the
patch in a few minutes...

Comment 35

[Žiga Sancin]

Attachment: patch

all in one...

Comment 36

[Ben Goodger (use ben at mozilla dot org for email)]

Comment on attachment 156697 [details] [diff] [review]
patch

r+a=[e-mail], we need to get this in now for l10n freeze.

Comment 37

[Žiga Sancin]

Could somebody check this in (I don't have a cvs account)? 

Thanks Ben!

Comment 38

[Žiga Sancin]

mconnor checked in the patch to the aviary branch...

Comment 39

[Dennis Jakobsen]

(In reply to comment #38)
> mconnor checked in the patch to the aviary branch...

If the filesize reaches 2^32 * 1024 bytes it will start counting backwards from
minus something..  at -xx kb/sec which looks very odd, i'll attach a picture
that has the file from my explorer imposed on top, sorry for the bad edit, i'm
sure you'll see what i mean..

Not sure if I should create a new bug for this ?

Comment 40

[Dennis Jakobsen]

Attachment: displays firefox's behaviour downloading files >2GiB

Comment 41

[Ali Ebrahim]

(In reply to comment #40)
> Created an attachment (id=165125)
> displays firefox's behaviour downloading files >2GiB
> 

>2GB case is bug 228968.

Comment 42

[Mike Connor [:mconnor]]

according to lxr, the code is there, can anyone reproduce on a current trunk build?

Comment 43

[Ryan VanderMeulen [:RyanVM]]

(In reply to comment #42)
> according to lxr, the code is there, can anyone reproduce on a current trunk
build?

WFM
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8b) Gecko/20050115 Firefox/1.0+

Comment 44

[Žiga Sancin]

Yep, the code was checked in, however there is a bug, that I (and some people at
m'zine) discovered recently... If the file is smaller than 1MB (1024KB) and the
filesize is known, we get something like "xx KB at yy KB/s; zz remain" (the
expected line should say "xx KB of xx KB at yy KB/s; zz remain"). I'll make the
patch tomorrow and I think we don't need a new bug fo that.

Comment 45

[Žiga Sancin]

Attachment: KB fix

The patch fixes the small regression while downloading files smaller than 1MB.
Asking for review... It's a simple fix, so it could also get the aviary1.0.1
approval, but let's wait for the review.

Comment 46

[Neil Paris]

*** Bug 252547 has been marked as a duplicate of this bug. ***

Comment 47

[Ben Goodger (use ben at mozilla dot org for email)]

Comment on attachment 172093 [details] [diff] [review]
KB fix

r=[e-mail]

Comment 48

[Ben Goodger (use ben at mozilla dot org for email)]

*** Bug 259995 has been marked as a duplicate of this bug. ***

Comment 49

[Zibi Braniecki [:zbraniecki][:gandalf]]

I can check this in if noone else want.

Comment 50

[Žiga Sancin]

(In reply to comment #49)
> I can check this in if noone else want.

I have already contacted Mike over irc and he said he would check in the "KB
fix" patch... Maybe he didn't have time to get to this bug, so feel free to
check in the last patch.

Comment 51

[Zibi Braniecki [:zbraniecki][:gandalf]]

Comment on attachment 172093 [details] [diff] [review]
KB fix

checked in

Comment 52

[Žiga Sancin]

Thanks to Ben, Mike and Zbigniew!

-> fixed.