Closed Bug 1393753 Opened 8 years ago Closed 8 years ago

Download files are corrupted

Categories

(Toolkit :: Downloads API, defect)

Product:
Toolkit
Component:
Downloads API
Version:
55 Branch
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

()

Status:
RESOLVED WORKSFORME

People

(Reporter: gspe+mozilla, Unassigned)

Details

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:56.0) Gecko/20100101 Firefox/56.0 Build ID: 20170821193225 Steps to reproduce: For example go to etcher.io and download etcher several times Actual results: every time you download you get a different file here the sha256sum of the downloaded files: 45428935c8d8fd52d4215b2970c38d393dcfca4a0d4d2190237adb9b01fbbac6 etcher-1.1.2-linux-x86_64(1).zip bc21ea0ac382979c778a449c7ccdb2d3468daa7e99f9416264473dda8bbb3687 etcher-1.1.2-linux-x86_64(2).zip d5503b9f64a76a77ed14099967d7fc1a8a346f52aa615c44938d56264ebd1204 etcher-1.1.2-linux-x86_64(3).zip b9c7b93e8355236b95d83b2bf203320a8450126f0817d2b70fdce3dfcb239bf5 etcher-1.1.2-linux-x86_64(4).zip 47c2e284deaf33e1e370655176354c3ca39745566bf5453a8a49f2d88f6a4e66 etcher-1.1.2-linux-x86_64(beta1).zip 992e7bd29cc5d8c195f05362692c3a77883400644337c8f3214bdb5ca3ce9427 etcher-1.1.2-linux-x86_64(beta2).zip 0c1a0f885955423baf4d0cfe766c069403ed5b5ac7c01aeec15b443422fbc8fa etcher-1.1.2-linux-x86_64(beta3).zip 64a8eca0431b8f8a9b6a76a595d904c2eb3e09ea9a73f87ca0a5fb8fb6ceee82 etcher-1.1.2-linux-x86_64(beta4).zip 269e3c7400a44c4c4b4824d6c5c89eeeb2abf1ff565c72e2ec1db06d29984ce1 etcher-1.1.2-linux-x86_64(beta5).zip 25ec651c843833ce23d6861c67e2d9c96bd39cdada4a7248d70a67a3a528c615 etcher-1.1.2-linux-x86_64(safe1).zip 25ec651c843833ce23d6861c67e2d9c96bd39cdada4a7248d70a67a3a528c615 etcher-1.1.2-linux-x86_64(safe2).zip 25ec651c843833ce23d6861c67e2d9c96bd39cdada4a7248d70a67a3a528c615 etcher-1.1.2-linux-x86_64(safe3).zip 6696c0bc2b6e72e2ba0544837ad1cfc30a1f4895310e8eda06cc0528b70a892e etcher-1.1.2-linux-x86_64(safe4).zip 4a87aedf53565b116d6df0429220a834fc82e211148916e2ab4300e4619eb474 etcher-1.1.2-linux-x86_64(safe5).zip 25ec651c843833ce23d6861c67e2d9c96bd39cdada4a7248d70a67a3a528c615 etcher-1.1.2-linux-x86_64(upstream1).zip 25ec651c843833ce23d6861c67e2d9c96bd39cdada4a7248d70a67a3a528c615 etcher-1.1.2-linux-x86_64(upstream2).zip a54c54dfa5795851f5bd566cd18dee4bdfc88212d9e7eb08b04723d0f3cf0261 etcher-1.1.2-linux-x86_64(upstream3).zip 0701e7239e2e7aa64d1530148e5421bb6319338375cd5287b5534c4e18a79d23 etcher-1.1.2-linux-x86_64(upstream4).zip 5e33d1bad554d2bc102cdaf45c8ebf6f5df37b46967e8838e9d08ac6dd5033be etcher-1.1.2-linux-x86_64(upstream5).zip 8d2c06bdf4feac3f061007d9a5c8855ccb2722abe9310d36dc9b7fcb378e082e etcher-1.1.2-linux-x86_64.zip Expected results: I expect that I get the same file every time I download it
Component: Untriaged → Networking: HTTP
Product: Firefox → Core
Hmm, I guess it's an issue of the site in question. Have you contacted the webmaster?
Component: Networking: HTTP → Untriaged
Product: Core → Firefox
No the issue is with Firefox, I have the same issue with github and other sites too. Tied with Opera and I get always a correct file
But we haven't seen similar reports. I cannot reproduce the issue either. Also: have you tried safe mode? https://support.mozilla.org/kb/troubleshoot-firefox-issues-using-safe-mode
Yeah I've tried with -safe-mode too and I get the same result This is what I get downloading Stacer from github (https://github.com/oguzhaninan/Stacer/releases) gspe@jura ~/Downloads> sha256sum stacer-1.0.8_x64\(* f6392662a0430a6563dd1aef662cc0698644969bafc329e18bb513178a5fbfe7 stacer-1.0.8_x64(1).rpm 02df42cb35119831188b8baa810ea1a9e6da0cd02a2f904b491cd0da952703a2 stacer-1.0.8_x64(2).rpm f6392662a0430a6563dd1aef662cc0698644969bafc329e18bb513178a5fbfe7 stacer-1.0.8_x64(3).rpm It's strange because sometimes I get the correct result but after a while I get the corrupted files I'll try with another hardware to see if the problem is related to a hardware configuration
I've done more test with linux 4.9 and 4.12 kernel and this is the resoult I've downloaded [mattermost](https://releases.mattermost.com/4.1.0/mattermost-4.1.0-linux-amd64.tar.gz) from github since it has a SHA-256 Checksum: a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f Firefox with Linux 4.12: ``` a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_01).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_02).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_03).tar.gz f4abbcd0bef16eecfacfb3c7a0b696f880afc7dbadcc28b2c51951391205a888 mattermost-4.1.0-linux-amd64(firefox_linux4.12_04).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_05).tar.gz 5e8c649cf2442a15b783f3502ee659baadc3e1fb8eab91e44e9c02abc4755096 mattermost-4.1.0-linux-amd64(firefox_linux4.12_06).tar.gz eb6dff16b98f18be14c3689d4aebfc18eb6048e73d548266adcb234f52ffb406 mattermost-4.1.0-linux-amd64(firefox_linux4.12_07).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_08).tar.gz 42303781405006bc7a1b583ab303af9c29fd3d323b63421da7e4330a06558d83 mattermost-4.1.0-linux-amd64(firefox_linux4.12_09).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_10).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_11).tar.gz e4e2ae91b43c3ef52b628042229398c2a11e8f9630b2a6d97fb7d9010ba6b798 mattermost-4.1.0-linux-amd64(firefox_linux4.12_12).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_13).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.12_14).tar.gz b527b40039af6e88fcd8f05f9c9bb3ca3f709447490157ab5f23ea828dc0dc0c mattermost-4.1.0-linux-amd64(firefox_linux4.12_15).tar.gz a70a120 ``` Opera with Linux 4.12: ``` a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_01).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_02).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_03).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_04).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_05).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_06).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_07).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_08).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_09).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_10).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_11).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_12).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_13).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_14).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_15).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_16).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_17).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(opera_linux4.12_18).tar.gz ``` Firefox with Linux 4.9: ``` a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_01).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_02).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_03).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_04).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_05).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_06).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_07).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_08).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_09).tar.gz a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f mattermost-4.1.0-linux-amd64(firefox_linux4.9_10).tar.gz ``` I've tried with my laptop and I get the same result error with firefox and kernel 4.12 correct behaviour with firefox and kernel 4.9
User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:57.0) Gecko/20100101 Firefox/57.0 Firefox: 57.0a1, Build ID: 20170829100404 I have tested this issue, using the steps provided in description, on latest Firefox release and latest Nightly build and could not reproduce it. I have navigated to the etcher.io website and downloaded "Etcher" several times. The sha256sum was exactly the same for all the downloads. Can you please retest this issue on latest Nightly build (please use an official Mozilla binary http://ftp.mozilla.org/pub/firefox/nightly/latest-mozilla-central/) using a new clean Firefox profile (https://goo.gl/iJqvLZ)?
Flags: needinfo?(gspe)
Hi I've downloaded Firefox version 57.0a1 (2017-08-29) (64-bit) from the above server and I tested the download with this site: https://docs.mattermost.com/administration/upgrade.html#version-archive, downloading this file: https://releases.mattermost.com/4.1.0/mattermost-4.1.0-linux-amd64.tar.gz since it provide a SHA-256 Checksum: a70a120a5bc32365bc39aae79e221615ea5d569319423ff179bd4ea7b163309f This is what i get with kernel 4.12 ``` gspe@oban ~/D/DownloadTest> uname -r 4.12.8-2-MANJARO ``` ``` gspe@oban ~/D/DownloadTest> sha256sum mattermost-4.1.0-linux-amd64\(* fef9739a598d122f2defa2ded258d16ac591da6a495fd21786aa60c48c044dac mattermost-4.1.0-linux-amd64(night_01).tar.gz c2e74ea34f256fb12a189c13ca154d57d3a20c657e65514f1cd1dd46019cc867 mattermost-4.1.0-linux-amd64(night_02).tar.gz 0427129e27138ed691733e9a3eb4d1dce1b475c58e269cf9b01fb5fc50df4db6 mattermost-4.1.0-linux-amd64(night_03).tar.gz a04eb8defbb959c0d626468837122261a6b14775a7313567df6982e999507235 mattermost-4.1.0-linux-amd64(night_04).tar.gz e3660358c6ed477fee4b58a9c7a635f9e0fb028986ce15c6a59a039db3575935 mattermost-4.1.0-linux-amd64(night_05).tar.gz ``` As you can see the error is still here. But I get this error only with kernel 4.12! Another thing, I've watched the download progress and I noticed that the file is downloaded completely (the size in MB) but when it was written on disk (from .partial to actual name) the size is randomly written as you can see here: ``` gspe@oban ~/D/DownloadTest> ll total 195M -rw-r--r-- 1 gspe gspe 32M 30 ago 12.00 'mattermost-4.1.0-linux-amd64(night_01).tar.gz' -rw-r--r-- 1 gspe gspe 51M 30 ago 12.01 'mattermost-4.1.0-linux-amd64(night_02).tar.gz' -rw-r--r-- 1 gspe gspe 40M 30 ago 12.02 'mattermost-4.1.0-linux-amd64(night_03).tar.gz' -rw-r--r-- 1 gspe gspe 37M 30 ago 12.03 'mattermost-4.1.0-linux-amd64(night_04).tar.gz' -rw-r--r-- 1 gspe gspe 39M 30 ago 12.04 'mattermost-4.1.0-linux-amd64(night_05).tar.gz' ``` But again the problem is with kernel 4.12 so maybe you can close this bug.
Flags: needinfo?(gspe)
The strange part is that in Opera the issue is not reproducible. As such I will assign a component to this bug in order to get the engineering team involved to get their opinion.
Component: Untriaged → Networking: File
Product: Firefox → Core
This looks similar to bug 1366282. Are the files just incomplete or is the content corrupted? Is the destination directory on a network fs?
Flags: needinfo?(gspe)
Seams that the file are incomplete, looking at download seams that it download the file completely but save them partially. The directory is on ssd.
Flags: needinfo?(gspe)
Paolo, this seems to be the same problem as in bug 1366282, but this time the file is not stored to network share.
Component: Networking: File → Downloads API
Flags: needinfo?(paolo.mozmail)
Product: Core → Toolkit
It's difficult to say whether this is the same issue or not, but unfortunately it looks like we don't have a way to identify the cause with certainty at the moment.
Flags: needinfo?(paolo.mozmail)
I think that you can close this bug since it's not present with linux 4.13 kernel The problem was present only with 4.12 kernel series, maybe was a regression that is solved in 4.13 series.
OK, closing as WFM. Feel free to reopen to bug if you see the problem again with a newer kernel.
Status: UNCONFIRMED → RESOLVED
Closed: 8 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.