937831 - can't fully download http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2

Status: RESOLVED WORKSFORME

(Infrastructure & Operations Graveyard :: WebOps: Product Delivery, task)

Description

[[e-mail] (:bhearsum)]

This file on the filesystem looks like this:
-bash-4.1$ ls -l /pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
-rw-r--r-- 1 ffxbld firefox 39028484 2013-11-12 12:58 /pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2


In some build logs, we got:
12:59:37     INFO - Downloading http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2 to /builds/slave/test/build/installer.tar.bz2
12:59:37     INFO - retry: Calling <bound method DesktopUnittest._download_file of <__main__.DesktopUnittest object at 0x874c4ec>> with args: ('http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2', '/builds/slave/test/build/installer.tar.bz2'), kwargs: {}, attempt #1
12:59:42     INFO - Downloaded 10801638 bytes.

followed by failures to extract the file.

When I tried to download the file locally with wget I got:
➜  tmp  wget http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
--2013-11-12 16:13:57--  http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
Resolving ftp.mozilla.org (ftp.mozilla.org)... 63.245.215.46
Connecting to ftp.mozilla.org (ftp.mozilla.org)|63.245.215.46|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 39092429 (37M) [application/x-bzip2]
Saving to: ‘firefox-28.0a1.en-US.linux-i686.tar.bz2.1’

27% [==================================================>                                                                                                                                       ] 10,801,638  --.-K/s   in 32s     

2013-11-12 16:14:31 (325 KB/s) - Connection closed at byte 10801638. Retrying.

--2013-11-12 16:14:32--  (try: 2)  http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
Connecting to ftp.mozilla.org (ftp.mozilla.org)|63.245.215.46|:80... connected.
HTTP request sent, awaiting response... 416 Requested Range Not Satisfiable

    The file is already fully retrieved; nothing to do.



Not that the number of bytes I got before it retried is exactly the same as in the build log.

Not sure what's going on, but something seems broken. So far, it appears limited to this one file.

Comment 1

[Chris Turra [:cturra]]

as discussed with on irc, i see the same thing (on osx) downloading this file with `wget`, but `curl` doesn't return the same error.  dropping importance so it doesn't page oncall.

$ wget -4 http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
--2013-11-12 13:56:21--  http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
Resolving ftp.mozilla.org... 63.245.215.46
Connecting to ftp.mozilla.org|63.245.215.46|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 39092429 (37M) [application/x-bzip2]
Saving to: ‘firefox-28.0a1.en-US.linux-i686.tar.bz2’

27% [=========================================================>                                                                                                                                                           ] 10,801,638  --.-K/s   in 19s

2013-11-12 13:56:40 (566 KB/s) - Connection closed at byte 10801638. Retrying.

--2013-11-12 13:56:41--  (try: 2)  http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
Connecting to ftp.mozilla.org|63.245.215.46|:80... connected.
HTTP request sent, awaiting response... 416 Requested Range Not Satisfiable

    The file is already fully retrieved; nothing to do.



$ curl -O http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 37.2M  100 37.2M    0     0  2795k      0  0:00:13  0:00:13 --:--:-- 2932k

Comment 2

[Chris Turra [:cturra]]

update! when i disable timestamp checking (-N) with wget, the file downloads fine...

$ wget -N http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
--2013-11-12 14:02:30--  http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/fx-team-linux/1384285052/firefox-28.0a1.en-US.linux-i686.tar.bz2
Resolving ftp.mozilla.org... 63.245.215.56
Connecting to ftp.mozilla.org|63.245.215.56|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 39028484 (37M) [application/x-bzip2]
Saving to: ‘firefox-28.0a1.en-US.linux-i686.tar.bz2’

100%[====================================================================================================================================================================================================================>] 39,028,484  2.87MB/s   in 13s

2013-11-12 14:02:44 (2.77 MB/s) - ‘firefox-28.0a1.en-US.linux-i686.tar.bz2’ saved [39028484/39028484]

Comment 3

[Chris Turra [:cturra]]

:bhearsum - as discussed on irc, i'm going to mark this as r/wfm since this is only an issue with `wget` and can be suppressed by ignoring timestamp checking.