1217978 - Missing files on the release ftp

Status: RESOLVED FIXED

(Release Engineering :: Release Automation, defect)

Description

[Guillaume Destuynder [:kang] [this account is no longer active]]

I was trying to verify all checksums from the binaries we release on https://ftp.mozilla.org/pub/firefox/releases/latest/

I took the list from https://ftp.mozilla.org/pub/firefox/releases/latest/SHA512SUMS and walked through it - but found that many files present in the checksum file are missing from the web server.

Ex (at the bottom of the SHA512SUMS file):
0aa784c31a8a968804eb0cd56560bbc8aca85d2fd3ec4f1b8ecea6795b7885d2da0b7d5595369db7f7038b9de89a04d5cef047adc7f78687c411db7182650d32  win32/zh-TW/firefox-41.0.2.zip

This file is not present in https://ftp.mozilla.org/pub/firefox/releases/latest/win32/zh-TW/ so cannot be verified.

Is this meant to be? (if so we should probably wipe these entries from the *SUMS files)

Note that ideally this was used by a script I run externally, which checks all binaries we serve are matching the signed checksums.
Thanks!

Comment 1

[Guillaume Destuynder [:kang] [this account is no longer active]]

For clarity: https://ftp.mozilla.org/pub/firefox/releases/latest/win32/zh-TW/firefox-41.0.2.zip 404, i expected 200 :)

Comment 2

[Guillaume Destuynder [:kang] [this account is no longer active]]

Callek mentionned on IRC that these files are available at https://archive.mozilla.org/pub/firefox/nightly/41.0.2-candidates/build2/

It seems like it should also be on the official release ftp or that the checksums might need to be altered, though

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Zip files are not supported binaries for end users, and they're in there by mistake. That should be remedied by the new checksums script from bug 1174145.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Eyeball check of http://archive.mozilla.org/pub/firefox/releases/44.0/SHA512SUMS looks OK, :kang could you verify if you have a scripted check ?

Comment 5

[Guillaume Destuynder [:kang] [this account is no longer active]]

This seems to work so far (i had to fix up the script due to changes :) as in it seems to find all file referenced in the SHA512SUMS file.

I'm letting it run over night to see if everything checks out (as in all checksums also verify properly). Since it's an external check by design (it's outside the mozilla infra) it takes a while to download all binaries and checksum them.

Quick note: since /latest/ no longer work I've to do magic to find the latest firefox version, unless there's a good way to get it programmatically?

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

For now http://viewvc.svn.mozilla.org/vc/libs/product-details/json/firefox_versions.json?view=co. There's a project to provide that at product-details.mozilla.org but it's not done yet.

Comment 7

[Guillaume Destuynder [:kang] [this account is no longer active]]

Good enough for me, thanks!
ps: I blew our linode account with the amount of traffic hehe. Don't rely on us running this regularly, but if it's of interest, we could allocate some resources (machine-wise) for it I think. It works :)

Comment 8

[Rail Aliiev [:rail]]

This has been fixed. SHA512SUMS contains only published files.