beetmover should verify downloaded files

RESOLVED FIXED

Status

Release Engineering
Release Automation
P4
normal
RESOLVED FIXED
a year ago
a month ago

People

(Reporter: rail, Unassigned)

Tracking

(Blocks: 1 bug)

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

a year ago
In Firefox 50.0b6 we hit an issue where beetmover download a corrupted file from TC artifacts (cloud-mirror) and copied it to the candidates directory. The file was 33M instead of 86M. We have to request a purge in bug 1309252 twice, because it wasn't clear why the file was corrupted.

I had to use a "one click loaner" to get all redirect URLs to cloud-mirror, so I can purge the file. I replaced /redirect/ with /purge/ (see cloud-mirror's API) and use "curl -X DELETE ..." to purge the file.

It would be great to:

* print out all redirects, so we can purge files without a loaner

* verify the files somehow. This is tricky...
** we can use checksums if the file is there
** we can check file integrity depending on the format:
*** mar: mar -t?
*** exe, dmg: 7z t?
*** etc.

Comment 1

a year ago
Once bug 1317747 is done, we'll know all our downloaded files match the chain of trust SHAs.  If that's your main concern, that should solve this bug.

Comment 2

a year ago
(In reply to Aki Sasaki [:aki] from comment #1)
> Once bug 1317747 is done, we'll know all our downloaded files match the
> chain of trust SHAs.  If that's your main concern, that should solve this
> bug.

(once release promotion uses scriptworkers)
(Reporter)

Updated

a year ago
Priority: -- → P4
(Reporter)

Updated

a year ago
Summary: beetmover should verify downloaded files if possible → beetmover should verify downloaded files

Comment 3

a month ago
(In reply to Aki Sasaki [:aki] from comment #2)
> (In reply to Aki Sasaki [:aki] from comment #1)
> > Once bug 1317747 is done, we'll know all our downloaded files match the
> > chain of trust SHAs.  If that's your main concern, that should solve this
> > bug.
> 
> (once release promotion uses scriptworkers)

(Which is Fx59+)
Status: NEW → RESOLVED
Last Resolved: a month ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.