If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Verify downloaded build artifacts on test runs

RESOLVED WONTFIX

Status

Release Engineering
General
P4
normal
RESOLVED WONTFIX
7 years ago
4 years ago

People

(Reporter: jhford, Assigned: jhford)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Once we have checksum files generated and uploaded to FTP, we should verify these checksums on the slave.

I propose that we do:
-download the build, test and symbols using current code paths
-run a script that:
  -takes artifact download urls as arguments for retries
  -verifies the checksums for each file downloaded
  -on failure will (up to X number of retries):
    -notify through email relevant parties of cache corruption
    -clear the cache
    -download file again
    -re-verify the file
-unpack files using current code paths
Priority: P3 → P4
Depends on: 557336

Comment 1

6 years ago
We don't have the cache now as we use to at that time.
Shall we dupe bug 665559 against this one?
Are you planning on doing this on the build machine or the test machine?
(In reply to comment #1)
> We don't have the cache now as we use to at that time.

That is correct.

> Shall we dupe bug 665559 against this one?

That is for repacks, this is for tests.  We could use the same logic for both, and if that's the case, lets modify this bug to cover both and dupe 665559 against this bug

> Are you planning on doing this on the build machine or the test machine?

It wouldn't be useful to do on the build machine as they are the source of these tarballs in the first place.  We should be verifying artifacts for repacks and tests.

Comment 3

6 years ago
(In reply to comment #2)
> > Are you planning on doing this on the build machine or the test machine?
> 
> It wouldn't be useful to do on the build machine as they are the source of
> these tarballs in the first place.  We should be verifying artifacts for
> repacks and tests.

My reasoning was that if the build job knows that what it just uploaded to ftp is corrupted we could prevent sendchanges from happening but your approach should work too.

Comment 4

6 years ago
I agree that checksum-ing would be an improvement here. Let's make sure that makes it into the mozharness-equiv of this bug.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → WONTFIX
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.