1269040 - figure out how to make talos use tooltool for tp5n.zip

Status: RESOLVED FIXED

(Taskcluster :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

currently talos downloads tp5n.zip from:
http://talos-bundles.pvt.build.mozilla.org/zips/tp5n.zip

this is not accessible from a taskcluster instance, so we need to figure out how to do this- ideally via tooltool.

most likely this will need to be edited in the mozharness taloy.py code (which is in-tree), but I am not sure.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

it looks like there is a pending work item to get tp5n.zip in tooltool in bug 1121049.  I think just putting tp5n.zip on a public interface would be simpler.

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

Isn't that data non-redistributable?

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

as per bug 1234611, we are ok with this pageset being public, and on the instructions found on the wiki page for running the tests locally (https://wiki.mozilla.org/Buildbot/Talos/Tests#tp5n_pages_set), we reference a public .zip file.

Tooltool might not be the most logical, it requires writing code to get data and this makes it more confusing when people edit a .json manifest to define what file they want.  Either way, I think we are fine with any solution where we can put the tp5n.zip file in a public location.

:dustin, do you have common ways that we can define a static file publicly so that taskcluster tasks can use that file?

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

I'd suggest putting it in tooltool for production use, since you get caching and content checking in that case.  For public consumption, dropping it in an S3 bucket is not a bad idea.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

I think we can solve this in bug 1234500 (or use that code)

Comment 6

[Greg Arndt [:garndt]]

bug referenced in comment 5 has been resolved.  Is this still an issue?