1578749 - Refactor raptor test INI and taskcluster config files

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement, P3)

Description

[Robert Wood [:rwood]]

Using the existing raptor test INI files and taskcluster configs is fine for the browsertime MVP. However when we move to browsertime in production after that, we need to come up with a better solution for raptor test INI's and taskcluster configs.

For example for tp6 page-load tests, IMO ideally we would have one big list of test URL's that are to be run per commit; and we would have one single test INI (or .json config) that will determine the settings for all tp6 page-load tests. This is similar to what I believe :erahm did for AWSY with playback support.

Then we could have taskcluster transforms automatically create each raptor tp6 job for a single URL; and create the symbol name etc.

Comment 1

[Andrew Halberstadt [:ahal]]

Note, some parts of the taskcluster side of things might depend on bug 1541420. Though I'm sure there are smaller improvements we can make without that one.

Comment 2

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The browsertime taskcluster and manifests are looking much better now. I'm going to resolve this bug.