1150616 - add compare-talos (or equivalent) link to regression bugs template

Status: RESOLVED WONTFIX

(Testing :: Talos, defect)

Description

[Avi Halachmi (:avih)]

Right now the regression bugs template includes the offending changeset and a link to alert manager to get an overview of the performance changes it caused - per suit (tp5/TART/glterrain/etc).

However, on some cases the breakdown to subtests is also important.

Compare-talos can show such breakdown for all tests/subtests on all platforms.

The "old" compare talos (http://compare-talos.mattn.ca/) grabs its data from graph-server and/but mixes up PGO/non-PGO results.

The new compare talos (https://compare-talos.paas.mozilla.org/) grabs its results from DataZilla and doesn't mix PGO/non-PGO, so it's preferable.

Specifically, if we say that the regression on inbound, then the regression bug template should include a new compare-talos link which compares the offending changeset to the previous one on inbound (or any other branch if it's not inbound).

However, DataZilla should be decommissioned soon, and so we'll need something to use the tree herder API instead or a complete replacement for compare-talos within tree herder. This is bug 1142680.