add compare-talos (or equivalent) link to regression bugs template

RESOLVED WONTFIX

Status

Testing
Talos
RESOLVED WONTFIX
3 years ago
2 months ago

People

(Reporter: avih, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

3 years ago
Right now the regression bugs template includes the offending changeset and a link to alert manager to get an overview of the performance changes it caused - per suit (tp5/TART/glterrain/etc).

However, on some cases the breakdown to subtests is also important.

Compare-talos can show such breakdown for all tests/subtests on all platforms.

The "old" compare talos (http://compare-talos.mattn.ca/) grabs its data from graph-server and/but mixes up PGO/non-PGO results.

The new compare talos (https://compare-talos.paas.mozilla.org/) grabs its results from DataZilla and doesn't mix PGO/non-PGO, so it's preferable.

Specifically, if we say that the regression on inbound, then the regression bug template should include a new compare-talos link which compares the offending changeset to the previous one on inbound (or any other branch if it's not inbound).

However, DataZilla should be decommissioned soon, and so we'll need something to use the tree herder API instead or a complete replacement for compare-talos within tree herder. This is bug 1142680.

Updated

2 months ago
Status: NEW → RESOLVED
Last Resolved: 2 months ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.