1252203 - Add a mode to talos e10s dashboard where we only show release blockers

Status: RESOLVED FIXED

(Tree Management :: Perfherder, defect)

Description

[William Lachance (:wlach)]

:cpeterson requested a mode for the talos e10s dashboard where we only show regressions that would block the release. At the moment this means:

1. A greater than 5% regression in any of:

glterrain
sessionrestore
TART
tpaint
tresize
tps
tp5
tp5o
tcanvasmark
tsvgx
tsvgr_opacity

2. *ANY* regression in any other talos test except for a11yr (which we are ignoring). Since talos is kind of imprecise, I'm going to set the threshold for "regression" at 2%

Comment 1

[Chris Peterson [:cpeterson]]

Thanks, Will. That sounds good.

btw, we are ignoring a11yr for the first phase of e10s (because we are only rolling out to users without a11y or any add-ons). We will care about a11yr in subsequent roll-out phases.

Comment 2

[GitHub Autolander Bot]

Attachment: [treeherder] wlach:1252203 > mozilla:master

Comment 3

[William Lachance (:wlach)]

Comment on attachment 8724883 [details] [review]
[treeherder] wlach:1252203 > mozilla:master

See above for context.

Comment 4

[Treeherder GitHub Bugbot]

Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/d4732ac5c2cb9dd030fbd37ca5008dab73dfc2bb
Bug 1252203 - Add some release blocker features to the e10s dashboard

* Allow to filter results to exclude results which wouldn't block the
  release
* Link to wiki page outlining blocker criteria