1324369 - Create a per-channel dashboard

Status: NEW

(Firefox :: Sync, defect, P3)

Description

[Mark Hammond [:markh] [:mhammond]]

From our last meetings, we want something like a "per channel" set of dashboards, to track key metrics by release version so we can identify regressions and celebrate expected fixes. It may even be possible to group some existing queries by version/channel or it may be necessary to create brand new ones - whatever is easiest and gives us what we need.

Comment 1

[Lina Butler [:lina]]

Questions from triage:

* "Key metrics" is likely a subset, but do we want this for general success and failure rates, validation rates, or both?
* It would be useful to compare dashboards for channels.
* "Sync success rates" without accounting for the version doesn't seem useful by itself.
* Release is going to swamp our data. If we introduce an error in Nightly that causes 10% of syncs to fail, we'll only see it as a ~1% change for the combined dashboard.
* The Scala re:dash job is still broken, so we'll want to wait until that's ready, then build our validation dashboards.