1066626 - [UI] Alert Manager should have an table of tests x platforms for when we have many alerts

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

Every 6 weeks we uplift our code from trunk (mozilla-central) to our Aurora (sort of a pre beta) branch.  this usually results in many regressions and improvements which we need to document and understand.

It is difficult to understand what is a real problem when you have a list of 50 alerts, putting these in a table is much easier to understand.  Here is an example table:
https://docs.google.com/spreadsheets/d/1vjGfGE0GqeX5k3C1XeYfNYP_BEGTpUiux0wgwnGNBro/edit?usp=sharing

I envision having a button to toggle a view in the UI where it will go from what we have now, to a table view like we have in the example google docs spreadsheet.  It would be nice if this were per revision, but if we need to do everything that is fine as well.

The parameters:
* Columns: All unique tests that have an alert for a given revision
* Rows: All unique platforms that have an alert for a given revision
* Cells: percent change for that platform/test
** red 10%+ regression
** orange 0-9.9% regression
** blank - no alert
** light green 0-9.9% improvement
** green 10+% improvement

bonus:
* mouse over a cell and have links to graph server, changeset, tbpl, bugs show up!
* click a single button to toggle improvements on/off
* figure out something slick with merged alerts (alerts that show up when we merge the change to another branch)