Open Bug 1573131 Opened 4 months ago Updated Yesterday

Automatically identify backouts

Categories

(Tree Management :: Perfherder, enhancement, P3)

enhancement

Tracking

(Not tracked)

People

(Reporter: igoldan, Unassigned)

Details

Occasionally, a bug lands & causes some obvious perf regressions.
Because some of these bugs cause some functionality tests to fail also, they're backed out by the Code sheriffs.

The backout is then naively interpreted by Perfherder as a perf improvement.
Let's find a way of making Perfherder able to automatically identify these false improvements & label them appropriately.

We should employ some sort of suggestion system which we could then accept or reject.
We cannot simply let Perfherder reassign or tweak alerts like these, because there are likely many edge cases it may miss.

Type: task → enhancement
You need to log in before you can comment on or make changes to this bug.