1676950 - Performance comparisons should not include replayed, not-replayed and replayed-confidence tasks

Status: RESOLVED FIXED

(Tree Management :: Perfherder, defect)

Description

[Denis Palmeiro [:denispal]]

When comparing two try runs that include tp6 tests, you often see a lot of tasks with "replayed", "not-replayed" or "replayed-confidence" in them. These are not real performance measurements and clutter the results, sometimes making it very difficult to find which tests to focus on. They can also give a false sense of a performance regression or improvement if many of them are green or red, especially if the actual test measurement goes the opposite direction. It would be great to have a way to omit these tasks from the view altogether.

Comment 1

[Ionuț Goldan [:igoldan]]

This has been addressed 2 weeks ago, thanks to Jira issue FXP-1395.