1815714 - Display all data related to a performance comparison on one page, with statistical analysis to aid decision making

Status: RESOLVED FIXED

(Testing :: PerfCompare, enhancement, P4)

Description

[Paul Adenot (:padenot)]

When looking at large performance comparisons (because e.g. I'm changing something very deep in Firefox and anything could happen), it would be great to have one big page with all the data and graphs, so it's very quick to look the general trend. Ideally, everything will be visible at the same time.

Statistical analysis would ideally be computed for all data series.

Aggregation functions are notoriously misleading, and looking at the data is essential. But those same aggregation functions are also quite useful when we've validated that they make sense when looking at the data distribution. Outlier pruning and variation due to the pruning of outliers would also be amazing.

Being able to display a KDE graph for the two revision that are being compared would be really nice, as it turns out lots of our measurements are multi-modal (from the look of it).

Comment 1

[Julien Wajsberg [:julienw] (PTO -> Mar 16)]

In perfcompare, KDE graphs arealready implemented and all results are on one big page.
So I'm gonna close this!