1646470 - Change the metrics performance calculation to use the median of the results instead of the mean

Status: ASSIGNED

(Testing :: mozperftest, enhancement, P3)

Description

[Andrew Creskey [:acreskey]]

Currently we use the mean of subtest results.
It is generally preferable to use the median to minimize the impact of outliers.

Comment 1

[Andrew Creskey [:acreskey]]

Attachment: Bug 1646470 - Change the metrics performance calculation to use the median of the results instead of the mean r=sparky,tarek

It is generally preferable to use the median to minimize the impact of outliers.

Comment 2

[Greg Mierzwinski [:sparky]]

:acreskey, are you planning on finishing this patch or can we close this bug as wontfix?

Comment 3

[Andrew Creskey [:acreskey]]

Ah, I got stuck on learning enough python to implement the requested unit tests.

I'm going to unassign myself from it because I won't be able to do this for a while.

I do still think that it's more useful to take the median rather than the mean.