1944065 - Modify Translations Perftest Metrics Reporting

Status: RESOLVED FIXED

(Firefox :: Translations, task)

Description

[Erik Nordin [:nordzilla]]

Description

The current Translations perf test runs the test 5 times, and reports only the median of the 5 runs as the single value for the run.

This is not ideal, and we should instead run the test N times, and report the N values as replicates, allowing the test summary value to reflect the full range of data.

Comment 1

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1944065 - Modify translation perftests to report all runs as replicates. r?nordzilla

This patch changes the translation perftests to report all the runs as replicates instead of only the median value. The median value is still reported, and used as the summary value for the subtests

Depends on D235706

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0c70c6b7931f
Modify translation perftests to report all runs as replicates. r=nordzilla,translations-reviewers

Comment 3

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/0c70c6b7931f