1592746 - Raptor-browsertime perfherder_data includes all known measurements

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P2)

Description

[Greg Mierzwinski [:sparky]]

Raptor-browsertime is currently parsing out all measurements available to it and outputting those into the perfherder-data.json file when it should be restricted based on the measure field in the test manifests: https://dxr.mozilla.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-1-cold.ini#27-31

Here's an example run showing that fnb is being included in the chrome perfherder-data.json when it shouldn't be: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=91d231570e53cf17bc6a5e9609394f7812a33265&selectedJob=273481613

The reason it is included is because of this hardcoded list of measures: https://searchfox.org/mozilla-central/rev/1fe0cf575841dbf3b7e159e88ba03260cd1354c0/testing/raptor/raptor/results.py#311

Comment 1

[Tarek Ziadé (:tarek)]

Attachment: Bug 1592746 - filter measures in perfherder_data

Comment 2

[Tarek Ziadé (:tarek)]

try run https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=62d69d2d82155952e82d8b38307910a5b8f62281

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3e6dcd69d652
filter measures in perfherder_data r=sparky

Comment 4

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/3e6dcd69d652