1599424 - Convert vismet task output to a perfherder artifact

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement, P1)

Description

[Tarek Ziadé (:tarek)]

This is a follow-up bug from bug 1595789

let's simplify and clean up the vismet task:

• remove the schema stuff in the decision task, we don't use anymore

https://searchfox.org/mozilla-central/source/taskcluster/taskgraph/util/schema.py#132
https://searchfox.org/mozilla-central/source/taskcluster/taskgraph/decision.py#120

• simplify the vismet output.

=> currently: a tarball with one dir per result, with browsertime.json, pages/ and visual-metrics.json
=> proposed: a single file called visual-metrics.json, containing an indexed list of all results from each /<index>/visual-metrics.json file

Comment 1

[Greg Mierzwinski [:sparky]]

This would be great to have! Could that simplified JSON be in a perfherder-data format so we can start monitoring the results?

Comment 2

[Robert Wood [:rwood]]

There's another bug on file for dumping out visual metric results to Perfherder: Bug 1592262

Comment 4

[Tarek Ziadé (:tarek)]

https://github.com/mozilla/treeherder/blob/master/schemas/performance-artifact.json

Comment 5

[Tarek Ziadé (:tarek)]

Attachment: Bug 1599424 - Convert vismet task output to a perfherder artifact

Comment 6

[Tarek Ziadé (:tarek)]

Try run https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=3c38a5865fe92a8adc206435fd8022347e9da3cc&selectedJob=279531273

Comment 7

[Tarek Ziadé (:tarek)]

try run https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=616b693e0534888bf0c7b4a2a51acd5fe0a94d37&selectedJob=279566997

Comment 8

[Tarek Ziadé (:tarek)]

bigger try run https://treeherder.mozilla.org/#/jobs?repo=try&revision=a53457e55badf5f92dabcda5e5158df670cd6464

Comment 9

[Tarek Ziadé (:tarek)]

try run https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=4ec70ad823dd2de75187b1237813b6b145573b13

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/fc1a07c0d43f
Convert vismet task output to a perfherder artifact r=sparky,rwood

Comment 11

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/fc1a07c0d43f