1085021 - disable some ingestion alerts on datazilla

Status: RESOLVED FIXED

(Datazilla Graveyard :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

It appears we don't need some (or all) of the cold_load_time test for the b2g 319MB device.  Here is where we define the devices and tests:
https://github.com/mozilla/datazilla/blob/master/datazilla/settings/ingestion_alerts.json

Eli, can you clarify what is/isn't tested

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: Link to Github pull-request: https://github.com/mozilla/datazilla/pull/120

This patch removes the b2gperf ingestion reports that are no longer being run. It also cleans up the reports for flame, hamachi, and tarako. We currently have no ingestion report for flame-512, and I'm not familiar enough with the gaia performance tests to know if we have enough coverage here.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8507751 [details] [review]
Link to Github pull-request: https://github.com/mozilla/datazilla/pull/120

this looks like valid json, it appears quite a lot has changed.

Comment 3

[:Eli Perelman]

Comment on attachment 8507751 [details] [review]
Link to Github pull-request: https://github.com/mozilla/datazilla/pull/120

With the test list being resolved, this looks good to me.

Comment 4

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Comment on attachment 8507751 [details] [review]
Link to Github pull-request: https://github.com/mozilla/datazilla/pull/120

Eli: Could you have another look over this? I've added costcontrol and I noticed that we had the apps/tests the wrong way around for the memory results.

Comment 5

[:Eli Perelman]

Comment on attachment 8507751 [details] [review]
Link to Github pull-request: https://github.com/mozilla/datazilla/pull/120

Looks good to me.

Comment 6

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I've merged this, but someone will need to deploy it. I'm not sure of the process, though I think :cturra has been involved in previous updates. Sorry if I'm misremembering!

Comment 7

[Chris Turra [:cturra]]

:davehunt - we can get this deployed for you, but will need a bug filed. see bug 1026554 as a reference to another repo update request.

Comment 8

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Thanks, I've raised bug 1089316.