1074162 - Reduce iterations or disable b2gperf tests running in CI

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Performance, defect)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The Gaia make test-perf jobs have been running with 30 iterations in CI for some weeks now. It would seem to be a good time to reduce the number of iterations for the b2gperf jobs, or perhaps disable them entirely. It was my understanding that once make test-perf was reliably providing results that we would stop running b2gperf.

If there are no objections I will reduce the number of iterations to 5 for all b2gperf jobs and leave it that way for 1-2 weeks before disabling these jobs. Another 1-2 weeks after that, I will delete the jobs in Jenkins.

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Not sure who the best person to needinfo on this is. Geo: do you have any thoughts/concerns?

Comment 2

[:Eli Perelman]

I have no objections; I support this.

Comment 3

[Geo Mealer [:geo] -- This account is inactive after 2015-07-07]

No objections here. AFAIK, we aren't really looking at the b2gperf results at this point.

Comment 4

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Thanks. I've reduced the iterations to 5 and will disable these jobs entirely in two weeks time unless there are any objections.

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I've now disabled the b2gperf jobs and will delete them in two weeks time unless there are any objections.

Comment 7

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: flame-kk-319_b2g-inbound_perf_b2gperf_config.xml

Comment 8

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: flame-kk-319_mozilla-aurora_perf_b2gperf_config.xml

Comment 9

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: flame-kk-319_mozilla-b2g32_v2_0_perf_b2gperf_config.xml

Comment 10

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I've now deleted these jobs and attached their configuration files to the bug.