Reduce the frequency of android browsertime tests on the toolchains branch
Categories
(Testing :: Raptor, task, P1)
Tracking
(firefox111 fixed)
Tracking | Status | |
---|---|---|
firefox111 | --- | fixed |
People
(Reporter: sparky, Assigned: sparky)
Details
Attachments
(1 file)
I found that we are running Android performance tests on every push in the toolchains branch: https://treeherder.mozilla.org/jobs?repo=toolchains&searchStr=android%2Cbrowsertime
We should either disable them completely, or reduce them to a small handful of tests. If we decide to not disable them completely, then we should reduce their frequency to once per week given our limited capacity for these.
Assignee | ||
Comment 1•1 year ago
|
||
:glandium, what do you think about disabling these performance tests on the toolchains branch?
Comment 2•1 year ago
|
||
The toolchains branch receives pushes at most once a day, but more often twice a week or less. Is that really a problem?
Assignee | ||
Comment 3•1 year ago
|
||
Unfortunately yes, we only have 27 devices available for testing on all of our branches. I'm looking into increasing our capacity but it'll be some time before we get that (assuming we do). Could we instead reduce the tests we run on each commit there to only the browsertime essential tests (6-7 tasks)? That way you'll still have android coverage on this branch.
Assignee | ||
Comment 5•1 year ago
|
||
Ok, thanks :glandium! Patch incoming.
Assignee | ||
Comment 6•1 year ago
|
||
This patch disables most of the android perftests on the toolchain branch. After this patch, only 1 pageload test, and 1 benchmark test will run on android on that branch.
Updated•1 year ago
|
Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/430910bbea14 Run a subset of Android perftests on the toolchain branch. r=perftest-reviewers,AlexandruIonescu
Comment 8•1 year ago
|
||
bugherder |
Description
•