1597991 - Power usage tests on fenix and fennec68

Status: RESOLVED FIXED

(Testing :: Raptor, task, P1)

Description

[Alexandru Irimovici]

Power usage tests should be run on fenix and fennec68.

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

This involves adding the following to the weekly cron job:

• raptor-scn-power-idle-fenix
• raptor-scn-power-idle-bg-fenix

It will also involve adding tasks for the following, and adding them to the weekly cron job:

• raptor-speedometer-fenix-power
• raptor-speedometer-fennec86-power
• raptor-scn-power-idle-fennec86
• raptor-scn-power-idle-bg-fennec86

Comment 2

[Marian Raiciof [:marauder]]

Attachment: Bug 1597991 - created a weekly cron job

Comment 3

[Marian Raiciof [:marauder]]

Attachment: Bug 1597991 - created speedometer tests for fenix and fennec68

Depends on D54155

Comment 4

[Marian Raiciof [:marauder]]

Attachment: Bug 1597991 - created raptor-scn-power-idle and raptor-scn-power-idle-bg for fennec68

Depends on D54156

Comment 5

[Marian Raiciof [:marauder]]

Push to try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=748b4b105fc339a8741326b967350846798c86a0

Comment 6

[Marian Raiciof [:marauder]]

Push to try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=f3d893eed185ce92d2c973e2c2d23847540e9cfd

Comment 7

[Marian Raiciof [:marauder]]

Push to try with the changes that fixed the fenix unit tests for Python 2 "rap" jobs:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=2bfc9ec30b350806e19123d2872cda6cd6928e2a

Comment 8

[Marian Raiciof [:marauder]]

Hey Rob,
I made a few changes to speedometer tests.
If we use 5 pagecycles for fenix speedometer tests - these will be unstable, most of the time, and we can end up with perma fails.
When i changed them to 1 pagecycle, as we already have for geckoview and refbrow:
https://searchfox.org/mozilla-central/rev/8bc24752246aeac8a9aed566cf1caccf88d97d11/testing/raptor/raptor/tests/benchmarks/raptor-speedometer.ini#31,36
the tests are passing on multiple retriggers.

A full pagecycle test for speedometer on fenix varies from 10 to 23 minutes.
A full pagecycle test for speedometer-power on fenix varies from 14 to 19 minutes.

Push to try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=45df5ac1dc10b9554a36e8cf775d3962b94e057b

Comment 9

[Robert Wood [:rwood]]

Good find Marian! Yes we should just be running 1 pagecycle to match geckoview and refbrow. Thanks.

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a208db28a6b4
created a weekly cron job r=perftest-reviewers,davehunt,sparky,alexandru.irimovici
https://hg.mozilla.org/integration/autoland/rev/9976fe43c0da
created speedometer tests for fenix and fennec68 r=perftest-reviewers,rwood,alexandru.irimovici
https://hg.mozilla.org/integration/autoland/rev/e42b9120c419
created raptor-scn-power-idle and raptor-scn-power-idle-bg for fennec68 r=perftest-reviewers,rwood,alexandru.irimovici

Comment 11

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/a208db28a6b4
https://hg.mozilla.org/mozilla-central/rev/9976fe43c0da
https://hg.mozilla.org/mozilla-central/rev/e42b9120c419