1867669 - Look into disabling all live site tests on browsertime

Status: RESOLVED FIXED

(Testing :: Raptor, task, P2)

Description

[Greg Mierzwinski [:sparky]]

The live site tests provide limited value, but use quite a bit of our CI capacity. See the following queries for mozilla-central:

For a single commit: https://sql.telemetry.mozilla.org/queries/96271/source
Over 2 weeks: https://sql.telemetry.mozilla.org/queries/96276/source

In a single commit, for android we spend 70% of the cpu hours on live site tests versus all of the tests. Over two weeks it's ~35%. On desktop, it's about 10% over 2 weeks (single commit is 30%).

Note also that these run during peak development hours 3 times a week. We should see if we can disable them temporarily, or find a better way of scheduling them.

Comment 1

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1867669 - Temporarily disable all live site browsertime tests. r?#perftest,aglavic

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b2c7644e41eb
Temporarily disable all live site browsertime tests. r=aglavic,perftest-reviewers,taskgraph-reviewers,bhearsum DONTBUILD

Comment 3

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/b2c7644e41eb