Closed Bug 1867669 Opened 11 months ago Closed 11 months ago

Look into disabling all live site tests on browsertime

Categories

(Testing :: Raptor, task, P2)

task

Tracking

(firefox122 fixed)

RESOLVED FIXED
122 Branch
Tracking Status
firefox122 --- fixed

People

(Reporter: sparky, Assigned: sparky)

References

(Blocks 1 open bug)

Details

(Whiteboard: [fxp])

Attachments

(1 file)

The live site tests provide limited value, but use quite a bit of our CI capacity. See the following queries for mozilla-central:

For a single commit: https://sql.telemetry.mozilla.org/queries/96271/source
Over 2 weeks: https://sql.telemetry.mozilla.org/queries/96276/source

In a single commit, for android we spend 70% of the cpu hours on live site tests versus all of the tests. Over two weeks it's ~35%. On desktop, it's about 10% over 2 weeks (single commit is 30%).

Note also that these run during peak development hours 3 times a week. We should see if we can disable them temporarily, or find a better way of scheduling them.

Assignee: nobody → gmierz2
Status: NEW → ASSIGNED
Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/b2c7644e41eb Temporarily disable all live site browsertime tests. r=aglavic,perftest-reviewers,taskgraph-reviewers,bhearsum DONTBUILD
Status: ASSIGNED → RESOLVED
Closed: 11 months ago
Resolution: --- → FIXED
Target Milestone: --- → 122 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: