1613479 - [meta] Enable Fenix Browsertime pageload tests in production

Status: RESOLVED FIXED

(Testing :: Raptor, task, P2)

Description

[Greg Mierzwinski [:sparky]]

This is a meta bug for enabling all pageload tests in production for browsertime.

What do we need to do here:

1. Enable Browsertime for all fenix branch tests: https://treeherder.mozilla.org/#/jobs?repo=fenix&tier=1%2C2%2C3&searchStr=raptor&fromchange=02b4582c8d2c425b1bcf83fd0956d17425d5c7e0
2. Enable Browsertime for all mozilla-central branch tests: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=fenix

Currently, we will have 1 week of overlap between the two varieties with both of them running. What happens after that 1 week is TBD at the moment but a comment in this bug will be posted shortly for this.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to Greg Mierzwinski [:sparky] from comment #0)

Currently, we will have 1 week of overlap between the two varieties with both of them running.

Can you please explain what that exactly means?

Comment 2

[Greg Mierzwinski [:sparky]]

What I mean there is that we will have the browsertime and raptor tests running at the same time for at least 1 week at the same frequency.

Comment 3

[Greg Mierzwinski [:sparky]]

Here's a document which contains more info about the Fenix migration (which also elaborates on the transition period): https://docs.google.com/document/d/1EB7p1qJTqUol_EHKVrFpUpXXWfu5UxX7pclTgx5W0bI/edit?usp=sharing

Comment 4

[Greg Mierzwinski [:sparky]]

Try push with all fenix tests (warm+cold) added (see the patch used in that push): https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=9ac5cf90b9f9fb3408f8e6d366a2c36386854ece

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Bug 1621344 is not a pageload test and so doesn't block this bug.