1558621 - Reduce Raptor cold page-load tests on android to have one site per suite

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Robert Wood [:rwood]]

Currently the Raptor cold page-load test suites on android (i.e. tp6m-cold-*) have two sites per suite. This is causing some of them to exceed the taskcluster max run time i.e. 30 minutes.

Let's reduce the number of pages to 1 per suite (the same as what is currently done on the tp6 cold page-load desktop suites). This will keep the job times smaller - which also will have the benefit of being able to re-trigger/bisect faster.

Comment 1

[Robert Wood [:rwood]]

:bebe can you please assign this to someone on the SV team and make it P1? Thanks!

Comment 2

[Arnold Iakab]

Attachment: Bug 1558621 Reduce Raptor cold page-load tests on android to have one site per suite

Comment 3

[Robert Wood [:rwood]]

Hi Arnold, thanks for the patch. Please provide a try push running each one of the cold page-load suites (just once) for Fenix, Geckoview, and Fennec - on just one android platform. Thanks!

Comment 4

[Arnold Iakab]

Hi Rob!

https://treeherder.mozilla.org/#/jobs?repo=try&revision=f03587fdf34ac6838e810eba8fee863c6c4bf9f6

Comment 5

[Robert Wood [:rwood]]

This is the latest try push, not ^

https://treeherder.mozilla.org/#/jobs?repo=try&revision=4390dd06187974597ed3b1a6d4cd115a4ed56457&selectedJob=252616057

Comment 6

[Arnold Iakab]

Latest try push:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=a72b91ea20e00bc9f4f4e3d889e03a6f515e0cf3

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6a939548fc90
Reduce Raptor cold page-load tests on android to have one site per suite r=perftest-reviewers,rwood,AlexandruIonescu

Comment 8

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/6a939548fc90