Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App

RESOLVED FIXED in Firefox 68

Status

Product:
Testing
Component:
Raptor
Type:
enhancement
Importance:
P1
normal
Status:
RESOLVED FIXED
Opened:
3 months ago
Updated:
3 months ago

People

(Reporter: rwood, Assigned: rwood)

Tracking

(Blocks 1 bug)

Version:
Version 3
Target:
mozilla68
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox68 fixed)

Details

Attachments

(1 attachment)

Bug 1545186 - Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest
47 bytes, text/x-phabricator-request
Details | Review

Once the Raptor cold page-load test INI's and taskcluster configs land in Bug 1545175 for Fenix, mirror those for the geckoview example app, for try and mozilla-central tier 2.

Type: defect → enhancement

Once cold page-load on geckoview example app is ready, we will phase these into CI (try/central/trunk) and phase-out the geckoview example app warm page-load tests (move those to central/try only).

Assignee: nobody → rwood
Status: NEW → ASSIGNED
Priority: P2 → P1

Roll this out a few jobs at a time. i.e. for the first 3 tp6m geckoview example cold page-load jobs: try/central/beta/trunk will be tier 1.

For the remainder (tp6m-cold-4 to 14) for geckoview example they will be: try/central only for now due to device availability. That will allow reporting to the mobile health dashboard. Eventually when we have more devices then move those also to try/central/beta/trunk.

As phase them out, Geckoview example warm page-load on try/central will be tier 2.

Summary: Raptor test definitions and taskcluster configs for cold page-load tests on Geckoiew Example App → Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App

Before landing these (mirroring the Fenix cold page-load tests/configs landed in Bug 1545175) make sure the failures being seen on Fenix don't happen on the geckoview example app also: Bug 1547491 and Bug 1547492.

(In reply to Robert Wood [:rwood] from comment #3)

Before landing these (mirroring the Fenix cold page-load tests/configs landed in Bug 1545175) make sure the failures being seen on Fenix don't happen on the geckoview example app also: Bug 1547491 and Bug 1547492.

Those failures only happen when using live sites, not the mitmproxy recordings, so will go ahead with the geckoview example cold page-load tests/configs.

Updated patch (fixed errors in one INI, increased taskcluster job limit since some were timing out, and re-based). Pushed to try:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=9a0bdc2e70430c72f0fe5a21cd701c87461373eb

Pushed by rwood@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d0383e7940c9
Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest r=davehunt

https://hg.mozilla.org/mozilla-central/rev/d0383e7940c9

Status: ASSIGNED → RESOLVED
Closed: 3 months ago
status-firefox68: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla68

:rwood could you file a follow-up for enabling the remaining cold page load tests on trunk?

Flags: needinfo?(rwood)

(In reply to Dave Hunt [:davehunt] [he/him] ⌚️UTC from comment #10)

:rwood could you file a follow-up for enabling the remaining cold page load tests on trunk?

Yes, filed Bug 1550553.

Flags: needinfo?(rwood)
You need to log in before you can comment on or make changes to this bug.