Closed Bug 1545186 Opened 6 years ago Closed 6 years ago

Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App

Categories

(Testing :: Raptor, enhancement, P1)

Version 3
enhancement

Tracking

(firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox68 --- fixed

People

(Reporter: rwood, Assigned: rwood)

References

Details

Attachments

(1 file)

Once the Raptor cold page-load test INI's and taskcluster configs land in Bug 1545175 for Fenix, mirror those for the geckoview example app, for try and mozilla-central tier 2.

Type: defect → enhancement

Once cold page-load on geckoview example app is ready, we will phase these into CI (try/central/trunk) and phase-out the geckoview example app warm page-load tests (move those to central/try only).

Assignee: nobody → rwood
Status: NEW → ASSIGNED
Priority: P2 → P1

Roll this out a few jobs at a time. i.e. for the first 3 tp6m geckoview example cold page-load jobs: try/central/beta/trunk will be tier 1.

For the remainder (tp6m-cold-4 to 14) for geckoview example they will be: try/central only for now due to device availability. That will allow reporting to the mobile health dashboard. Eventually when we have more devices then move those also to try/central/beta/trunk.

As phase them out, Geckoview example warm page-load on try/central will be tier 2.

Summary: Raptor test definitions and taskcluster configs for cold page-load tests on Geckoiew Example App → Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App

Before landing these (mirroring the Fenix cold page-load tests/configs landed in Bug 1545175) make sure the failures being seen on Fenix don't happen on the geckoview example app also: Bug 1547491 and Bug 1547492.

(In reply to Robert Wood [:rwood] from comment #3)

Before landing these (mirroring the Fenix cold page-load tests/configs landed in Bug 1545175) make sure the failures being seen on Fenix don't happen on the geckoview example app also: Bug 1547491 and Bug 1547492.

Those failures only happen when using live sites, not the mitmproxy recordings, so will go ahead with the geckoview example cold page-load tests/configs.

Updated patch (fixed errors in one INI, increased taskcluster job limit since some were timing out, and re-based). Pushed to try:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=9a0bdc2e70430c72f0fe5a21cd701c87461373eb

Pushed by rwood@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/d0383e7940c9 Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest r=davehunt
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68

:rwood could you file a follow-up for enabling the remaining cold page load tests on trunk?

Flags: needinfo?(rwood)

(In reply to Dave Hunt [:davehunt] [he/him] ⌚️UTC from comment #10)

:rwood could you file a follow-up for enabling the remaining cold page load tests on trunk?

Yes, filed Bug 1550553.

Flags: needinfo?(rwood)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: