Raptor cold page-load tests on Firefox android geckoview
Categories
(Testing :: Raptor, enhancement, P1)
Tracking
(firefox68 fixed)
| Tracking | Status | |
|---|---|---|
| firefox68 | --- | fixed |
People
(Reporter: rwood, Assigned: rwood)
References
Details
Attachments
(1 file)
Add Raptor support to run the tp6m page-load test suites on the android geckoview_example app in cold-load mode i.e. restart the geckoview browser app between each page-cycle.
|
Assignee | |
Comment 1•5 years ago
|
||
Raptor page-load tests will default to running in the new cold page-load mode, but will support running in the (current) warm page-load mode by adding 'warm = true' to the tp6m* test INI. Running in warm page-load mode will add '-warm' to the test name so the results can be differentiated in Perfherder. This way we won't be doubling the current Raptor android jobs running in production when this lands.
|
||
Comment 2•5 years ago
|
||
I guess the number of Raptor android jobs is a bottleneck?
It would be useful to have both cold and warm loads recorded since there can be independent regressions / improvements in either.
|
|
Assignee | |
Comment 3•5 years ago
|
||
(In reply to Andrew Creskey from comment #2)
I guess the number of Raptor android jobs is a bottleneck?
It would be useful to have both cold and warm loads recorded since there can be independent regressions / improvements in either.
Yes correct due to device resources, see https://bugzilla.mozilla.org/show_bug.cgi?id=1529212#c8
|
|
||
Comment 4•5 years ago
|
||
(In reply to Robert Wood [:rwood] from comment #3)
Yes correct due to device resources, see https://bugzilla.mozilla.org/show_bug.cgi?id=1529212#c8
Gotcha, thanks Rob.
|
|
Assignee | |
Comment 5•5 years ago
|
||
(In reply to Robert Wood [:rwood] from comment #1)
Raptor page-load tests will default to running in the new cold page-load mode, but will support running in the (current) warm page-load mode by adding 'warm = true' to the tp6m* test INI. Running in warm page-load mode will add '-warm' to the test name so the results can be differentiated in Perfherder. This way we won't be doubling the current Raptor android jobs running in production when this lands.
Correction, I'll do the opposite. Have 'cold = true' in the INI file, and add '-cold' to the test names. Reason is we want to be able to keep warm page-load results having the same existing test names, so that we can keep comparing with the existing / historical data in Perfherder.
|
|
Assignee | |
Comment 6•5 years ago
|
||
|
|
Assignee | |
Comment 7•5 years ago
|
||
|
|
Assignee | |
Comment 8•5 years ago
|
||
|
|
Assignee | |
Comment 9•5 years ago
|
||
|
||
Comment 10•5 years ago
|
||
Pushed by rwood@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/6b770c5d755a Raptor cold page-load support for Firefox android geckoview; r=jmaher
|
||
Comment 11•5 years ago
|
||
| bugherder | ||
Description
•