revisit chunking of reftest
Categories
(Testing :: General, enhancement)
Tracking
(firefox68 fixed)
| Tracking | Status | |
|---|---|---|
| firefox68 | --- | fixed |
People
(Reporter: egao, Assigned: egao)
References
Details
Attachments
(1 file)
Summary
Reftest has some chunk rebalancing for the linux platform which can save us a couple of minutes per chunk.
Data
Comparing some platforms:
linux64/opt-reftest-e10s-1:
- setup: 0:04:14
linux64-qr/opt-reftest-e10s-8:
- setup: 0:04:16
As it is possible to see, each chunk takes approx. 4 minute on a typical linux64 machine to set up.
All examples are taken from baseline run:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&tier=1%2C2%2C3&group_state=expanded&revision=e8aebe488b2f2e567940577de25013d00e818f7c&searchStr=linux%2Creftest&selectedJob=243355715
Scope
Scope of this project will be to investigate linux64 primarily:
- reftest on linux64/opt (including QR, shippable, shippable-QR)
- reftest-no-accel on linux64/opt (including QR, shippable, shippable-QR)
linux64-asan, linux64/debug and linux64-ccov/debug types are excluded as each chunk already runs close to the unofficial 30 minute time limit.
Windows/Mac are out of scope due to the already small chunk count.
|
Assignee | |
Updated•5 years ago
|
|
|
Assignee | |
Comment 1•5 years ago
|
||
Pushed by egao@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/3e5fe2fc2f17 task efficiency: re-balance reftest and reftest-no-accel chunking on linux r=gbrown
|
||
Comment 3•5 years ago
|
||
| bugherder | ||
Description
•