Migrate ARES6 benchmark to Raptor
Categories
(Testing :: Talos, defect, P1)
Tracking
(firefox70 fixed)
Tracking | Status | |
---|---|---|
firefox70 | --- | fixed |
People
(Reporter: davehunt, Assigned: marauder)
References
Details
Attachments
(1 file)
It appears the Jetstream and ARES6 benchmarks were erroneously disabled when the Talos motionmark suite was removed in bug 1504251. We should restore these benchmarks in the short-term and consider migrating them to Raptor in the future.
Reporter | ||
Comment 1•2 years ago
|
||
Instead of restoring these in Talos, we're going to migrate them to Raptor, THis bug will focus on ARES6 and Jetstream2 will be taken care of in bug 1542046.
Assignee | ||
Comment 2•2 years ago
|
||
Changed the required yml, ini, json, js and html files to migrate ARES6 benchmark test to Raptor.
Assignee | ||
Comment 3•2 years ago
|
||
First push to try : https://treeherder.mozilla.org/#/jobs?repo=try&revision=4d42a6029be42d444cc9ef3bed2bc1ce02510964
There are some failures - i will look into those.
Assignee | ||
Comment 4•2 years ago
|
||
Comment 5•2 years ago
|
||
@acreskey
Can you take a look over the comment in the review?
Hi Andrew. Could you please double check this deletion we're doing here? We removed this geomean that ARES6 computes by default, because Raptor already does one automatically, over each of ARES6's subtests.
Comment 6•2 years ago
|
||
Hi Florin, sorry for the delay.
Yes, I've stepped through that and I agree with removing the ARES6 calculated geomean.
Assignee | ||
Comment 7•2 years ago
•
|
||
Hi Andrew,
I added a comment to phabricator patch about the metrics: https://phabricator.services.mozilla.com/D34178#1123231
I need your opinion on that.
And as a side note - i already changed the filter from median to mean for raptor.
Thanks!
Assignee | ||
Comment 8•2 years ago
|
||
Comment 9•2 years ago
|
||
Marian -- thank you for the explanation and I agree with the filtering for mean in raptor.
Assignee | ||
Comment 10•2 years ago
|
||
Thanks Andrew!
Push to try for the last changes + rebase:
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=5ee4eac70dd0eab60f20a5224d739f4dbcc528cb
Comment 11•2 years ago
|
||
Pushed by mraiciof@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/9afcb33144f7 Migrate ARES6 benchmark to Raptor r=rwood,perftest-reviewers,igoldan,acreskey
Comment 12•2 years ago
|
||
bugherder |
Description
•