Closed Bug 1548814 Opened 2 years ago Closed 2 years ago

Migrate ARES6 benchmark to Raptor

Categories

(Testing :: Talos, defect, P1)

Product:
Testing
Component:
Talos
Version:
Version 3
Type:
defect

Tracking

(firefox70 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla70
Tracking Flags:
Tracking Status
firefox70 --- fixed

People

(Reporter: davehunt, Assigned: marauder)

References

Details

Attachments

(1 file)

Bug 1548814 - Migrate ARES6 benchmark to Raptor
47 bytes, text/x-phabricator-request
Details | Review

It appears the Jetstream and ARES6 benchmarks were erroneously disabled when the Talos motionmark suite was removed in bug 1504251. We should restore these benchmarks in the short-term and consider migrating them to Raptor in the future.

Instead of restoring these in Talos, we're going to migrate them to Raptor, THis bug will focus on ARES6 and Jetstream2 will be taken care of in bug 1542046.

Assignee: nobody → marian.raiciof
Status: NEW → ASSIGNED
Summary: Restore Jetstream and ARES6 benchmarks → Migrate ARES6 benchmark to Raptor

Changed the required yml, ini, json, js and html files to migrate ARES6 benchmark test to Raptor.

First push to try : https://treeherder.mozilla.org/#/jobs?repo=try&revision=4d42a6029be42d444cc9ef3bed2bc1ce02510964
There are some failures - i will look into those.

@acreskey
Can you take a look over the comment in the review?

Hi Andrew. Could you please double check this deletion we're doing here? We removed this geomean that ARES6 computes by default, because Raptor already does one automatically, over each of ARES6's subtests.
Flags: needinfo?(acreskey)

Hi Florin, sorry for the delay.
Yes, I've stepped through that and I agree with removing the ARES6 calculated geomean.

Flags: needinfo?(acreskey)

Hi Andrew,
I added a comment to phabricator patch about the metrics: https://phabricator.services.mozilla.com/D34178#1123231
I need your opinion on that.
And as a side note - i already changed the filter from median to mean for raptor.
Thanks!

Flags: needinfo?(acreskey)

Marian -- thank you for the explanation and I agree with the filtering for mean in raptor.

Flags: needinfo?(acreskey)
Pushed by mraiciof@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/9afcb33144f7
Migrate ARES6 benchmark to Raptor r=rwood,perftest-reviewers,igoldan,acreskey

https://hg.mozilla.org/mozilla-central/rev/9afcb33144f7

Status: ASSIGNED → RESOLVED
Closed: 2 years ago
status-firefox70: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla70
You need to log in before you can comment on or make changes to this bug.