Closed Bug 1538201 Opened 9 months ago Closed 8 months ago

Incorrect lowerIsBetter for Motionmark's subtests

Categories

(Testing :: Raptor, defect, P2)

defect

Tracking

(firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox68 --- fixed

People

(Reporter: igoldan, Assigned: igoldan)

References

Details

Attachments

(1 file)

According to this comment from bug 1535031, it seems that the subtests have the wrong lowerIsBetter value set. It should be false, like the overall test.

Assignee: nobody → igoldan

Turns out this was a bug in Raptor itself, not in the integration of Motionmark Animometer benchmark.

Type: enhancement → defect
Pushed by igoldan@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/4fc66ecdfa16
Correctly extract subtest_lower_is_better value r=rwood
Status: NEW → RESOLVED
Closed: 8 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
You need to log in before you can comment on or make changes to this bug.