Closed Bug 2034152 Opened 6 months ago Closed 3 months ago

Show improvement/regression status in the email alert

Categories

(Testing :: Performance, task, P2)

Product:
Testing
Component:
Performance
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: sparky, Unassigned)

References

(Blocks 1 open bug)

Details

(Whiteboard: [fxp][operational][est-3d])

This bug is for showing the regression/improvement status in the email alerts. Currently, in the dashboard, we do this by taking the extra data, subtracting the before CDF from the after CDF and doing a sum of the differences. Negative means a shift to the right, and if lower_is_better is true, this means it's a regression. Otherwise, if lower_is_better is false, this is an improvement. Positive is a shift to the left and should be interpreted in a similar way with lower_is_better.

Fixed here: https://github.com/mozilla/treeherder/pull/9696

Landed some bug fixes for this here: github.com/mozilla/treeherder/pull/9720

Status: NEW → RESOLVED
Closed: 3 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.