Closed Bug 1551556 Opened 5 years ago Closed 7 months ago

Add support to enable/disable alerting on suite and sub-test level

Categories

(Tree Management :: Perfherder, enhancement, P3)

enhancement

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: whimboo, Unassigned)

References

Details

(Whiteboard: [fxp])

While working on the integration of the YouTube playback performance tests into Raptor, and correctly reporting the results to perfherder I noticed a really high noise for Aarch64 and MacOS, which requires us to disable alerting for those platforms.

Sadly Perfherder doesn't allow to enable / disable alerting for specific platforms or tests whether on the suite nor sub-test level. Instead the results as pushed by the client have to be updated, by having shouldAlert set appropriately.

It would be great if sheriffs could manage that via perfherder directly.

We've talked about the idea of Perfherder having a test configuration screen. This could be a way to offer overrides for the alerting options.

Type: defect → enhancement
Priority: -- → P3
Whiteboard: [fxp]
Status: NEW → RESOLVED
Closed: 7 months ago
Flags: needinfo?(gmierz2)
Resolution: --- → WONTFIX

This hasn't been fixed, and won't be fixed for raptor, but will be resolved once we move to mozperftest for testing as it provides more capabilities for alerting settings.

Flags: needinfo?(gmierz2)
You need to log in before you can comment on or make changes to this bug.