Shouldn't recommend retriggers if we already have 6 runs on both sides

RESOLVED FIXED

Status

Tree Management
Perfherder
RESOLVED FIXED
2 years ago
2 years ago

People

(Reporter: wlach, Assigned: wlach)

Tracking

Details

Attachments

(1 attachment)

We currently recommend retriggers if the confidence isn't high, even if we already have 6 retriggers on both sides:

https://treeherder.allizom.org/perf.html#/compare?originalProject=mozilla-inbound&originalRevision=5e130ad70aa7&newProject=mozilla-inbound&newRevision=59e6b29d756a

If we've completed that many runs a confidence of "low" or "medium" may be as good as it gets. Let's not recommend more in that case.
Created attachment 8641885 [details] [review]
PR
Attachment #8641885 - Flags: review?(jmaher)
Comment on attachment 8641885 [details] [review]
PR

thanks!  I look forward to this and thanks for jumping on it so fast.
Attachment #8641885 - Flags: review?(jmaher) → review+

Comment 3

2 years ago
Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/ed2e392c75d9e3f3c4ae4d98830feb6451c5bf55
Bug 1189826 - Don't recommend retriggering if we have full set of runs

If we already have 6 runs for base / new, more won't really help, even
if we have low/medium confidence.
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.