1189826 - Shouldn't recommend retriggers if we already have 6 runs on both sides

Status: RESOLVED FIXED

(Tree Management :: Perfherder, defect)

Description

[William Lachance (:wlach)]

We currently recommend retriggers if the confidence isn't high, even if we already have 6 retriggers on both sides:

https://treeherder.allizom.org/perf.html#/compare?originalProject=mozilla-inbound&originalRevision=5e130ad70aa7&newProject=mozilla-inbound&newRevision=59e6b29d756a

If we've completed that many runs a confidence of "low" or "medium" may be as good as it gets. Let's not recommend more in that case.

Comment 1

[William Lachance (:wlach)]

Attachment: PR

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8641885 [details] [review]
PR

thanks!  I look forward to this and thanks for jumping on it so fast.

Comment 3

[Treeherder GitHub Bugbot]

Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/ed2e392c75d9e3f3c4ae4d98830feb6451c5bf55
Bug 1189826 - Don't recommend retriggering if we have full set of runs

If we already have 6 runs for base / new, more won't really help, even
if we have low/medium confidence.