We currently recommend retriggers if the confidence isn't high, even if we already have 6 retriggers on both sides: https://treeherder.allizom.org/perf.html#/compare?originalProject=mozilla-inbound&originalRevision=5e130ad70aa7&newProject=mozilla-inbound&newRevision=59e6b29d756a If we've completed that many runs a confidence of "low" or "medium" may be as good as it gets. Let's not recommend more in that case.
Comment on attachment 8641885 [details] [review] PR thanks! I look forward to this and thanks for jumping on it so fast.
Commit pushed to master at https://github.com/mozilla/treeherder https://github.com/mozilla/treeherder/commit/ed2e392c75d9e3f3c4ae4d98830feb6451c5bf55 Bug 1189826 - Don't recommend retriggering if we have full set of runs If we already have 6 runs for base / new, more won't really help, even if we have low/medium confidence.