1371106 - Bug filer should help reduce the number of duplicate bugs filed

Status: NEW

(Tree Management :: Treeherder, enhancement, P3)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

There are times where we end up filing multiple bugs for a single failure. Maybe one sheriff files a bug near the end of their shift, but that bug isn't ingested into the bugscache before the next sheriff takes over, so the new sheriff re-files that same failure as a new bug.


There are a few things we could try with the bug filer to help reduce duplicates:
1. Maybe do a bugzilla search for the soon-to-be-filed bug's summary and warn if it finds one?
2. Query something (bugzilla api or maybe just have Treeherder store data about recently filed bugs) to show the last XX hours' worth of bugs filed by the bug filer account on bugzilla, and show those in the bug filer, especially if key parts of the soon-to-be-filed bug exist in any of the recently filed bugs.


Some combination of this and/or bug 1354295 (reducing the bugscache update interval or eliminating the bugscache entirely) would go a long way to helping sheriffs file fewer duplicated bugs.

Comment 1

[Ed Morley [:emorley]]

I don't suppose you have some example of duplicates, so we can work out the distribution of causes / best solutions?

Possible reasons off the top of my head:
* bugscache didn't yet have the newly filed bug
* the failure for which the new bug was filed occurred before the first bug was filed (since bug suggestions aren't refreshed after they are generated)
* the first bug was missing metadata so wasn't suggested correctly
* the first bug was actually for a slightly different test name/variation but which wants to be combined (this is somewhat unavoidable)
* the first bug was correctly suggested but the user didn't see it / thought it was unrelated, so filed another

Comment 2

[Phil Ringnalda (:philor)]

#2 is what bites me the most, much more than #1. I wake up or come home from work and there's a couple hundred unstarred, and I do https://bugzilla.mozilla.org/buglist.cgi?quicksearch=ALL%20test_multipart_streamconv-byte-by-byte.js