Bug filer should suppress some useless crash signatures (or maybe refuse to file the bugs completely?)

RESOLVED FIXED

Status

Tree Management
Treeherder
RESOLVED FIXED
8 months ago
6 months ago

People

(Reporter: KWierso, Assigned: KWierso)

Tracking

Details

Attachments

(1 attachment)

(Assignee)

Description

8 months ago
There's a (non-comprehensive) list of things at https://github.com/mozilla/treeherder/blob/ac04d5ab8c314d046016b501720d1be564b62568/treeherder/model/error_summary.py#L160 which are not helpful for getting good bug suggestions. 

The bug filer should know about that list and either not include crash signatures matching something in the list, or perhaps outright refusing to file a bug with the blacklisted entries.

Comment 1

8 months ago
Created attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master
(Assignee)

Updated

8 months ago
Assignee: nobody → wkocher
(Assignee)

Updated

8 months ago
Attachment #8856873 - Flags: review?(emorley)
(Assignee)

Comment 2

8 months ago
That list might need updating.
Comment on attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master

Have left some comments on the PR :-)
Attachment #8856873 - Flags: review?(emorley) → review-
(Assignee)

Comment 4

7 months ago
Comment on attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master

Removed the copied blacklist and just warn when the selected failure has no search_terms defined or if the summary does not contain a substring of the selected failure's search_terms.
Attachment #8856873 - Flags: review- → review?(emorley)
Comment on attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master

Have left some comments
Attachment #8856873 - Flags: review?(emorley)
(Assignee)

Comment 6

7 months ago
Comment on attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master

How about this?
Attachment #8856873 - Flags: review?(emorley)
Comment on attachment 8856873 [details] [review]
[treeherder] KWierso:b1355339 > mozilla:master

r+ with the comment addressed :-)

Many thanks!
Attachment #8856873 - Flags: review?(emorley) → review+

Comment 8

7 months ago
Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/443ee67652440df89d27b9bb38f26b60dd927be3
Bug 1355339 - Make the bug filer warn when it doesn't match any of the failure's search terms (#2336) r=emorley

If the selected failure has no search_terms defined, the bug being filed will never appear as a suggestion for classification. Warn in this case.

If the bug-to-be-filed's summary does not contain any of the selected failure's search_terms, it will never appear as a suggestion for the classification. Warn in this case. The search terms are displayed in this case so the user can see exactly what needs to be added to make the bug discoverable.
(Assignee)

Updated

7 months ago
Status: NEW → RESOLVED
Last Resolved: 7 months ago
Resolution: --- → FIXED
Depends on: 1364033
You need to log in before you can comment on or make changes to this bug.