Open Bug 1140452 Opened 5 years ago Updated 4 years ago

Failures from bug 1131287 have to be classified manually since "test.html" returns too many bug suggestions

Categories

(Testing :: web-platform-tests, defect)

defect
Not set

Tracking

(Not tracked)

People

(Reporter: RyanVM, Unassigned)

Details

This means it's a manual star. I'm not sure offhand what's different about these failures.
The search term is presumably "test.html", awful name for the test.
So this is working as expected, since there are 98 bugs that match it:
https://treeherder.mozilla.org/api/bugscache/?search=test.html

Solutions:
a) Rename the test
b) Manually star this one and shrug it off as an edge case
c) Come up with some even more convoluted algorithm for selecting a better search term (eg: if too many results, try using more of the filepath than just the filename and search again using that)

I'm not adverse to (c) per se, but it would be good to know how many other cases this would help (eg the webgl ones?) or if it's just a one off, and so (a) is simpler.
I like the idea of renaming the test.
Flags: needinfo?(james)
Summary: Failures from bug 1131287 hit the "Exceeded max bug suggestions" error → Failures from bug 1131287 have to be classified manually since "test.html" returns too many bug suggestions
Obviously in an ideal world we'd use the mozlog json output, get path and test names from there & have a proper mapping of intermittent failures to tests (would avoid the mis-stars we see occasionally when two tests have the same filename but different path). But that vision is a fair way down the road.
The test can be renamed in m-c and we'll push that change upstream next time we sync.
Flags: needinfo?(james)
This was renamed somewhere yeah?
Component: Treeherder: Data Ingestion → web-platform-tests
Product: Tree Management → Testing
Version: --- → unspecified
You need to log in before you can comment on or make changes to this bug.