717400 - fix sorting for elastic search results

Status: RESOLVED WONTFIX

(support.mozilla.org :: Search, defect)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

Based on https://bugzilla.mozilla.org/show_bug.cgi?id=714849#c3 we should tweak the sorting for ES search results so that the results on top are more like what we're looking for:

"""
Relevancy
---------
Avg Distance from 1st: 2.34 (~1.6 worse than Sphinx)
Median: 0
How often below 1st: 40% (~19%age points worse)
Below 5th: 11% (6%age points worse)
Below 10th: 9% (9%age points worse)

Precision
---------
By Strict: 42%
By Loose: 59%
By Permissive: 86%


So, Relevancy is suffering, we aren't surfacing the best answer as well as we can. Precision is about the same, so ES might not sort the results the exact same way as Sphinx, but it's returning roughly the same set of documents.

Recommendations: focus on tweaks that affect sort first, once that's done we can iterate on matching.
"""

This bug should start with "how are ES results sorted?", then work through options and then implement the best option (or something along those lines).

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Closing this out. Matt is doing parallel work.