Closed Bug 872547 Opened 12 years ago Closed 11 years ago

[elasticsearch] Improve search capabilities by using custom analyzers and an exhaustive mapping

Categories

(Socorro :: Backend, task, P3)

Product:
Socorro
Component:
Backend
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: adrian, Assigned: adrian)

References

Details

We currently use elasticsearch's default analyzer for all our fields, but we have some values that could use something more specific. For example, the standard analyzer doesn't split words on dots, so file name fields like `pluginFilename` will not be split as we would expect. (i.e. we would expect 'file.dll' to become ['file', 'dll'] but it becomes ['file.dll'] at the moment) We need to: - audit all the fields that would require a non-standard analyzer - for each, decide what analyzer will suit best - create the needed custom analyzers in our elasticsearch databases - update our mapping to use those analyzers
Blocks: 678101
I am morphing this bug a little. I have started doing a bit of the analyzer improvement in bug 889334. However, at the moment we rely on elasticsearch to guess what most of our fields should be stored at. We didn't run into any problem so far, but shouldn't rely on it anyway. Consequently, we will need to create a mapping that reflects all the fields that we can store in elasticsearch.
Summary: [elasticsearch] Improve search capabilities by using custom analyzers → [elasticsearch] Improve search capabilities by using custom analyzers and an exhaustive mapping
Blocks: 921479
Commits pushed to master at https://github.com/mozilla/socorro https://github.com/mozilla/socorro/commit/fed6e8e44cf812ed9c39b104617a5a673b3c7452 Fixes bug 872547 - Improved mapping with a list of all fields and better analyzers. https://github.com/mozilla/socorro/commit/31dc5f891cb4de598b89cc5c53ffadd72869ad65 Merge pull request #1687 from AdrianGaudebert/872547-improve-es-mapping Fixes bug 872547 - Improved mapping with a list of all fields and better...
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Commits pushed to master at https://github.com/mozilla/socorro https://github.com/mozilla/socorro/commit/a04c8944e1b357a56bdb9275104682a5b3e03639 Bug 872547 - Use long instead of integer, addons is _not_ a nested JSON object. https://github.com/mozilla/socorro/commit/27e1aca21d7c3db23c7eb1ac76a94515407a95d3 Merge pull request #1694 from AdrianGaudebert/872547-fix-mapping Bug 872547 - Use long instead of integer, addons is _not_ a nested JSON ...
You need to log in before you can comment on or make changes to this bug.