651279 - [tracker] add Elastic Search support to Socorro

Status: RESOLVED FIXED

(Socorro :: General, task, P1)

Description

[Robert Helmer [:rhelmer]]

Currently we use PostgreSQL for reports in the Socorro web UI, such as "Top Crashers", for example:

https://crash-stats.mozilla.com/topcrasher/byversion/Firefox/5.0a2

Behind the scenes, this uses the "top crash by signatures" table in PostgreSQL.

This bug is to track exploring Elastic Search to replace this (and other) reports, and also to investigate new features like faceted search.

Comment 2

[[DEACTIVATED] Adrian Gaudebert]

To test search with elasticsearch on production, here is what you can do: 

1. go to advanced search https://crash-stats.mozilla.com/query?advanced=1
2. run any search you want
3. once the results appear, add `&_force_api_impl=elasticsearch` at the end of the URL and reload
4. you should now get results coming directly from elasticsearch. One easy way of telling it does indeed come from ES is to verify that the number of results is lesser than 1,000
5. if you find a bug, please file! https://bugzilla.mozilla.org/enter_bug.cgi?product=Socorro&component=Middleware

Important note: at the moment, filtering by version is broken! A pull request is open to fix that, https://github.com/mozilla/socorro/pull/1199 (bug 838897)

Comment 3

[[DEACTIVATED] Adrian Gaudebert]

Other note: if you run a new search after having loaded a forced search, the new search won't be using elasticsearch and you will have to force it again by doing step 3.

Comment 4

[Lonnen :lonnen]

retargeting this tracker for the future. not sure if its time to resolve it or not.

Comment 5

[[DEACTIVATED] Adrian Gaudebert]

Let's mark this resolve when we have turned elasticsearch on the main production web app. Should happen when we turn the PHP app off.

Comment 6

[[DEACTIVATED] Adrian Gaudebert]

The PHP app was switched off, the django app is on, elasticsearch is on!