698799 - Add statsd and start tracking things

Status: RESOLVED FIXED

(Input Graveyard :: Backend, defect)

Description

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Before we flip to ElasticSearch, we need to start tracking data.  This bug entails:

- setting up statsd in input
- tracking various things (for example):
  - search 500 errors
  - pagination clicks
  - filters
  - raw searches to sphinx
- setting up potch's statsd toy


When we switch to statsd we can start seeing success and failures and dialing knobs accordingly.

CCing James, in case he has other ideas of what to track.

Comment 1

[James Socol [:jsocol, :james]]

commonware has two very useful Statsd/Graphite middleware bits:

commonware.response.middleware.GraphiteMiddleware - simply increments counters for all your HTTP status codes
commonware.response.middleware.GraphiteRequestTimingMiddleware - times all views, separated by HTTP method

It would be interesting to write some kind of decorator that would log a specific view's non-2xx/3xx responses.

Setting up statsd most likely just means opening some network routes.

[1] https://github.com/jsocol/commonware/blob/master/commonware/response/middleware.py#L56

Comment 2

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

> It would be interesting to write some kind of decorator that would log a
> specific view's non-2xx/3xx responses.

@statsd.errors # <-- better name?
def myview():



and then it uses the package/function name to come up with the key?

e.g. input_error_search_myview?

Comment 3

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

r? https://github.com/mozilla/input.mozilla.org/pull/34

Comment 4

[[github robot]]

Commits pushed to https://github.com/mozilla/input.mozilla.org

https://github.com/mozilla/input.mozilla.org/commit/faec9c30e5de0a4235db0bb982ed3b7c0b22e109
Add statsd + basic data, bug 698799

https://github.com/mozilla/input.mozilla.org/commit/aeeb54b3fb34ac5db8564c78b377db400511ecee
More statsd counters please, bug 698799

Comment 5

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

mbrandt, you know how statsd works.

Comment 6

[[github robot]]

Commits pushed to https://github.com/mozilla/input.mozilla.org

https://github.com/mozilla/input.mozilla.org/commit/faec9c30e5de0a4235db0bb982ed3b7c0b22e109
Add statsd + basic data, bug 698799

https://github.com/mozilla/input.mozilla.org/commit/aeeb54b3fb34ac5db8564c78b377db400511ecee
More statsd counters please, bug 698799