Closed Bug 979662 Opened 11 years ago Closed 11 years ago

single page to determine site health

Categories

(Input Graveyard :: Backend, defect, P1)

Product:
Input Graveyard
Component:
Backend
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: willkg, Assigned: willkg)

Details

(Whiteboard: u=dev c=general p=2 s=input.2014q2)

We need a one-page way to determine whether the Input system is healthy and acting within norms. "Norms" are probably a series of things like HTTP response codes over time, db usage, ES usage, as well as data things like number of happy feedbacks, number of sad feedbacks, number of feedbacks per product, ...
SUMO used to have a statsdash system that pulled from Graphite. I think that sounds like the best option here: build an Input-based statsdash-like system built into Input (i.e. it's in the repository) that pulls the relevant data. This fails if the system is down, but if the system is down, we know it's not working already. For now I think it should track at least the following per 10m interval 1. HTTP responses (200, 403, 500) (from graphite) 2. happy/sad feedback (from ES) 3. feedback per product (from ES) This would have helped diagnose problems with the generic form I just pushed out. :(
Priority: -- → P1
Whiteboard: u=dev c=general p= s=input.2014q1
Another possibility instead of pulling from ES is to make sure those stats make it to Graphite and then pull it all from Graphite. (Probably a better idea.)
Moving this to 2014q2.
Whiteboard: u=dev c=general p= s=input.2014q1 → u=dev c=general p= s=input.2014q2
This is a mediocre skeleton to base it off of: http://people.mozilla.org/~wkahngreene/input-dashboard/ I need to add statsd calls for total, happy, sad and api-based feedback so I can see that. I think I'm going to skip item 3 since I can see that in the product dashboards now.
Assignee: nobody → willkg
I added some statsd calls: https://github.com/mozilla/fjord/commit/9ed76473 That covers item 2. Once that lands, we can close this out. Waiting until Monday to push them.
Whiteboard: u=dev c=general p= s=input.2014q2 → u=dev c=general p=2 s=input.2014q2
Pushed the statsd calls to production. I see them in my dashboard. Done!
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Product: Input → Input Graveyard
You need to log in before you can comment on or make changes to this bug.