Closed Bug 1062453 Opened 7 years ago Closed 7 years ago
create analyzer view for examining classification data
The spicedham classifier will be classifying incoming feedback responses. We need a way to examine the results and also mark correctness. This bug covers: 1. create an analyzer view that pulls from mysql and shows response and flag data 2. add ui bits to mark whether the classifier is wrong (spam-wrong, abuse-wrong) Plus we need: 3. add section that summarizes percent right/wrong for the last 24 hours (not sure how this is going to work, yet) Note: This is purely for the purposes of integrating the spicedham prototype. We're not trying to design infrastructure that will be used outside of this specific need. After we figure out how things should work, it's expected we'll wipe away all this stuff and "start over".
In a PR: https://github.com/mozilla/fjord/pull/343 I didn't do item 3, yet. I think what we really want is to further restrict the view for a specified day so we can reason about all the responses for a given day.
Assignee: nobody → willkg
Status: NEW → ASSIGNED
Making this 2 points because I had to fight with django-cache-machine and I still need to implement item 3 or something equivalent.
Whiteboard: u=dev c=spam p= s=input.2014q3 → u=dev c=spam p=2 s=input.2014q3
Landed in master: https://github.com/mozilla/fjord/commit/0411d912f359983468599cc528a00a5db2448081 Waiting to deploy until Monday.
Pushed to prod last night. Also, I added a set of counts that show total responses, number marked as abuse, number of false positives and number of false negatives since when we pushed the integration.
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.