I want to be able to easily generate summary metrics for a shield pref-flipping experiment. I'd like the metrics to be output in a textual format so they can be included in a report and annotated. I'd like the initial set of metrics to be percentage changes between experiment and base for 4-5 metrics with an included confidence interval. The confidence interval would ideally not rely on a normal hypothesis. An initial set of metrics could include: * Session Length * URI Counts * Total Searches * Crashes Eventually, I'd like there to be similar functionality for all experiment results used to make a decision. I.e. I'd like all experiment summary tools to have textual export functions.
Unlikely I'll make progress in Q1. Hoping to tackle this in Q2
Priority: P1 → P3
Status: NEW → RESOLVED
Last Resolved: 3 months ago
Resolution: --- → DUPLICATE
Duplicate of bug: 1485804
You need to log in before you can comment on or make changes to this bug.