Closed Bug 762682 Opened 12 years ago Closed 9 years ago

Provide data normalization for older data, fit new data based on adoption rates

Categories

(Mozilla Metrics :: Frontend Reports, defect)

x86_64
Windows 7
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX
Moved to JIRA

People

(Reporter: taras.mozilla, Unassigned)

References

Details

(Whiteboard: [JIRA STATMOD-21] [Telemetry] -- needs PM project priority)

Please add a 'fancy stat data-fitting' view to telemetry evolution to complement the current 'raw' view.

Telemetry evolution is the most useful telemetry dashboard. It reports builds by build id and lets us see trends.
The main use for this dashboard is to see regressions, optimizations in the field.
Over the past week multiple developers said telemetry would be significantly more useful if it tried to deal with noise in the data.
1) Normalization for older data(ie data over 2 weeks old?):
Unfortunately due to variations in daily usage patterns there is fair bit of noise. Would be great to have a 'normalize' mode to turn daily swings into a straight line.

2) Use an adoption curve to plot new data. It takes about a week to stabilize on the number of reports from a particular build. As of today build from 12-06-01 seems to have been adopted and left behind(ie the number of submissions from that build is not going to increase much in the future). Since early adopters have different performance patterns for later adopters, we could not reliably use this datapoint until today. Would have been useful to have telemetry evolution predict where that point was going to end up based on previous data.
Depends on: 765010
Depends on: 765014
Depends on: 765022
Marking: in group of > 33 asks for Telemetry that need PM priority before triage/scheduling.
Status: NEW → ASSIGNED
Whiteboard: Telemetry -- needs PM project priority
Triaged.
Target Milestone: Unreviewed → Backlogged - BZ
https://metrics.mozilla.com/projects/browse/METRICS-995
Target Milestone: Backlogged - BZ → Targeted - JIRA
Whiteboard: Telemetry -- needs PM project priority → [JIRA STATMOD-21] Telemetry -- needs PM project priority
Whiteboard: [JIRA STATMOD-21] Telemetry -- needs PM project priority → [JIRA STATMOD-21] [Telemetry] -- needs PM project priority
Status: ASSIGNED → RESOLVED
Closed: 9 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.