Closed Bug 1344239 Opened 9 years ago Closed 9 years ago

Add hindsight monitor for ping sizes

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: gfritzsche, Assigned: trink)

References

(Blocks 1 open bug)

Details

We want: - email alerts to telemetry-client-dev@mozilla.com - graphing over time, per-channel, per-type - regression detection, per-channel, per-type This should give us timely alerts of any regressions in ping sizes, e.g. when a ping is suddenly growing in size or empty.
Assignee: nobody → mreid
Points: --- → 2
Priority: -- → P1
Is per-channel really the right dimension to partition on? It seems like appBuildId or appVersion would be better as they will most likely be what introduces a change in size and we can detect it more rapidly if they aren't hidden in the full channel population.
Flags: needinfo?(gfritzsche)
It is definitely helpful to group by doc type, broken down by channel+buildid, treating the buildids as dates within each channel. This is how the budget report[1] currently works, and you can quickly see an increase in payload size on Nightly from builds between Jan 25th and 26th, and similarly on Aurora between March 8th and 9th. Some improvements that would make things more useful: - Use the product-details metadata[2] or similar to track only official builds (right now it uses heuristics around number of pings observed) - Add ability to track more than two doc types (top ten in terms of total size and count would be nice) - Alerting on significant changes in payload size between builds (the whole point of this bug) - Split out "ESR" as a separate channel, rather than grouping it into Other. - Monitor the 95th percentile of sizes by build in addition to the average to track how close we are to the infrastructure and client-code per-ping limits. - Track some of the TELEMETRY_* histograms that count discarded pings based on size. [1] https://metrics.services.mozilla.com/telemetry-budget-dashboard/ [2] https://product-details.mozilla.org/1.0/
Assignee: mreid → trink
Flags: needinfo?(gfritzsche)
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.