1339616 - Add checks to output of Aggregates Dataset

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, defect, P3)

Description

[Frank Bertsch [:frank]]

We ran into an issue when we switched to Main Pings where Fennec data stopped being aggregated, since it does not send Main Pings. In order to avoid this situation from occurring, we should include sanity checks on the output of the aggregation. We can have any number of checks, but if any checks fail, the Aggregation should fail, and not commit any data. Then we can fix the issue and pickup where we left off.

Possible checks:
1. Max count of pings per-channel-App
2. Total number of histograms/scalars reported
3. Max count of pings per process-type
4. Sum value of select histograms/scalars
5. Total count of select histograms/scalars
6. Number of distinct values per aggregation dimension
7. Number of distinct metrics per aggregation dimension
...etc

Comment 1

[Frank Bertsch [:frank]]

Not doing more work on TMO.