Add checks to output of Aggregates Dataset

NEW
Assigned to

Status

Data Platform and Tools
Datasets: Telemetry Aggregates
P3
normal
8 months ago
11 hours ago

People

(Reporter: frank, Assigned: frank)

Tracking

(Blocks: 1 bug)

Details

(Assignee)

Description

8 months ago
We ran into an issue when we switched to Main Pings where Fennec data stopped being aggregated, since it does not send Main Pings. In order to avoid this situation from occurring, we should include sanity checks on the output of the aggregation. We can have any number of checks, but if any checks fail, the Aggregation should fail, and not commit any data. Then we can fix the issue and pickup where we left off.

Possible checks:
1. Max count of pings per-channel-App
2. Total number of histograms/scalars reported
3. Max count of pings per process-type
4. Sum value of select histograms/scalars
5. Total count of select histograms/scalars
6. Number of distinct values per aggregation dimension
7. Number of distinct metrics per aggregation dimension
...etc
(Assignee)

Updated

8 months ago
Priority: -- → P2

Updated

6 months ago
Component: Metrics: Pipeline → Datasets: Telemetry Aggregates
Product: Cloud Services → Data Platform and Tools
(Assignee)

Updated

5 months ago
No longer blocks: 1255755
(Assignee)

Updated

4 months ago
Priority: P2 → P3
(Assignee)

Updated

11 hours ago
Blocks: 1347564
You need to log in before you can comment on or make changes to this bug.