Closed Bug 1461520 Opened 7 years ago Closed 7 years ago

Automate exploratory monitors for generic ingestion

Categories

(Data Platform and Tools :: General, enhancement, P1)

Product:
Data Platform and Tools
Component:
General
Type:
enhancement
Points:
2

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: whd, Assigned: whd)

Details

(Whiteboard: [DataOps])

We rolled out our first generic ingestion dataset last week, and it was somewhat painful. While the schema service being worked on in bug #1458734 will help the debugging story significantly, we should also automatically provision analysis plugins on the CEP per-namespace/doctype to monitor "last 10 pings" and "last 10 errors", in a manner similar to how generic ingestion already provisions the parquet outputs.
Priority: P2 → P1
https://github.com/mozilla-services/puppet-config/pull/2744/files These monitors are documented in the relevant section of the generic ingestion readme at https://docs.telemetry.mozilla.org/cookbooks/new_ping.html#cep.
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Component: Pipeline Ingestion → General
You need to log in before you can comment on or make changes to this bug.