1693822 - Need to know which Telemetry probes are being used (in mozaggregates)

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, task, P1)

Description

[Chris H-C :chutten]

For FOG Migration it'd be really handy to have a quick way to check if a given Firefox Telemetry probe is ever being used.

BQ can tell us the SQL folks are running, and we can grep them for column names in telemetry.main. But what if someone's diligently keeping an eye on the health of their probe via TMO Measurement Dashboards? We'll miss that.

Talking with :frank, this could take the form of logging route accesses against the mozaggregator service. But that might be more information than we need. To figure out whether a probe is used, we "only" need to know:

• Name of probe (the mozaggregator-transformed SCREAMING_SNAKE_CASE style is fine)
• Day (server time) it was accessed
• Count of accesses on that day (this one's kinda optional, but I want to be able to sum accesses over time)

I'd also like a pleasant way to query this (dump it into BQ?), but I'd settle for some magic incantations if that's what it takes. I can always pull it to iodide and make a UI there (I think. It's been a while.).

Comment 1

[Frank Bertsch [:frank]]

:hwoo said that we're already exporting logs to GCP Stackdriver. In that case, we can log the request in the app here, and we may be able to export those logs to BQ (or query in stackdriver directly).

Comment 2

[Chris H-C :chutten]

This didn't happen and if it will happen later, it'll be tracked in a different component.