1477749 - Add Use Counters to main summary

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, enhancement, P2)

Description

[Mark Reid [:mreid]]

This may be handled by Bug 1391307, but it may be preferable to treat the USE_COUNTER2_*  fields in a special way to simplify their use.

They are effectively uint scalars, so they could be treated as simple top-level fields.

Comment 1

[Georg Fritzsche [:gfritzsche]]

If treating the use counters as scalars, we need to make sure to also have fields for their unit (page load counts & document load counts). These are included in each use counter histogram currently.

Note that the use counters are not listed in Histograms.json, but they are available in the probe info service. [1]
(The list of use counters is generated from Gecko source files using a Python script.)
See the probe dictionary for a list of use counters:
https://telemetry.mozilla.org/probe-dictionary/?search=use_counter2_

1: https://github.com/mozilla/probe-scraper

Comment 2

[Mark Reid [:mreid]]

Georg, would you recommend fetching the list of use counters from the probe dictionary? Or running the probe scraper as part of the dataset generation?

Comment 3

[Georg Fritzsche [:gfritzsche]]

I recommend using the probe info service.
That's the service / interface that's aiming to provide the data of what probes our products have, so that data jobs don't have to run their own code for this.

Comment 4

[Mark Reid [:mreid]]

Use counters are available in the main ping table. I don't think we need them in main_summary anymore.