1394547 - Create a client-count version that includes all of normandy's population filters

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, enhancement, P3)

Description

[bugzilla]

This may or may not be feasible depending on how many filters Normandy has, but if we were able to create a client count version based on Normandy dimensions we should be able to estimate expected population size before launch. If there are a ton of filters this will be a little more difficult but we could always limit this to pre-release (where this would probably be more useful anyway.)

Comment 1

[Matt Grimes [:Matt_G]]

That would be insanely helpful. +100 for this!

Comment 2

[Frank Bertsch [:frank]]

Matt, to move on this I need a list of all dimensions that Normandy can filter on, and the possible values one can select from each of those dimensions. We'll also need to know how to handle any values that are not selectable - we could just have an OTHER bucket for each dimension.

Once we have those, we'll need to make sure that they are all available in main_summary. If they are, we will be able to run this on historical data; if not, we'll have to wait a bit before we can start using the data (I would recommend at least a month).

Once we have data, it should be straightforward to create another client_count with these dimensions, using the Generic Count View [0].

[0] https://github.com/mozilla/telemetry-batch-view/blob/master/src/main/scala/com/mozilla/telemetry/views/GenericCountView.scala

Comment 3

[Matt Grimes [:Matt_G]]

Osmose can point you to the docs where all of the Normandy filters live. Osmose?

Comment 4

[Osmose [:osmose, :mkelly]]

Docs for filter expressions are here: https://normandy.readthedocs.io/en/latest/user/filter_expressions.html

The info you want is probably everything under the "Context" section.

Comment 5

[David Lawrence [:dkl]]

Moving to General.

Comment 6

[Frank Bertsch [:frank]]

I believe we said this is impossible since Normandy is able to filter by anything in the main ping. Sunah do you remember?

Comment 7

[bugzilla]

That's true, but we can at least get numbers for the most frequently used filters. This may or may not generally be the exact-mau-by-client-count-dimensions table.

Comment 8

[Rob Miller [:rmiller]]

Hello,

The Mozilla Data Engineering organization is currently going through our extensive backlog, consisting of hundreds of issues stretching back for nearly 10 years. We've done a pass through all of the open bugzilla bugs and have identified and tagged the ones that we think are relevant enough to still need attention. The rest, including the bug with which this comment is associated, we are closing as "WONTFIX" in a single bulk operation.

If you feel we have closed this (or any) issue in error, please feel free to take the following actions:

• Reopen the bug.
• Edit the bug to add the string [dataplatform] (including the brackets) to the Whiteboard field. (Note that you must edit the Whiteboard, not the similarly named QA Whiteboard.)

Doing this will ensure that we see the bug in our weekly triage process, where we will decide how to proceed.

Thank you.