1584188 - New Fennec Core Ping Fields

Status: VERIFIED FIXED

(Firefox for Android Graveyard :: Metrics, enhancement, P1)

Description

[Stefan Arentz | :st3fan | ⏰ EST | he/him]

Now that we have a data review confirmed for bug https://bugzilla.mozilla.org/show_bug.cgi?id=1579196 let's implement these new probes.

The fields and the format we want is described in this document:

https://docs.google.com/document/d/1BCjlx8Rl5Sc_sQvbxr1A2w9k4GKT4oId9LfdETL8la4/edit

The goal is to add these to the Core Ping.

My suggestion is to add all of these in bulk in one patch for this bug. Unless we think that is not practical.

Comment 1

[Stefan Arentz | :st3fan | ⏰ EST | he/him]

Note that we do not have a sign off on sending add-on IDs just yet, so lets not go there already.

Comment 2

[Petru-Mugurel Lingurar [:petru]]

Would be great if we could get a description for all of this new fields.
We would then add it to the other ping fields documentation - https://dxr.mozilla.org/mozilla-central/source/toolkit/components/telemetry/docs/data/core-ping.rst
And would also help us greatly in knowing exactly what new data we need to collect.

Comment 3

[Stefan Arentz | :st3fan | ⏰ EST | he/him]

I will start documenting these fields in a bit more detail in the google doc for now. When the work has settled down we should definitely move the descriptions to core-ping.rst.

Comment 4

[Stefan Arentz | :st3fan | ⏰ EST | he/him]

We updated https://docs.google.com/document/d/1BCjlx8Rl5Sc_sQvbxr1A2w9k4GKT4oId9LfdETL8la4 with a FIeld Details section that is similar to how we documented the rest of the ping.

If there are any questions about any of these fields please comment in the google doc.

Maybe it is a good idea to break up the work in a similar way the fennec.* fields are grouped?

Just a confirmation that we decided to not file individual bugs and simply group the patches under this bug.

Comment 5

[Andrei Lazar]

Following the discussion with Stefan we took to break the pings into smaller chunks that are to be added separately so to give time to the data scientists to review each new new fields category.
To make sure we'll adhere to the specifications the first patch will add all fields with default values (the schema structure with stub values) and will be followed with subsequent patches for each fields category.

Comment 6

[Liz Henry (:lizzard) (relman/hg->git project)]

Andrei, I noticed these patches landed and then were backed out, are you still planning to land them again next week for Fennec 68.3?

Comment 7

[Andrei Lazar]

Hey Liz, working on some last minute fixes. Planning to request uplift again by the end of the week.

Comment 8

[Diana Rus]

Hi, received today new try build for Core Ping, testing based on Firefox 68.3.0 esr.
Build download.
I could not check the values through redash.

@Andrei, could you please look why the values are not displayed at redash level? I will put NI on you, thanks.
Screenshot

Comment 9

[Diana Rus]

Hi, verified with Google Pixel 3a (Android 9) on Firefox Nightly 68.3a1 (2019-11-25) through redash, with the structure mentioned in the provided documentation.

Comment 10

[Diana Rus]

Hi, I will set this as verified as the other new ping is treated in bug1583525