1795467 - Include key metrics from targeting state snapshot in background (update) task

Status: RESOLVED FIXED

(Toolkit :: Application Update, enhancement, P3)

Description

[Nick Alexander :nalexander [he/him]]

Bug 1775138 started taking a snapshot of the current ASRouter targeting state in browsing profiles. The background update task (but in future, potentially other tasks as well) consume any snapshot from the default browsing profile to do additional targeting; in particular, experiments can target "lapsed" users, those who have not used Firefox in some number of days. It would be helpful to capture some key metrics from the default browsing profile targeting snapshot, say:

• did a snapshot exist
• how many days has it been since the snapshot was serialized (currentDate)
• the Firefox version that wrote the snapshot (firefoxVersion)
• profileAgeCreated

Comment 1

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1795467 - Include some targeting in background update Glean telemetry. r?chutten!

This includes some key metrics from the default profile targeting
state in the background update Glean telemetry. It will allow us to
measure the incidence of missing and malformed targeting state JSON,
and how many background update clients have been lapsed for how long.
This in turn will help us understand if the lapsed experiment
targeting is working correctly.

Depends on D164025

Comment 2

[Nick Alexander :nalexander [he/him]]

Attachment: 1795467-data-review-1.md

Comment 3

[Elise Richards]

Comment on attachment 9307238 [details]
1795467-data-review-1.md

Redirecting this data review to me

Comment 4

[Elise Richards]

Comment on attachment 9307238 [details]
1795467-data-review-1.md

Data Review Form

1. Is there or will there be documentation that describes the schema for the ultimate data set in a public, complete, and accurate way?

   • Yes, through the Glean Dictionary.

2. Is there a control mechanism that allows the user to turn the data collection on and off? (Note, for data collection not needed for security purposes, Mozilla provides such a control mechanism) Provide details as to the control mechanism available.

   • Yes, through the normal telemetry opt-out.

3. If the request is for permanent data collection, is there someone who will monitor the data over time?

   • Yes, this a permanent collection. It will be monitored by [e-mail].

4. Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?

   • Category 1 (technical data) and category 2 (interaction data)

5. Is the data collection request for default-on or default-off?

   • Default-on.

6. Does the instrumentation include the addition of any new identifiers (whether anonymous or otherwise; e.g., username, random IDs, etc. See the appendix for more details)?

   • No

7. Is the data collection covered by the existing Firefox privacy notice?

   • Yes

8. Does the data collection use a third-party collection tool? If yes, escalate to legal.

   • No

Result

data-review+

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7c1415829dce
Include some targeting in background update Glean telemetry. r=bytesized,chutten,application-update-reviewers

Comment 6

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/7c1415829dce

Comment 7

[Nick Alexander :nalexander [he/him]]

Comment on attachment 9307003 [details]
Bug 1795467 - Include some targeting in background update Glean telemetry. r?chutten!

Beta/Release Uplift Approval Request

• User impact if declined: None.
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This adds telemetry to background tasks, which is looking healthy on Nightly. This telemetry helps understand the "lapsed user" targeting for background messaging experiments, and we wish to run more such experiments in January.
• String changes made/needed:
• Is Android affected?: No

Comment 8

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 9307003 [details]
Bug 1795467 - Include some targeting in background update Glean telemetry. r?chutten!

Approved for 109.0b9.

Comment 9

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/df026ed3550e