1643069 - Add telemetry for purple boxes on the monitor card

Status: RESOLVED FIXED

(Firefox :: Protections UI, task, P1)

Description

[:prathiksha]

Purple boxes on the monitor card were made clickable in Fx 78. See https://mozilla.invisionapp.com/share/QWWCC2WH7JY#/screens/408637393.

Comment 1

[:prathiksha]

Attachment: Bug 1643069 - Add telemetry for purple boxes on the monitor card. r?ewright

Comment 2

[:prathiksha]

Attachment: Bug 1643069 - Remove outline on Monitor card blocks. r?ewright

Depends on D79428

Comment 3

[:prathiksha]

Comment on attachment 9156205 [details]
Bug 1643069 - Add telemetry for purple boxes on the monitor card. r?ewright

Request for data collection review form

1. What questions will you answer with this data?

   • Are users navigating to Monitor via the protections dashboard?
   • Are users motivated to add new email addresses to be monitored?
   • Are users visiting Firefox Monitor to view their known breaches or exposed passwords from the dashboard?

2. Why does Mozilla need to answer these questions? Are there benefits for users? Do we need this information to address product or business requirements?

   • We need this information so that the protection dashboard gets credit for sending users to our Monitor product. This can help us make decisions around the usefulness of the dashboard.
   • We also need to understand what type of content motivates our users to use the Monitor product? That is, does our current messaging around monitored emails, unresolved breaches and exposed passwords speak to users? We plan to iteratively improve copy and experience in the dashboard by using this data in the future.

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?
   None

4. Can current instrumentation answer these questions?
   No

5. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox data collection categories on the Mozilla wiki.
   Note that the data steward reviewing your request will characterize your data collection based on the highest (and most sensitive) category.

   security.ui.protections#click - Level 2 Interaction data

6. How long will this data be collected? Choose one of the following:
   This is scoped to a time-limited experiment/project until version 80.

7. What populations will you measure?

   • Which release channels?
     All
   • Which countries?
     All countries
   • Which locales?
     All locales

8. If this data collection is default on, what is the opt-out mechanism for users?
   User can opt out of this telemetry by turning telemetry off.

9. Please provide a general description of how you will analyze this data.

   • We will use this data to understand whether our users find value in the dashboard. For example, does the copy around changing their email preferences, viewing known data breaches or viewing exposed passwords make them want to visit Firefox Monitor?

10. Where do you intend to share the results of your analysis?
    Internally only

11. Is there a third-party tool (i.e. not Telemetry) that you are proposing to use for this data collection? If so:
    Events may be sent to amplitude.

Comment 4

[Chris H-C :chutten]

Attachment: data review request

Please attach future data review requests as attachments to bugs. Easier for Stewards to find that way : )

Comment 5

[Chris H-C :chutten]

Comment on attachment 9156802 [details]
data review request

DATA COLLECTION REVIEW RESPONSE:

    Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate?

Yes. This collection is Telemetry so is documented in its definitions file [Events.yaml](https://hg.mozilla.org/mozilla-central/file/tip/toolkit/components/telemetry/Events.yaml) and the [Probe Dictionary](https://telemetry.mozilla.org/probe-dictionary/).

    Is there a control mechanism that allows the user to turn the data collection on and off?

Yes. This collection is Telemetry so can be controlled through Firefox's Preferences.

    If the request is for permanent data collection, is there someone who will monitor the data over time?

No. This collection will expire in Firefox 80.

    Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?

Category 2, Interaction.

    Is the data collection request for default-on or default-off?

Default on for all channels.

    Does the instrumentation include the addition of any new identifiers?

No.

    Is the data collection covered by the existing Firefox privacy notice?

Yes.

    Does there need to be a check-in in the future to determine whether to renew the data?

Yes. :prathiksha is responsible for renewing or removing the collection before it expires in Firefox 80.

---
Result: datareview+

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d22347a6e41e
Add telemetry for purple boxes on the monitor card. r=ewright
https://hg.mozilla.org/integration/autoland/rev/632c0f1ee377
Remove outline on Monitor card blocks. r=ewright

Comment 7

[Razvan Maries]

https://hg.mozilla.org/mozilla-central/rev/d22347a6e41e
https://hg.mozilla.org/mozilla-central/rev/632c0f1ee377

Comment 8

[:prathiksha]

Comment on attachment 9156205 [details]
Bug 1643069 - Add telemetry for purple boxes on the monitor card. r?ewright

Beta/Release Uplift Approval Request

• User impact if declined: None. This patch collects telemetry that will help developers/Product understand how our users are responding to new changes that were introduced in the protections dashboard in Firefox 78.
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: No
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This is a simple telemetry patch that's been reviewed by our data team. It is also covered by automated tests.
• String changes made/needed: None

Comment 9

[Julien Cristau [:jcristau]]

Can we let this ride 79? We're about to build the last beta so it's fairly late for something like this...

Comment 10

[:prathiksha]

(In reply to Julien Cristau [:jcristau] from comment #9)

Can we let this ride 79? We're about to build the last beta so it's fairly late for something like this...

Hi Julien, this patch absolutely needs to go into 78. The telemetry we're collecting here is for an experiment. It's a low risk developer facing patch. Is there any way you can build with it, please?

Comment 11

[Julien Cristau [:jcristau]]

Comment on attachment 9156205 [details]
Bug 1643069 - Add telemetry for purple boxes on the monitor card. r?ewright

ok then... :/

approved for 78 rc1

Comment 12

[Julien Cristau [:jcristau]]

https://hg.mozilla.org/releases/mozilla-beta/rev/fb866707aa49
https://hg.mozilla.org/releases/mozilla-beta/rev/6716d67b76f8