1687048 - New Tab: AS Telmetry for snippets and top sites.

Status: VERIFIED FIXED

(Firefox :: New Tab Page, enhancement, P1)

Description

[Erica Wright [:ewright]]

We have activity stream telemetry for pocket and spocs, but we do not have it for snippets and top sites. We should report these in a similar way to this patch:
https://bugzilla.mozilla.org/show_bug.cgi?id=1681387

Comment 1

[Erica Wright [:ewright]]

Attachment: Bug 1687048 - Add AS Telemetry for Top Sites and Snippets.

Comment 2

[Erica Wright [:ewright]]

Attachment: data request

Comment 3

[Chris H-C :chutten]

Comment on attachment 9198178 [details]
data request

Please indicate the individual responsible for this permanent data collection in your answer for Question 7 and reflag for review.

Comment 5

[Erica Wright [:ewright]]

Comment on attachment 9198178 [details]
data request

>
># Request for data collection review form
>
>adding aditional source event types to this original request: https://bug1672518.bmoattachments.org/attachment.cgi?id=9191365
>
>1) What questions will you answer with this data?
>
>Did users enable/disable Snippets, tops sites, and sponsored top sites in the New Tab both from preferences and from the customize menu. 
>
>2) Why does Mozilla need to answer these questions?  Are there benefits for users? Do we need this information to address product or business requirements? Some example responses:
> 
>We need to know if people are using the customize menu, and which parts of it, for testing purposes.
>
>3) What alternative methods did you consider to answer these questions? Why were they not sufficient?
>none
>
>4) Can current instrumentation answer these questions?
>
>Not in a way that allows us to accurately estimate the number of users that turn on/off these prefs content during the course of a test.
>
>5) List all proposed measurements and indicate the category of data collection for each measurement, using the [Firefox data collection categories](https://wiki.mozilla.org/Firefox/Data_Collection) found on the Mozilla wiki.
>
>A new case for firing an existing telemetry event that captures when users enable/disable Snippets, Tops Sites, and Sponsored Top Sites in the New Tab. | Category 2 |
>existing event: =  "PREF_CHANGED",
>new additional sources = "TOP_SITES"|"SPONSORED_TOP_SITES"|"SNIPPETS"
>
>6) Please provide a link to the documentation for this data collection which describes the ultimate data set in a public, complete, and accurate way.
>
>This file has been updated: browser/components/newtab/docs/v2-system-addon/data_events.md
>
>It will eventually live here:
>https://firefox-source-docs.mozilla.org/browser/components/newtab/docs/v2-system-addon/data_events.html#basic-shape
>
>7) How long will this data be collected?  Choose one of the following:
>
>Permanently. This will be monitored by Kirill Demtchouk.
>
>8) What populations will you measure?
>
>All channels, locales, and countries.
>
>9) If this data collection is default on, what is the opt-out mechanism for users?
>
>The user can opt-out the data collection by disabling Firefox telemetry.
>
>10) Please provide a general description of how you will analyze this data.
>
>Experiment analysis as well as general reporting on Redash.
>
>11) Where do you intend to share the results of your analysis?
>
>This will be shared over Mozilla LDAP via Redash.
>
>12) Is there a third-party tool (i.e. not Telemetry) that you are proposing to use for this data collection? If so:
>
>No.

This will be monitored by Kirill Demtchouk.

Comment 6

[Chris H-C :chutten]

Comment on attachment 9198178 [details]
data request

DATA COLLECTION REVIEW RESPONSE:

Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate?

Yes.

Is there a control mechanism that allows the user to turn the data collection on and off?

Yes. This collection is Telemetry so can be controlled through Firefox's Preferences.

If the request is for permanent data collection, is there someone who will monitor the data over time?

Yes, Kirill Demtchouk is responsible.

Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?

Category 2, Interaction.

Is the data collection request for default-on or default-off?

Default on for all channels.

Does the instrumentation include the addition of any new identifiers?

No.

Is the data collection covered by the existing Firefox privacy notice?

Yes.

Does there need to be a check-in in the future to determine whether to renew the data?

No. This collection is permanent.

---

Result: datareview+

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/02ce57443260
Add AS Telemetry for Top Sites and Snippets. r=thecount

Comment 8

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/02ce57443260

Comment 9

[Marius Coman [:mcoman], Ecosystem QA]

I have verified this enhancement and I can confirm that the related telemetry pings are successfully displayed in the "Browser Console" if the "Top Sites" and the "Snippets" sections are disabled/enabled from the "Customize" menu.

Verified using the latest Firefox Beta (86.0b2 Build ID - 20210126185730) installed on Windows 10 x64, Mac 10.15.7, and Linux Mint 20 x64.