1487914 - Add UI event telemetry for New Tab Settings

Status: UNCONFIRMED

(Firefox for iOS :: Telemetry, enhancement)

Description

[Meera Rachamallu [:Meera]]

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:63.0) Gecko/20100101 Firefox/63.0
Build ID: 20180829100131

Comment 1

[Meera Rachamallu [:Meera]]

New Tabs Settings landed in version 13.0, but we could use some telemetry to understand users' preferences on which new tab setting is most popular

Comment 2

[Meera Rachamallu [:Meera]]

Attachment: Github Pull Request

Comment 3

[Meera Rachamallu [:Meera]]

[Request for data collection review form](https://github.com/mozilla/data-review/blob/master/request.md)

1. What questions will you answer with this data?

 - How often do users change their new tab setting?
 - Which new tab setting do users choose?

2. Why does Mozilla need to answer these questions? Are there benefits for users? Do we need this information to address product or business requirements?:

  - We are trying to gauge whether or not users find this functionality useful on iOS to determine whether or not to invest more time in it.

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?

  - There are no alternate ways to determine how popular this feature is and how it is being used.

4. Can current instrumentation answer these questions?

  - No.

5. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox [data collection categories](https://wiki.mozilla.org/Firefox/Data_Collection) on the found on the Mozilla wiki.

Note that the data steward reviewing your request will characterize your data collection based on the highest (and most sensitive) category.

Measurement Description                                  | Data Collection Category | Tracking Bug #
----------------------------------------------------------------------------------------------------
Tapping Top Sites button in New Tab Settings             | Category 2               | Bug 1487914
Tapping Blank Page button in New Tab Settings            | Category 2               | Bug 1487914
Tapping Bookmarks button in New Tab Settings             | Category 2               | Bug 1487914
Tapping History button in New Tab Settings               | Category 2               | Bug 1487914
Tapping Homepage button in New Tab Settings              | Category 2               | Bug 1487914


6. How long will this data be collected?:

  - This data will be permanently monitored.

7. What populations will you measure?

  - The entire Firefox for iOS population (Beta and Release)

8. Please provide a general description of how you will analyze this data.

  - We will determine what percentage and raw total number of our users are using New Tab Settings by device type.
  - We will also query percentages and raw total numbers of our users that perform various actions in the New Tab Settings panel.

9. Where do you intend to share the results of your analysis?

  - Through a dashboard on sql.telemetry.mozilla.org

Comment 4

[Chenxia Liu [:liuche]]

Conditional data-review+ pending two points:

- Since data will be permanently collected, please list the PM or data scientist who will be monitoring this data.
- Add these telemetry probes to the telemetry wiki for Firefox iOS 

Data review:

    Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? (see here, here, and here for examples).

Yes, probes added and documented here in this request, and requested to be added by :Meera


    Is there a control mechanism that allows the user to turn the data collection on and off? (Note, for data collection not needed for security purposes, Mozilla provides such a control mechanism) Provide details as to the control mechanism available.

Yes, will be under Firefox iOS data controls


    If the request is for permanent data collection, is there someone who will monitor the data over time?**

NI for Meera to answer this.

    Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under? **
Type 2, user interaction

    Is the data collection request for default-on or default-off?
Default on

    Does the instrumentation include the addition of any new identifiers (whether anonymous or otherwise; e.g., username, random IDs, etc. See the appendix for more details)?
No

    Is the data collection covered by the existing Firefox privacy notice? If unsure: escalate to legal if:

Yes
    
    Does there need to be a check-in in the future to determine whether to renew the data? (Yes/No) (If yes, set a todo reminder or file a bug if appropriate)**
No, collecting data on new features

Comment 5

[Meera Rachamallu [:Meera]]

(In reply to Chenxia Liu [:liuche] - PTO until 9/7, not actively working on Fennec from comment #4)
> Conditional data-review+ pending two points:
> 
> - Since data will be permanently collected, please list the PM or data
> scientist who will be monitoring this data.
> - Add these telemetry probes to the telemetry wiki for Firefox iOS 
> 
> Data review:
> 
>     Is there or will there be documentation that describes the schema for
> the ultimate data set available publicly, complete and accurate? (see here,
> here, and here for examples).
> 
> Yes, probes added and documented here in this request, and requested to be
> added by :Meera
> 
> 
>     Is there a control mechanism that allows the user to turn the data
> collection on and off? (Note, for data collection not needed for security
> purposes, Mozilla provides such a control mechanism) Provide details as to
> the control mechanism available.
> 
> Yes, will be under Firefox iOS data controls
> 
> 
>     If the request is for permanent data collection, is there someone who
> will monitor the data over time?**
> 
> NI for Meera to answer this.
> 
>     Using the category system of data types on the Mozilla wiki, what
> collection type of data do the requested measurements fall under? **
> Type 2, user interaction
> 
>     Is the data collection request for default-on or default-off?
> Default on
> 
>     Does the instrumentation include the addition of any new identifiers
> (whether anonymous or otherwise; e.g., username, random IDs, etc. See the
> appendix for more details)?
> No
> 
>     Is the data collection covered by the existing Firefox privacy notice?
> If unsure: escalate to legal if:
> 
> Yes
>     
>     Does there need to be a check-in in the future to determine whether to
> renew the data? (Yes/No) (If yes, set a todo reminder or file a bug if
> appropriate)**
> No, collecting data on new features

Telemetry probes have been added to the Telemetry wiki for Firefox for iOS.
The PM monitoring this data will be Maria Popova [:mpopova].

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

Clear a needinfo that is pending on an inactive user.

Inactive users most likely will not respond; if the missing information is essential and cannot be collected another way, the bug maybe should be closed as INCOMPLETE.

For more information, please visit auto_nag documentation.