1485102 - Add UI event telemetry for Data Management

Status: UNCONFIRMED

(Firefox for iOS :: Telemetry, enhancement)

Description

[Meera Rachamallu [:Meera]]

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:63.0) Gecko/20100101 Firefox/63.0
Build ID: 20180720101508

Comment 1

[Meera Rachamallu [:Meera]]

Attachment: Github Pull Request

Comment 2

[Meera Rachamallu [:Meera]]

Adding some telemetry to see if the new Data Management feature is being used.

Comment 3

[Meera Rachamallu [:Meera]]

[Request for data collection review form](https://github.com/mozilla/data-review/blob/master/request.md)

1. What questions will you answer with this data?

 - How often are users viewing website data?
 - How often are users searching through website data?
 - How often are users deleting all website data?

2. Why does Mozilla need to answer these questions? Are there benefits for users? Do we need this information to address product or business requirements?:

  - We are trying to gauge whether or not users find this functionality useful on iOS to determine whether or not to invest more time in it. The users do not have any benefits from this data. We do not need this information to address any requirements.

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?

  - There are no alternate ways to determine how popular this feature is and how it is being used.

4. Can current instrumentation answer these questions?

  - No.

5. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox [data collection categories](https://wiki.mozilla.org/Firefox/Data_Collection) on the found on the Mozilla wiki.

Note that the data steward reviewing your request will characterize your data collection based on the highest (and most sensitive) category.

Measurement Description                                  | Data Collection Category | Tracking Bug #
----------------------------------------------------------------------------------------------------
Tapping Website Data in Settings/Data Management menu    | Category 2               | Bug 1485102
Tapping on the Search Bar in Settings/Data Management/   | Category 2               | Bug 1485102
Website Data
Tapping "Clear All Website Data" in Settings/            | Category 2               | Bug 1485102
Data Management/Website Data


6. How long will this data be collected?:

  - I want this data to be permanently monitored. (:Meera)

7. What populations will you measure?

  - The entire Firefox for iOS population (Beta and Release)

8. Please provide a general description of how you will analyze this data.

  - We will determine what percentage and raw total number of our users are searching through and clearing website data.
  - We will also query percentages and raw total numbers of our users that perform various actions in the Website Data panel.

9. Where do you intend to share the results of your analysis?

  - Through a dashboard on sql.telemetry.mozilla.org

Comment 4

[Chenxia Liu [:liuche]]

Conditional data-review+ pending two points:

- Instead of listing the engineer (:Meera) to monitor data collection (this is not the engineer's job), please list the PM or data scientist who will be monitoring this data.
- Add these telemetry probes to the telemetry wiki for Firefox iOS 

Data review:

    Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? (see here, here, and here for examples).

Yes, probes added and documented here in this request, and requested to be added by :Meera


    Is there a control mechanism that allows the user to turn the data collection on and off? (Note, for data collection not needed for security purposes, Mozilla provides such a control mechanism) Provide details as to the control mechanism available.

Yes, will be under Firefox iOS data controls


    If the request is for permanent data collection, is there someone who will monitor the data over time?**

NI for Meera to answer this.

    Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under? **
Type 2, user interaction

    Is the data collection request for default-on or default-off?
Default on

    Does the instrumentation include the addition of any new identifiers (whether anonymous or otherwise; e.g., username, random IDs, etc. See the appendix for more details)?
No

    Is the data collection covered by the existing Firefox privacy notice? If unsure: escalate to legal if:

Yes
    
    Does there need to be a check-in in the future to determine whether to renew the data? (Yes/No) (If yes, set a todo reminder or file a bug if appropriate)**
No, collecting usage data for features that haven't been measured

Comment 5

[Meera Rachamallu [:Meera]]

(In reply to Chenxia Liu [:liuche] - PTO until 9/7, not actively working on Fennec from comment #4)
> Conditional data-review+ pending two points:
> 
> - Instead of listing the engineer (:Meera) to monitor data collection (this
> is not the engineer's job), please list the PM or data scientist who will be
> monitoring this data.
> - Add these telemetry probes to the telemetry wiki for Firefox iOS 
> 
> Data review:
> 
>     Is there or will there be documentation that describes the schema for
> the ultimate data set available publicly, complete and accurate? (see here,
> here, and here for examples).
> 
> Yes, probes added and documented here in this request, and requested to be
> added by :Meera
> 
> 
>     Is there a control mechanism that allows the user to turn the data
> collection on and off? (Note, for data collection not needed for security
> purposes, Mozilla provides such a control mechanism) Provide details as to
> the control mechanism available.
> 
> Yes, will be under Firefox iOS data controls
> 
> 
>     If the request is for permanent data collection, is there someone who
> will monitor the data over time?**
> 
> NI for Meera to answer this.
> 
>     Using the category system of data types on the Mozilla wiki, what
> collection type of data do the requested measurements fall under? **
> Type 2, user interaction
> 
>     Is the data collection request for default-on or default-off?
> Default on
> 
>     Does the instrumentation include the addition of any new identifiers
> (whether anonymous or otherwise; e.g., username, random IDs, etc. See the
> appendix for more details)?
> No
> 
>     Is the data collection covered by the existing Firefox privacy notice?
> If unsure: escalate to legal if:
> 
> Yes
>     
>     Does there need to be a check-in in the future to determine whether to
> renew the data? (Yes/No) (If yes, set a todo reminder or file a bug if
> appropriate)**
> No, collecting usage data for features that haven't been measured

Telemetry probes have been added to the Telemetry wiki for Firefox for iOS.
The PM monitoring this data will be Maria Popova [:mpopova].

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

Clear a needinfo that is pending on an inactive user.

Inactive users most likely will not respond; if the missing information is essential and cannot be collected another way, the bug maybe should be closed as INCOMPLETE.

For more information, please visit auto_nag documentation.