1485650 - Data review for initial rollout

Status: RESOLVED FIXED

(Firefox :: Firefox Monitor, enhancement)

Description

[(inactive) Nihanth Subramanya [:nhnt11]]

The data-review doc is hosted at https://github.com/mozilla/blurts-addon/blob/master/docs/data-review.md

Please also see the Telemetry doc at https://github.com/mozilla/blurts-addon/blob/master/docs/TELEMETRY.md

Comment 1

[Chris H-C :chutten]

Preliminary notes:

The request.md makes references to event telemetry, yet there are no events listed in the request or in the code. This review is only covering the scalars, as far as I can tell.

DATA COLLECTION REVIEW RESPONSE:

    Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? 

https://github.com/mozilla/blurts-addon/blob/master/docs/TELEMETRY.md

In future the collections may be hosted in the m-c Scalars.yaml in which case it will appear in the usual Telemetry places (Probe Dictionary, elsewhere)

    Is there a control mechanism that allows the user to turn the data collection on and off?

Standard Telemetry mechanisms apply.

    If the request is for permanent data collection, is there someone who will monitor the data over time?**

N/A, is not permanent.

    Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?

Category 2, Interaction.

    Is the data collection request for default-on or default-off?

default-on.

    Does the instrumentation include the addition of any new identifiers (whether anonymous or otherwise; e.g., username, random IDs, etc. See the appendix for more details)?

No, only counts.

    Is the data collection covered by the existing Firefox privacy notice? 

Yes.

    Does there need to be a check-in in the future to determine whether to renew the data? 

Yes. :nhnt11, you will be responsible to determine whether to renew or remove these probes before they expire.

---
Result: datareview+

Comment 2

[(inactive) Nihanth Subramanya [:nhnt11]]

Chris, we updated our Telemetry to record events instead of scalars. The docs have been updated in the repo to reflect this. Could you please take another look?

Data-review doc, unchanged except for changing one occurrence of "scalars" to "events": https://github.com/mozilla/blurts-addon/blob/master/docs/data-review.md

Telemetry doc, with updated language (scalars -> events): https://github.com/mozilla/blurts-addon/blob/master/docs/TELEMETRY.md

Code: https://github.com/mozilla/blurts-addon/commit/6a72b0b0f3aedaba32efa84c6f830fca1cebef97

Thanks!

Comment 3

[Chris H-C :chutten]

Thank you for returning this to review.

datareview+ on using Events. They're tied to user interactions and UI elements, and their population is limited to study participants, so the overall volume also isn't of much concern.