1790817 - Data review for updated Rally Attention Stream study

Status: RESOLVED FIXED

(Data Platform and Tools :: General, task)

Description

[MarniePW [:marnie]]

Attachment: Data probe documentation

+++ This bug was initially created as a clone of Bug #1778367 +++

We have an updated study (Attention Stream) and need to complete a data review. We’re collecting new data points around YouTube advertising and the Google pixel. Additionally, we're incorporating probes from the Facebook Pixel Hunt study that has concluded. We’re trying to get the study launched shortly.

We will make this bug public closer to the launch of the study.

All data documentation, review, and code for this study will also be open, as is all Rally platform and study code.

Data Review form, with links to ancillary forms and documentation:
https://docs.google.com/document/d/1rrvyN1ZpGPpllt8kXp8Z_kJn_lMV8nE4FXpY7a-EJVM/edit#heading=h.9l5a4onxslg7
https://docs.google.com/document/d/1HCEFqlUj5v_Avxb4HfrgHqoOwrCSk0K5As1a9qia_io/edit#heading=h.vt24mgib06bc

Comment 1

[MarniePW [:marnie]]

Attachment: Data review document

Comment 2

[MarniePW [:marnie]]

Frank or Megan, is it possible for one of you to review so we can launch this week? Thanks so much!

Comment 3

[Frank Bertsch [:frank]]

I'm not a data steward so I can't help out here, sorry! Wiki says to reach out to them on Matrix.

Comment 4

[Alessio Placitelli [:Dexter]]

(In reply to MarniePW [:marnie] from comment #2)

Frank or Megan, is it possible for one of you to review so we can launch this week? Thanks so much!

I'd recommend to wait for the new Glean.js release to remove the data collection hack currently being used.

Comment 5

[Ashwin Agarwal]

I'd recommend to wait for the new Glean.js release to remove the data collection hack currently being used.

I saw the GH bug for that; thanks for moving this along so quickly. Do you think it will be possible to cut a new release by tomorrow? We really need to get this extension update uploaded to the AMO store for review, as it is blocking a lot of our urgent user acquisition plans.

Regardless, it would be great to have the rest of the metrics reviewed in the mean time. I've flagged the hack in the doc so that the data steward is aware.

Comment 6

[Alessio Placitelli [:Dexter]]

(In reply to Ashwin Agarwal from comment #5)

I'd recommend to wait for the new Glean.js release to remove the data collection hack currently being used.

I saw the GH bug for that; thanks for moving this along so quickly. Do you think it will be possible to cut a new release by tomorrow? We really need to get this extension update uploaded to the AMO store for review, as it is blocking a lot of our urgent user acquisition plans.

Yes, we're going to cut a new release of Glean.js today. Bruno is working on that, I'm flagging him here so that he can let you know once the new release is available.

Comment 7

[Bruno Rosa [:brosa]]

I just finished creating a new release for Glean.js, 1.2.0.

https://github.com/mozilla/glean.js/releases/tag/v1.2.0

Comment 8

[Ashwin Agarwal]

Just upgraded to Glean.js 1.2.0; thanks again Alessio and Bruno for all your speedy help!

https://github.com/mozilla-rally/rally/pull/267

Comment 9

[Megan McCorquodale]

Comment on attachment 9294636 [details]
Data probe documentation

1. Is there or will there be documentation that describes the schema for the ultimate data set in a public, complete, and accurate way?
   This data will be documented in the probe dictionary as well as in Rally docs.

2. Is there a control mechanism that allows the user to turn the data collection on and off?
   Yes, Rally data collection is double opt in and users can opt out of Rally or telemetry collection altogether.

3. If the request is for permanent data collection, is there someone who will monitor the data over time?
   This will be monitored by the Rally team.

4. Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?
   The data is a combination of Cat 1-4 data.

5. Is the data collection request for default-on or default-off?
   This collection is default off and double opt in - only users who opt in to participate in Rally and provide their data will have this data collected.

6. Does the instrumentation include the addition of any new identifiers?
   No new identifiers.

7. Is the data collection covered by the existing Firefox privacy notice?
   Yes, as this data is only collected for Rally users who opt in to this study.

8. Does the data collection use a third-party collection tool?
   No.

---

data-review +