1450016 - [Shield] Opt-out Study: Cloud Storage Phase 2

Status: RESOLVED FIXED

(Shield :: Shield Study, enhancement)

Description

[Punam Dahiya [:pdahiya]]

In this study existing users of cloud storage providers such as Dropbox, Google Drive will be prompted inside download panel to use cloud storage for various features, primarily saving files. 

- From download panel via context menu, existing users of cloud storage providers can select and move downloaded file to their preferred cloud storage.

- Downloads in ‘Download Panel’ will be annotated with provider icon for user to easily differentiate cloud saved files from local downloads.

- User selecting cloud storage as download option can view/update setting under Downloads in about:preferences.

- Supports multiple storage providers Dropbox and Google Drive.

- Easy accessible option to educate users from notification in download panel  to turn off or update settings from about:preferences.

Comment 1

[Punam Dahiya [:pdahiya]]

Shield Study is Web Extension Experiment WIP here https://github.com/mozilla/shield-cloudstorage/tree/cloud-storage-web-ext

Comment 2

[Punam Dahiya [:pdahiya]]

Hi Ilana

NI you for science review approval of attached PHD. Thanks!

Comment 3

[Ilana]

Punam: Caught up with Teon and I'll provide an R+ when I've seen success metrics documented. Thanks!

Comment 4

[MarniePW [:marnie]]

Punam, where are we from your side? What's still outstanding?

Comment 5

[Punam Dahiya [:pdahiya]]

Hi Marnie

Cloud Storage extension (Bug 1441949) is dev complete, peer reviewed and tested by QA (https://github.com/mozilla/shield-cloudstorage) 

Waiting to resolve one last dependency on v5 shield utils, so that we can merge and request final QA review
https://github.com/mozilla/shield-studies-addon-utils/pull/180

A second thread requesting data review should be initiated once we have science review from Ilana.

Thanks!
Punam

Comment 6

[Ilana]

Science review: R+

Comment 7

[Wil Clouser [:clouserw]]

Attachment: Data Steward Review doc

Comment 8

[Robert (rrayborn, he/him)]

Comment on attachment 8982381 [details]
Data Steward Review doc


1) Is there or will there be **documentation** that describes the schema for the ultimate data set available publicly, complete and accurate?
Yes, Github: https://github.com/mozilla/shield-cloudstorage/blob/master/docs/telemetry.json

2) Is there a control mechanism that allows the user to turn the data collection on and off?
Yes, Telemetry or Shield Study prefs

3) If the request is for permanent data collection, is there someone who will monitor the data over time?
Temporary collection for study, re:dash charts in place

4) Using the **[category system of data types](https://wiki.mozilla.org/Firefox/Data_Collection)** on the Mozilla wiki, what collection type of data do the requested measurements fall under?
Low-risk side of Category 3.  Activity such as down occurrences and cloud storage provider usage.


5) Is the data collection request for default-on or default-off?
default-on for users with Telemetry and Shield studies enabled.

6) Does the instrumentation include the addition of **any *new* identifiers** (whether anonymous or otherwise; e.g., username, random IDs, etc.  See the appendix for more details)?
No

7) Is the data collection covered by the existing Firefox privacy notice?
Yes, Telemetry/Shield being standard pathways

8) Does there need to be a check-in in the future to determine whether to renew the data?
No

Comment 9

[Liz Henry (:lizzard) (relman/hg->git project)]

Julian, sounds like this is planned for next Monday for 60, en-US only.

Comment 10

[Punam Dahiya [:pdahiya]]

Extension is in QA right now. Peer review + tracked in bug here https://bugzilla.mozilla.org/show_bug.cgi?id=1441949#c17

Comment 11

[Punam Dahiya [:pdahiya]]

Study has QA + tracked here https://bugzilla.mozilla.org/show_bug.cgi?id=1441949#c24 for en-US 60 launch. 

Julien, Need your go ahead to launch it in 60 channel. Thanks!

Comment 12

[Julien Cristau [:jcristau]]

This is good to go from relman perspective.

Comment 13

[Punam Dahiya [:pdahiya]]

Updating bug with feedback from Shield team. Shield study will enroll user in Firefox 60 but will continue on 61 if user updates to 61. We have requested QA approval for 60 an 61 and targeting launch date of June 27.

NI RyanVM to share this updated plan. Thanks!

Comment 14

[Ryan VanderMeulen [:RyanVM]]

What percentage of the en-US release population is this study being deployed to?

Comment 15

[Ryan VanderMeulen [:RyanVM]]

Nevermind, I was able to confirm our ability to target based on number of users rather than by percentage. And per the PHD, we're aiming for ~10k users per branch, which seems pretty low-risk. Signed off for RelMan.

Comment 16

[MarniePW [:marnie]]

RyanVM this looks like it might slip to tomorrow for release due to testing for 61 finding an issue. Are you comfortable with us launching a study Thursday, June 28, or would you prefer to wait until Monday, July 2?

Comment 17

[Ryan VanderMeulen [:RyanVM]]

Given that this is only targeting ~30k people or so and will run on both 60 and 61, I don't see much reason to delay the rollout.

Comment 18

[Julien Cristau [:jcristau]]

AIUI this is expiring now/soon, so dropping it off the radar for 60.

Comment 19

[Ryan VanderMeulen [:RyanVM]]

What's the current status of this study?

Comment 20

[Punam Dahiya [:pdahiya]]

Hi Ryan

Study has ended and is with Teon Brooks for analysis and final report. Thanks!

Comment 21

[Ryan VanderMeulen [:RyanVM]]

Hi Teon, is there an update on the final report for this?

Comment 22

[Teon Brooks [:teon]]

here's a link to the final report: https://metrics.mozilla.com/~tbrooks/testpilot-reports/cloud-storage_v2/cloud-storage_v2-report.html

Punam and I working on a blog post next week and will include the link to it here.

Comment 23

[Matt Grimes [:Matt_G]]

Looking forward to the blog post. Closing this bug.

Comment 24

[Punam Dahiya [:pdahiya]]

Link in #comment 22 is moved, here is updated link to final report https://metrics.mozilla.com/~tbrooks/testpilot-reports/cloud_storage_v2/index.html

Comment 25

[Punam Dahiya [:pdahiya]]

Blog post with cloud storage shield study findings is posted now at

https://medium.com/firefox-test-pilot/understanding-users-wants-and-needs-for-linking-cloud-storage-providers-d9a300269820

Thanks!