1423185 - Update document for the event when user finish first run on-boarding

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: Metrics, enhancement)

Description

[Nevin Chen(Not active on Bugzilla)]

Sorry I forget to request data review for bug 1420055. This bug is to update the document.

Comment 1

[Nevin Chen(Not active on Bugzilla)]

Attachment: Bug 1423185 - Update document for the event when user finish first run on-boarding.

Data review request comment:

1. What questions will you answer with this data?
   We want to know when the user exit on-boarding. So we can start to A/B testing on other contextual hints. We don't want to overlap them.

2. Why does Mozilla need to answer these questions? Are there benefits for users?
   We need this information to know if users had done on-boarding

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?
  I can't think of any.

4. Can current instrumentation answer these questions?
   No

5. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox data collection categories on the found on the Mozilla wiki.
   I can't find one for Android

6. How long will this data be collected? Choose one of the following:
   We want to permanently monitor this data. (Joe Cheng)

5. What populations will you measure?
   All Fennec users

6. Which release channels?
   All channels

7.Which countries?
   All countries

8. Which locales?
   All locales

9. Any other filters? Please describe in detail below.
   No

10.Please provide a general description of how you will analyze this data.
   We'd like to use Leanplum to cross-reference those events

11.Where do you intend to share the results of your analysis?
   We'll use it internally

Review commit: https://reviewboard.mozilla.org/r/205418/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/205418/

Comment 2

[Chenxia Liu [:liuche]]

Thank you for remembering to open this request!

Review request form is in the reviewboard request, copied here:

Data review request comment:

1. What questions will you answer with this data?
   We want to know when the user exit on-boarding. So we can start to A/B testing on other contextual hints. We don't want to overlap them.

2. Why does Mozilla need to answer these questions? Are there benefits for users?
   We need this information to know if users had done on-boarding

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?
  I can't think of any.

4. Can current instrumentation answer these questions?
   No

5. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox data collection categories on the found on the Mozilla wiki.
   I can't find one for Android

6. How long will this data be collected? Choose one of the following:
   We want to permanently monitor this data. (Joe Cheng)

5. What populations will you measure?
   All Fennec users

6. Which release channels?
   All channels

7.Which countries?
   All countries

8. Which locales?
   All locales

9. Any other filters? Please describe in detail below.
   No

10.Please provide a general description of how you will analyze this data.
   We'd like to use Leanplum to cross-reference those events

11.Where do you intend to share the results of your analysis?
   We'll use it internally


Data review here:

> Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? (see here, here, and here for examples). Refer to the appendix for "documentation" if more detail about documentation standards is needed.

Yes, review patch documents the new probe and when it is recorded.

> Is there a control mechanism that allows the user to turn the data collection on and off? (Note, for data collection not needed for security purposes, Mozilla provides such a control mechanism) Provide details as to the control mechanism available.

Is part of Leanplum data collection, and covered by that telemetry switch.

> If the request is for permanent data collection, is there someone who will monitor the data over time?**

Joe Cheng

> Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under? **

Type 2, user closes/finishes onboarding

> Is the data collection request for default-on or default-off?

default on

> Does the instrumentation include the addition of any new identifiers (whether anonymous or otherwise; e.g., username, random IDs, etc. See the appendix for more details)?

No new identifiers, sending a ping as part of MMA.

> Is the data collection covered by the existing Firefox privacy notice?

Yes

> Does there need to be a check-in in the future to determine whether to renew the data? (Yes/No) (If yes, set a todo reminder or file a bug if appropriate)**

No

Comment 3

[Chenxia Liu [:liuche]]

Comment on attachment 8934509 [details]
Bug 1423185 - Update document for the event when user finish first run on-boarding.

https://reviewboard.mozilla.org/r/205418/#review211224

data-review+

Comment 4

[Chenxia Liu [:liuche]]

Also, wiki.mo is down for me right now, but can you make sure the Leanplum documentation is updated too?
https://wiki.mozilla.org/Leanplum_Contextual_Hints

Comment 5

[Nevin Chen(Not active on Bugzilla)]

Hi Jean
Could you please help with comment 4? Thanks!

Comment 6

[Nevin Chen(Not active on Bugzilla)]

sorry I forgot to set NI

Comment 7

[Jean Collings]

(In reply to Nevin Chen [:nechen] from comment #6)
> sorry I forgot to set NI

Wiki has already been updated under Hypothesis 6.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7fc6865ed3f2
Update document for the event when user finish first run on-boarding. r=liuche

Comment 9

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/7fc6865ed3f2