1783155 - Add telemetry that informs how popular each quickaction is

Status: VERIFIED FIXED

(Firefox :: Address Bar, enhancement)

Comment 1

[Dale Harvey (:daleharvey)]

Attachment: Bug 1783155 - Add Scalar to inform which QuickActions are picked.

Comment 2

[Dale Harvey (:daleharvey)]

Comment on attachment 9291941 [details]
Bug 1783155 - Add Scalar to inform which QuickActions are picked.

1. What questions will you answer with this data?

How many users use QuickActions

2. Why does Mozilla need to answer these questions? Are there benefits for users? Do we need this information to address product or business requirements? Some example responses:

To inform feature development

3. What alternative methods did you consider to answer these questions? Why were they not sufficient?

No alternatives possible

4. List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox data collection categories found on the Mozilla wiki.

Measurement Description Data Collection Category Tracking Bug #
quickactions.picked Interaction data 1783155

5. Please provide a link to the documentation for this data collection which describes the ultimate data set in a public, complete, and accurate way.

This collection is documented in its definitions files Histograms.json, Scalars.yaml, and/or Events.yaml and in the Probe Dictionary at https://probes.telemetry.mozilla.org."

6. How long will this data be collected? Choose one of the following:

I want this data to be collected for 6 months initially (potentially renewable).

7. What populations will you measure?

This will be measured initially in nightly and then when the feature is enabled in release

8. If this data collection is default on, what is the opt-out mechanism for users?

Standard telemetry out-out

9. Please provide a general description of how you will analyze this data.

We will use the data to add and remove QuickActions and modify the order in which they are presented to users.

10. Where do you intend to share the results of your analysis?

In code

11. Is there a third-party tool (i.e. not Glean or Telemetry) that you are proposing to use for this data collection? If so:

No

Comment 3

[Chris H-C :chutten]

Attachment: data collection review request

In future, please attach review requests to the bug like so.

Comment 4

[Chris H-C :chutten]

Comment on attachment 9292841 [details]
data collection review request

PRELIMINARY NOTES:
Though your review request asks for 6 months, the code in the patch has expires: never. Assuming that the code is correct (since it's what will land) I've marked you, Dale, as the responsible individual for the non-expiring collection. If you do wish this to expire, please update the patch to expires: 113 (or so) to make it automatically expire. (There will be emails sent and bugs filed on the version before then to ensure there's a solid chance to renew it before it expires). If you do so, please make a comment here in the bug. There will be no need for another data review request in that case.

DATA COLLECTION REVIEW RESPONSE:

Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate?

Yes.

Is there a control mechanism that allows the user to turn the data collection on and off?

Yes. This collection is Telemetry so can be controlled through Firefox's Preferences.

If the request is for permanent data collection, is there someone who will monitor the data over time?

Yes, Dale Harvey is responsible.

Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under?

Category 2, Interaction.

Is the data collection request for default-on or default-off?

Default on for all channels.

Does the instrumentation include the addition of any new identifiers?

No.

Is the data collection covered by the existing Firefox privacy notice?

Yes.

Does the data collection use a third-party collection tool?

No.

---

Result: datareview+

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0169bbd32484
Add Scalar to inform which QuickActions are picked. r=adw

Comment 6

[Marian-Vasile Laza]

https://hg.mozilla.org/mozilla-central/rev/0169bbd32484

Comment 7

[Petruta Horea [:phorea], Desktop QA]

We verified the telemetry results during Nightly sign-off for QA-1573 and our test cases were updated accordingly.