990203 - Telemetry - Collect information on how many autofill profiles users save

Status: VERIFIED FIXED

(Toolkit :: Form Autofill, enhancement, P2)

Description

[Sevaan Franks [:sevaan]]

As a Product Owner I want to be able to see data on how many autofill profiles the browser saves for a user so that I can better understand how users are interacting with this feature.

Acceptance Criteria:

- I can view a report that shows me average, median and distribution of numbers of autofill profiles saved by the browser for users.

Comment 1

[Steve Chung [:steveck]]

We could use telemetry scalar and call scalarSet when profile store is updated.

Comment 2

[Zibi Braniecki [:zbraniecki][:gandalf]]

It would be very valuable for us to have this telemetry be keyed on locale to be able to monitor regional differences and spot markets at which our heuristics backfire.

Comment 3

[Jim Mathies [:jimm]]

Not a probe data science has asked for for the mvp.

Comment 4

[chsiang]

Knowing this data can help us prioritize future UI enhancement, for instance, how important it is to allow users to give a nickname to their cards.

Comment 5

[Zibi Braniecki [:zbraniecki][:gandalf]]

Attachment: Bug 990203 - Add profile count telemetry for Credit Card A/B testing. r?abr

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ff551504f2c6
Add profile count telemetry for Credit Card A/B testing. r=abr

Comment 7

[Zibi Braniecki [:zbraniecki][:gandalf]]

Comment on attachment 9166461 [details]
Bug 990203 - Add profile count telemetry for Credit Card A/B testing. r?abr

Beta/Release Uplift Approval Request

User impact if declined: None
Is this code covered by automated tests?: Yes
Has the fix been verified in Nightly?: Yes
Needs manual test from QE?: No
If yes, steps to reproduce:
List of other uplifts needed:
Risk to taking this patch: Low
Why is the change risky/not risky? (and alternatives if risky): It only adds telemetry
String changes made/needed: None

Comment 8

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/ff551504f2c6

Comment 9

[Julien Cristau [:jcristau]]

At the time of the uplift request this can't have been verified in nightly since it wasn't there yet, so can we please verify we're getting the expected data from nightly?

Also, can you point at the data review for this new collection?

Comment 10

[Zibi Braniecki [:zbraniecki][:gandalf]]

(In reply to Julien Cristau [:jcristau] from comment #9)

Also, can you point at the data review for this new collection?

bug 1653073 - data review 2.

Comment 11

[Julien Cristau [:jcristau]]

Comment on attachment 9166461 [details]
Bug 990203 - Add profile count telemetry for Credit Card A/B testing. r?abr

approved for 80.0b5

Comment 12

[Julien Cristau [:jcristau]]

https://hg.mozilla.org/releases/mozilla-beta/rev/e0319d858249

Comment 13

[Cosmin Muntean [:cmuntean], Ecosystem QA]

I have verified the telemetry implemented in this bug on Firefox 80.0b5 (Build ID: 20200806203447) and the latest Nightly 81.0a1 build (Build ID: 20200806215439) on Windows 10 x64, Mac 10.14.6, Linux Mint 19.2and Ubuntu 20.04 x64.
In order to verify this I have used the Credit Card Autofill Metrics Spec document.

• The formautofill.creditCards.autofill_profiles_count scalar is correctly registered and counts every distinct creditcard numbers saved.