Closed Bug 1783129 Opened 2 years ago Closed 2 years ago

Use a higher confidence threshold when determining whether a form with only a credit card number field as a valid credit card section

Categories

(Toolkit :: Form Autofill, task, P1)

task

Tracking

()

RESOLVED FIXED
106 Branch
Tracking Status
firefox106 --- fixed

People

(Reporter: dlee, Assigned: dlee)

References

Details

(Whiteboard: [fxcm-fathom-cc-p2])

Attachments

(2 files)

Right now, we use 0.5 as the confidence threshold to determine whether input field is a credit card number field.
Before Bug 1775233, a valid credit card section must contain a cc-number field and (a cc-name or a cc-exp field). We remove the constraint in Bug 1775233 so as long as there is a cc-number field in a form, we consider the form as a valid credit card form. The reason we think we can remove the constraint is because we think with fathom, the current cc-number detection model is accurate enough that we don't need addition rule to infer whether a form is a credit card form. However, from the data I saw after removing the constraint, the conversion rate (popup open -> autofill) drops.
I think this means the current model is not precise enough that we can use it as the only source of truth when determining whether a form is a credit card form.
So In this bug, I plan to increase the confidence threshold to see whether it improves the conversion rate.

Whiteboard: [fxcm-fathom-cc-p2]
Depends on: 1783600

In nightly and early beta, we still use 0.5 as the threshold so we can collect more data.
In release, use 0.95 as the threshold

Pushed by dlee@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/cd88dc6570b7
P1. Use a higher confidence threshold when determining whether a form with only a credit card number field as a valid cc section r=sgalich
https://hg.mozilla.org/integration/autoland/rev/ad01d1ce5556
P2. Add a testcase to test cases when the confidence value is below and above the threshold r=sgalich
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 106 Branch
Regressions: 1787703
No longer regressions: 1787703
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: