Test URL copy feature with users

RESOLVED INCOMPLETE

Status

Hello (Loop)
Client
RESOLVED INCOMPLETE
2 years ago
a year ago

People

(Reporter: RT, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

User Story

Bug 1239965 implemented a feature allowing to prompt users who copy the URL content to create a Hello conversation.
This feature includes the ability to limit the exposure to a percentage of users per channel (Nightly/Aurora/Beta/Release.

Given the potential negative impact that this feature may have if we don't get the user experience right, we want to test it with a limited set of users and if necessary iterate on the UI to get to the right experience.

This bug is about the management of that test plan.

Proposed plan:
1 Expose feature to 10% of beta population (throttle = 10% Beta)
2 Observe metrics
3 Change throttle value based on rules below

Rules to change the throttle value:
- If Ratio “Don’t show this again clicked” / “Copy message displayed” > 50% AND NPS > 20
   Increase the share of the Firefox user base exposed to the feature in 10% increments weekly up to 100% so long as the ratio remains above 50%
- If Ratio “Don’t show this again clicked” / “Copy message displayed” < 50% AND NPS > 20
   Revisit UX for copy action door hanger
Comment hidden (empty)
(Reporter)

Updated

2 years ago
Depends on: 1239965
(Reporter)

Updated

2 years ago
User Story: (updated)
(Reporter)

Comment 1

2 years ago
Sevaan and Ia
(Reporter)

Comment 2

2 years ago
Sevaan and Ian could you please take a look and let me know your thoughts?
Flags: needinfo?(sfranks)
Flags: needinfo?(ianb)
Sounds good to me.
Flags: needinfo?(sfranks)

Updated

2 years ago
Depends on: 1256328

Updated

2 years ago
Depends on: 1274337

Updated

2 years ago
Depends on: 1275598

Updated

2 years ago
Depends on: 1277184
Flags: needinfo?(ianb)

Updated

2 years ago
Depends on: 1283153
Support for Hello/Loop has been discontinued.

https://support.mozilla.org/kb/hello-status

Hence closing the old bugs. Thank you for your support.
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.