[SHIELD] Study Validation Review for Add-on Recommendation

Status

Shield
General
RESOLVED FIXED
a year ago
a year ago

People

(Reporter: Matt_G, Assigned: Matt_G, NeedInfo)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

a year ago
Theory:
- recommendations are stickier with higher adoption if they follow ux patterns (urlbar)
- contextual recommendations are awesome

Unknowns:
- balancing pushiness to value

Branches:
- no recommendations at all (count 'would offer')
- push open *once* (under some conditions)
- passive only
- NOT DOING: push always, b/c that would be really annoying to users

Measured outcomes by ARM:
- By site:
  - offer vs accept vs 'not for this site'
- Global
  - clicks on never show again
  - took an offer
- Uninstall addon
- General Firefox retention (total days)

Prior art:
There is a concurrent study around heuristics for recommendations. This is more about understanding pushiness and placement of recommendations.

Rollout Plan:
Channel - Release
Deploy date - 08/11/2016
Close enrollment - 08/25/2016

Sample size:
1k participants per arm
3k total participants
(Assignee)

Comment 1

a year ago
Requesting r+ for study validation.
Assignee: glind → mgrimes
Flags: needinfo?(glind)
(Assignee)

Updated

a year ago
Depends on: 1292688
(Assignee)

Updated

a year ago
No longer depends on: 1292688
(Assignee)

Comment 2

a year ago
Resolved over email. Jgaunt will be doing analysis here as well.
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.