Closed Bug 1499872 Opened 1 year ago Closed 1 year ago

Measure effect of "Activity Stream Search Filtering" experiment

Categories

(Data Science :: Experiment Collaboration, task, P2)

x86_64
macOS
task

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: harter, Assigned: bmiroglio)

References

Details

From Bug 1483396:

> we would really like to understand the overall effect/lift
> on SAP usage of the 'filtering' experiment as part of our analysis.
> This was the experiment where we filtered search engines
> out of Top Sites for 99% of the 62 population,
> but we held back 1% so these results weren't filtered.
> The slug for this second experiment was
> activity-stream-search-filtering-v1-1483396
>
> Could you run the numbers for this experiment as well?
Requested by Tim Spurway
Assignee: nobody → bmiroglio
Status: NEW → ASSIGNED
The report for this experiment is in review, I will link to it here as soon as the results are verified.
Here is a link to the final, reviewed results:

https://reports-dev.telemetry.mozilla.org/as_fitlers/index.html#Results

In summary (these summary results are global):

* SAP search is up +2.12%
* Google search is up +2.27%
* General topsite click interactions are down -1.94%
* Pinned topsite click interactions did not change
Status: ASSIGNED → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.