1477416 - Publish dataset devtools_new_user_retention

Status: RESOLVED FIXED

(Data Platform and Tools Graveyard :: Operations, defect, P1)

Description

[Tim Smith (inactive) 👨‍🔬 [:tdsmith]]

Location of the dataset: s3://net-mozaws-prod-us-west-2-pipeline-analysis/tdsmith/devtools_retention/v1/
Desired dataset name: devtools_new_user_retention

For future data archeologists:
The dataset is generated by this Databricks notebook: https://dbc-caf9527b-e073.cloud.databricks.com/#notebook/21955

It tracks the number of new users and the 2-week retention fraction for new Devtools users over time. Users of devtools in each week are screened for new users against a Bloom filter (cached in s3://net-mozaws-prod-us-west-2-pipeline-analysis/tdsmith/devtools_retention/filter.bin) that knows about all devtools-using client_ids ever observed in a 10% sample (by sample_id) of main_summary. The `n` column is the number of new users, which is not adjusted for sampling.

Comment 1

[Tim Smith (inactive) 👨‍🔬 [:tdsmith]]

(I just noticed an error and I'm rebuilding the data set, so if you're looking at it now it won't be present, sorry; it should be done rebuilding in ~an hour)

Comment 2

[Blake Imsland [:robotblake]]

Ran and scheduled.