Mark clients as part of an experiment for as long as the experiment is enabled, even if they unenroll
Categories
(Firefox :: Normandy Client, enhancement, P3)
Tracking
()
People
(Reporter: mythmon, Unassigned)
References
(Depends on 1 open bug)
Details
Experiment action types (both add-on and preference) should continue to mark users as a part of an experiment after they unenroll, until the experiment is disabled. This makes data analysis much easier. This isn't data that we couldn't already calculate in Telemetry, but does so in a much more efficient way.
This relies on a new Telemetry API that allows us to mark a user as formerly in an experiment (bug 1557757) and a new Normandy action hook to let actions know about recipes that the user no longer matches (bug 1555160).
|
||
Comment 1•5 years ago
|
||
clarification question: once experiment tagging changes so it persists through life of experiment (versus enrollment status of particular profile), those profiles will also now report their status (active, unenrolled), correct?
That's a distinction we'll need once the experiment tagging behavior changes.
|
Reporter | |
Comment 2•5 years ago
|
||
That's right. The design that I have proposed in bug 1557757 would have a new status field in the experiments field of the environment. It would have values like active and unenrolled, and be visible in any pings that include the environment.
|
|
Reporter | |
Updated•4 years ago
|
|
|
Reporter | |
Comment 3•3 years ago
|
||
Su, I have found myself with some time I could spend on this. Given changes to the data pipeline, is this feature still helpful? I want to make sure it won't mess up any important tools.
|
|
||
Comment 4•3 years ago
|
||
Hi Mythmon,
Thanks for the ping. Not sure this bug is important anymore... since it seems like the active_experiments tag in pings isn't actively being used in any expeirment methodologies.
We've pivoted to matching client id with enrollment pings, which doesn't rely on the experiments tag, so there might not be a need for this work anymore.
|
|
Reporter | |
Comment 5•3 years ago
|
||
That's what I expected. Sorry this idea died on the vine, but seeing as we don't use it anymore, I'm going to close this.
Description
•