Closed Bug 1413565 Opened 4 years ago Closed 2 years ago
[Shield] Opt-out Study: 57 Release New Users Unified Search Study
The main purpose of using Shield is to selectively upgrade Unified Bar users to a more optimal search-first result composition, while leaving the overwhelming majority of existing 2 bar users with the status quo history-first address bar. Evolution of the unified search is not complete in 57. The desire to use Shield is not just to segment new/old users, but also to continue testing and iterating.
Experiment Design Doc here: https://docs.google.com/document/d/1zJ9TVYqmF3Rj1Uj0Z7erLcg-R4-frCRx-deb9r62fIs/edit#heading=h.ai5jyqtpzw23
Matt, I have not logged a legal bug for this study. Do you need one? I am sending intent to ship to relman today.
This study isn't collecting any additional data, so a legal bug is not required.
These studies are now live. It should not return true for anyone until the Release 57 updates go live.
I want to stop recruiting *only* for this study: `pref-flip-search-unification-57-release-1413565` But I want the study to continue running. We do *not* want to stop recruiting for the composition study (it has branches like "sug4gen5"). This study should keep recruiting indefinitely.
Unfortunately there is not a "pause enrollment" function for pref flips the way there is for add-on studies. The options we have are to continue enrolling users or to end the study. CC mythmon as this functionality was in the backlog.
Talking in channel, let's just let this run. I was doing this for the sake of housekeeping, but there's no harm being done. Let's not risk anything.
Actually, "pause enrollment" for pref flips was released a few days ago without any fanfare. Sorry for not letting you know sooner. It should be available for use immediately.
Is it already available in 58 Release? That would be great!
Yes, it is available in 58 release. It is a server side feature (it is implemented in the hosted Actions, not in Normandy Client), so we were able to update it much more quickly.
Enrollment paused. Thanks mythmon!
Study (i.e. both recipes) shut down today. Per mythmon via slack: this recipe looks like it is bitrotted, and starting to fail on at least some Firefoxes: (Pref Flip - Search Composition new users in Release 57 - Bug 1413565) Specifically, the pref it is targetting is a bool now, and it is setting it as a string
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.