1413565 - [Shield] Opt-out Study: 57 Release New Users Unified Search Study

Status: RESOLVED FIXED

(Shield :: Shield Study, enhancement)

Description

[Shilpi Gupta [:shilpi]]

The main purpose of using Shield is to selectively upgrade Unified Bar users to a more optimal search-first result composition, while leaving the overwhelming majority of existing 2 bar users with the status quo history-first address bar.   Evolution of the unified search is not complete in 57. The desire to use Shield is not just to segment new/old users, but also to continue testing and iterating.

Comment 1

[Shilpi Gupta [:shilpi]]

Experiment Design Doc here: https://docs.google.com/document/d/1zJ9TVYqmF3Rj1Uj0Z7erLcg-R4-frCRx-deb9r62fIs/edit#heading=h.ai5jyqtpzw23

Comment 2

[Shilpi Gupta [:shilpi]]

Matt,  I have not logged a legal bug for this study. Do you need one? 

I am sending intent to ship to relman today.

Comment 3

[Matt Grimes [:Matt_G]]

This study isn't collecting any additional data, so a legal bug is not required.

Comment 4

[Shilpi Gupta [:shilpi]]

Thanks Matt!

Comment 5

[Matt Grimes [:Matt_G]]

These studies are now live. It should not return true for anyone until the Release 57 updates go live.

Comment 6

[Javaun Moradi [:javaun]]

I want to stop recruiting *only* for this study:
`pref-flip-search-unification-57-release-1413565`

But I want the study to continue running. 


We do *not* want to stop recruiting for the composition study (it has branches like "sug4gen5"). This study should keep recruiting indefinitely.

Comment 7

[Matt Grimes [:Matt_G]]

Unfortunately there is not a "pause enrollment" function for pref flips the way there is for add-on studies. The options we have are to continue enrolling users or to end the study. CC mythmon as this functionality was in the backlog.

Comment 8

[Javaun Moradi [:javaun]]

Talking in channel, let's just let this run. I was doing this for the sake of housekeeping, but there's no harm being done. Let's not risk anything.

Comment 9

[Michael Cooper [:mythmon]]

Actually, "pause enrollment" for pref flips was released a few days ago without any fanfare. Sorry for not letting you know sooner. It should be available for use immediately.

Comment 10

[Matt Grimes [:Matt_G]]

Is it already available in 58 Release? That would be great!

Comment 11

[Michael Cooper [:mythmon]]

Yes, it is available in 58 release. It is a server side feature (it is implemented in the hosted Actions, not in Normandy Client), so we were able to update it much more quickly.

Comment 12

[Matt Grimes [:Matt_G]]

Enrollment paused. Thanks mythmon!

Comment 13

[Josh Gaunt [:jgaunt]]

Study (i.e. both recipes) shut down today.

Per mythmon via slack: 

this recipe looks like it is bitrotted, and starting to fail on at least some Firefoxes: (Pref Flip - Search Composition new users in Release 57 - Bug 1413565)

Specifically, the pref it is targetting is a bool now, and it is setting it as a string

Comment 14

[:shell escalante]

closing all experiment bugs - for experiments that have ended.