Due to limitations in Normandy, this change has six recipes associated with it. This is the result of a combination of two factors that we can't combine recipes for: different preferences per OS, and different action types for Firefox versions.
The first factor is preference per OS. Here we have a straightforward one-recipe-per-os.
The second factor is using Preference Rollout for Firefox 61-64, and using Preference Experiment for 60 and below. I didn't put a lower bound on the latter, and we'll see how far it can go.
Here are the recipes:
- Firefox 61-64
- Firefox <= 60
There are few important things to note about these recipes. I've checked all of these things myself, but it would be good to have more eyes on them.
- For the preference experiment ones (<=60), it is very important that they be set to "high volume" recipes. This changes how Telemetry handles the data from these recipes.
- Pref rollout only works on 61 and above, so the pref rollouts should be targeted at only those versions.
- On the flip side, pref experiments aren't a good tool for this, so we only want to use them where rollouts aren't available (60 and below)
- Normandy has native OS filtering, but I've avoided using it, since it is only available in Firefox 63 and above.
Besides this, the obvious things of checking that the right prefs and the right versions are used would be great.
Ritu, can you take a look at the recipes?
Sylvestre, I think it would be good to get you access to Delivery Console as well, so you could do this kind of review in the future. If that's interesting to you, you can kick off the process by cloning bug 1527780 (except ask for access to stage and prod) to get access to the Normandy servers.