1362418 - Run a Telemetry experiment to enable Intersection Observer API on Firefox Beta 54

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, enhancement)

Description

[Tobias Schneider [:tobytailor]]

We want to A/B test enabling the Intersection API in Firefox beta 54 on all platforms. The idea is that Beta users who qualify will have the API enabled (via pref dom.IntersectionObserver.enabled); We want to switch half of these users to compare the stability between the two different groups.

Proposed Criteria:

>      Product: Firefox Beta
>      Version: 54.0b6-54.0b7
>           OS: all
>      Channel: beta
>     Build ID: 2017-05-08+
>     Language: en-US
> Sample ratio: 50%
>   Start Date: May 8, 2017
>     End Date: June 5, 2017

Comment 1

[Tobias Schneider [:tobytailor]]

Attachment: intersection-observer-experiment

Comment 2

[Tobias Schneider [:tobytailor]]

Attachment: experiment.xpi

Comment 3

[Tobias Schneider [:tobytailor]]

Jason, can you please sign the attached dpi?

Comment 4

[Tobias Schneider [:tobytailor]]

Jason, can you please sign the attached xpi?

Comment 5

[Jason Thomas [:jason]]

Attachment: experiment.xpi signed

Please see attached.

Comment 6

[Tobias Schneider [:tobytailor]]

Attachment: intersection-observer-experiment

Final patch to land including signed add-on, using sample value of .4 to target ~20% of the beta population to have the IntersectionObserver API enabled.

Comment 7

[Tobias Schneider [:tobytailor]]

Attachment: experiment.xpi

Updated add-on to work on 54.0b6 through 54.0b13. We need to have this signed one more time.

Comment 8

[Jason Thomas [:jason]]

Attachment: experiment.xpi signed

Please see attached.

Comment 9

[Tobias Schneider [:tobytailor]]

Attachment: intersection-observer-experiment

Updated patch to land. Manually tested on local telemetry server.

Comment 10

[Tobias Schneider [:tobytailor]]

Felipe, can we get this staged please? We got a go from r-d and its manually tested.

Comment 11

[:Felipe Gomes (needinfo for replies!)]

https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/4086420fdadc
https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/752f9014009c

Landed and tagged release_tag. Just wait for it to appear on the staging server (https://telemetry-experiment-dev.allizom.org/) to see if all experiment parameters are as expected, then you can file a bug to deploy it.

The length of this experiment is a bit bigger than the usual. If you get enough data before the specified date, let me know so that we could stop it earlier.

Comment 12

[Hsin-Yi Tsai (she/her) [:hsinyi]]

Tobias, looks you are handling this already, so I am assigning this to you. Feel free to re-assign. Thanks!