Run a Telemetry experiment to enable Intersection Observer API on Firefox Beta 54

NEW
Assigned to

Status

()

Core
DOM
2 months ago
2 months ago

People

(Reporter: tobytailor, Assigned: tobytailor)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(3 attachments, 4 obsolete attachments)

(Assignee)

Description

2 months ago
We want to A/B test enabling the Intersection API in Firefox beta 54 on all platforms. The idea is that Beta users who qualify will have the API enabled (via pref dom.IntersectionObserver.enabled); We want to switch half of these users to compare the stability between the two different groups.

Proposed Criteria:

>      Product: Firefox Beta
>      Version: 54.0b6-54.0b7
>           OS: all
>      Channel: beta
>     Build ID: 2017-05-08+
>     Language: en-US
> Sample ratio: 50%
>   Start Date: May 8, 2017
>     End Date: June 5, 2017
(Assignee)

Comment 1

2 months ago
Created attachment 8864880 [details] [diff] [review]
intersection-observer-experiment
(Assignee)

Comment 2

2 months ago
Created attachment 8864882 [details]
experiment.xpi
(Assignee)

Comment 3

2 months ago
Jason, can you please sign the attached dpi?
Flags: needinfo?(jthomas)
(Assignee)

Comment 4

2 months ago
Jason, can you please sign the attached xpi?

Updated

2 months ago
Flags: needinfo?(jthomas)

Comment 5

2 months ago
Created attachment 8865455 [details]
experiment.xpi signed

Please see attached.
(Assignee)

Comment 6

2 months ago
Created attachment 8865596 [details] [diff] [review]
intersection-observer-experiment

Final patch to land including signed add-on, using sample value of .4 to target ~20% of the beta population to have the IntersectionObserver API enabled.
Attachment #8864880 - Attachment is obsolete: true
(Assignee)

Comment 7

2 months ago
Created attachment 8865654 [details]
experiment.xpi

Updated add-on to work on 54.0b6 through 54.0b13. We need to have this signed one more time.
Attachment #8864882 - Attachment is obsolete: true
Attachment #8865455 - Attachment is obsolete: true
Flags: needinfo?(jthomas)

Comment 8

2 months ago
Created attachment 8865881 [details]
experiment.xpi signed

Please see attached.
Flags: needinfo?(jthomas)
(Assignee)

Comment 9

2 months ago
Created attachment 8865932 [details] [diff] [review]
intersection-observer-experiment

Updated patch to land. Manually tested on local telemetry server.
Attachment #8865596 - Attachment is obsolete: true
(Assignee)

Comment 10

2 months ago
Felipe, can we get this staged please? We got a go from r-d and its manually tested.
Flags: needinfo?(felipc)
https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/4086420fdadc
https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/752f9014009c

Landed and tagged release_tag. Just wait for it to appear on the staging server (https://telemetry-experiment-dev.allizom.org/) to see if all experiment parameters are as expected, then you can file a bug to deploy it.

The length of this experiment is a bit bigger than the usual. If you get enough data before the specified date, let me know so that we could stop it earlier.
Flags: needinfo?(felipc)
(Assignee)

Updated

2 months ago
Depends on: 1363518
Tobias, looks you are handling this already, so I am assigning this to you. Feel free to re-assign. Thanks!
Assignee: nobody → tschneider
You need to log in before you can comment on or make changes to this bug.