Last Comment Bug 1362418 - Run a Telemetry experiment to enable Intersection Observer API on Firefox Beta 54
: Run a Telemetry experiment to enable Intersection Observer API on Firefox Bet...
Status: RESOLVED FIXED
:
Product: Core
Classification: Components
Component: DOM (show other bugs)
: unspecified
: Unspecified Unspecified
-- normal (vote)
: ---
Assigned To: Tobias Schneider [:tobytailor]
:
: Andrew Overholt [:overholt]
Mentors:
Depends on: 1363518
Blocks:
  Show dependency treegraph
 
Reported: 2017-05-05 07:51 PDT by Tobias Schneider [:tobytailor]
Modified: 2017-07-12 12:46 PDT (History)
5 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---


Attachments
intersection-observer-experiment (4.65 KB, patch)
2017-05-05 07:54 PDT, Tobias Schneider [:tobytailor]
no flags Details | Diff | Splinter Review
experiment.xpi (1.50 KB, application/zip)
2017-05-05 07:55 PDT, Tobias Schneider [:tobytailor]
no flags Details
experiment.xpi signed (5.38 KB, application/x-xpinstall)
2017-05-08 08:05 PDT, Jason Thomas [:jason]
no flags Details
intersection-observer-experiment (11.43 KB, patch)
2017-05-08 12:54 PDT, Tobias Schneider [:tobytailor]
no flags Details | Diff | Splinter Review
experiment.xpi (1.50 KB, application/zip)
2017-05-08 14:43 PDT, Tobias Schneider [:tobytailor]
no flags Details
experiment.xpi signed (5.39 KB, application/x-xpinstall)
2017-05-09 07:56 PDT, Jason Thomas [:jason]
no flags Details
intersection-observer-experiment (11.41 KB, patch)
2017-05-09 09:54 PDT, Tobias Schneider [:tobytailor]
no flags Details | Diff | Splinter Review

Description User image Tobias Schneider [:tobytailor] 2017-05-05 07:51:53 PDT
We want to A/B test enabling the Intersection API in Firefox beta 54 on all platforms. The idea is that Beta users who qualify will have the API enabled (via pref dom.IntersectionObserver.enabled); We want to switch half of these users to compare the stability between the two different groups.

Proposed Criteria:

>      Product: Firefox Beta
>      Version: 54.0b6-54.0b7
>           OS: all
>      Channel: beta
>     Build ID: 2017-05-08+
>     Language: en-US
> Sample ratio: 50%
>   Start Date: May 8, 2017
>     End Date: June 5, 2017
Comment 1 User image Tobias Schneider [:tobytailor] 2017-05-05 07:54:17 PDT
Created attachment 8864880 [details] [diff] [review]
intersection-observer-experiment
Comment 2 User image Tobias Schneider [:tobytailor] 2017-05-05 07:55:41 PDT
Created attachment 8864882 [details]
experiment.xpi
Comment 3 User image Tobias Schneider [:tobytailor] 2017-05-07 16:50:12 PDT
Jason, can you please sign the attached dpi?
Comment 4 User image Tobias Schneider [:tobytailor] 2017-05-07 16:50:24 PDT
Jason, can you please sign the attached xpi?
Comment 5 User image Jason Thomas [:jason] 2017-05-08 08:05:40 PDT
Created attachment 8865455 [details]
experiment.xpi signed

Please see attached.
Comment 6 User image Tobias Schneider [:tobytailor] 2017-05-08 12:54:06 PDT
Created attachment 8865596 [details] [diff] [review]
intersection-observer-experiment

Final patch to land including signed add-on, using sample value of .4 to target ~20% of the beta population to have the IntersectionObserver API enabled.
Comment 7 User image Tobias Schneider [:tobytailor] 2017-05-08 14:43:34 PDT
Created attachment 8865654 [details]
experiment.xpi

Updated add-on to work on 54.0b6 through 54.0b13. We need to have this signed one more time.
Comment 8 User image Jason Thomas [:jason] 2017-05-09 07:56:10 PDT
Created attachment 8865881 [details]
experiment.xpi signed

Please see attached.
Comment 9 User image Tobias Schneider [:tobytailor] 2017-05-09 09:54:44 PDT
Created attachment 8865932 [details] [diff] [review]
intersection-observer-experiment

Updated patch to land. Manually tested on local telemetry server.
Comment 10 User image Tobias Schneider [:tobytailor] 2017-05-09 09:56:21 PDT
Felipe, can we get this staged please? We got a go from r-d and its manually tested.
Comment 11 User image :Felipe Gomes (needinfo me!) 2017-05-09 12:47:33 PDT
https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/4086420fdadc
https://hg.mozilla.org/webtools/telemetry-experiment-server/rev/752f9014009c

Landed and tagged release_tag. Just wait for it to appear on the staging server (https://telemetry-experiment-dev.allizom.org/) to see if all experiment parameters are as expected, then you can file a bug to deploy it.

The length of this experiment is a bit bigger than the usual. If you get enough data before the specified date, let me know so that we could stop it earlier.
Comment 12 User image Hsin-Yi Tsai [:hsinyi] 2017-05-11 03:11:26 PDT
Tobias, looks you are handling this already, so I am assigning this to you. Feel free to re-assign. Thanks!

Note You need to log in before you can comment on or make changes to this bug.