1313316 - Ship Activity Stream as switchboard experiment to 0% of the Nightly users.

Status: VERIFIED FIXED

(Firefox for Android Graveyard :: General, defect, P1)

Description

[Sebastian Kaspari (:sebastian; :pocmo)]

We want to get very early versions of activity stream into the hands of our team members without much friction (custom builds, distribution tools, updates). Nightly is perfect for that (patches are available fast and it updates itself) - but we are not ready to ship it to regular Nightly users just yet.

So the proposal is:

* We enable Activity Stream as a Switchboard A/B experiment for 0% of our Nightly users. So no user will actually be able to see/use it.

* We do have an add-on [1] that allows us to manually enable experiments locally. This could be used by our team members to enable activity stream.

This is hidden enough to not be annoying to regular users and testers of our Nightly builds. But at the same time it is easy for interested parties to enable it without the need to administrate build distribution.

[1] https://addons.mozilla.org/en-US/android/addon/switchboard-experiments/

Comment 1

[Sebastian Kaspari (:sebastian; :pocmo)]

Attachment: Bug 1313316 - Add 'activity-stream' experiment.

Review commit: https://reviewboard.mozilla.org/r/89276/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/89276/

Comment 2

[Sebastian Kaspari (:sebastian; :pocmo)]

Attachment: Bug 1313316 - Show activity stream setting if build flag is enabled or user is enrolled in experiment.

Review commit: https://reviewboard.mozilla.org/r/89278/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/89278/

Comment 3

[Sebastian Kaspari (:sebastian; :pocmo)]

The disabled experiment is already in production:
https://firefox.settings.services.mozilla.com/v1/buckets/fennec/collections/experiments/records

Comment 4

[Sebastian Kaspari (:sebastian; :pocmo)]

I updated the extension to load the experiment configuration from Kinto, so that the new experiments are visible as soon as they are published:
https://addons.mozilla.org/en-US/android/addon/switchboard-experiments/
https://github.com/pocmo/Addon-Switchboard-Experiments

(The new version 0.5 is in the review queue)

Comment 5

[Andrzej Hunt :ahunt]

Comment on attachment 8805529 [details]
Bug 1313316 - Add 'activity-stream' experiment.

https://reviewboard.mozilla.org/r/89276/#review88864

Comment 6

[Andrzej Hunt :ahunt]

Comment on attachment 8805530 [details]
Bug 1313316 - Show activity stream setting if build flag is enabled or user is enrolled in experiment.

https://reviewboard.mozilla.org/r/89278/#review88866

Comment 7

[Sebastian Kaspari (:sebastian; :pocmo)]

Comment on attachment 8805529 [details]
Bug 1313316 - Add 'activity-stream' experiment.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/89276/diff/1-2/

Comment 8

[Sebastian Kaspari (:sebastian; :pocmo)]

Comment on attachment 8805530 [details]
Bug 1313316 - Show activity stream setting if build flag is enabled or user is enrolled in experiment.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/89278/diff/1-2/

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/04ed5f3ad61a
Add 'activity-stream' experiment. r=ahunt
https://hg.mozilla.org/integration/autoland/rev/3b502c7d1e53
Show activity stream setting if build flag is enabled or user is enrolled in experiment. r=ahunt

Comment 10

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/mozilla-central/rev/04ed5f3ad61a
https://hg.mozilla.org/mozilla-central/rev/3b502c7d1e53

Comment 11

[Sorina Florean [:sflorean]]

Attachment: Screenshot_20161104-151721.png

Verified as fixed in build 52.0a1 (2016-11-03);
Device: Nexus 5 (Android 6.0.1).