Bug 1571817 Comment 2 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

Notes for QA testing:

This patch implements a holdback experiment for the extended triplets added in bug 1568909. There are two branchs in this experiment:

* The `control` branch (99%), in which one should see the extended triplets if the profile age is younger than 7 days;
* The `holdback` branch (1%), in which one should NOT see the extended triplets regardless of the profile age.

To test the `control` branch is straightforward, simply use a new profile, it should show the triplets on the about:home or about:newtab. It's worth checking the `shield_id` field in the onboarding `IMPRESSION` telemetry ping, it should include the string `activity-stream-extended-triplets:control`.

It's hard to verify the `holdback` branch since it only accounts for 1% of the targeting audience. However, we can manually enroll themselves into this branch by overwriting `trailhead.extendedTriplets.experiment` in about:config, simply set it as `holdback` then restart the browser. Users in this branch will not see the extended triplets, hence it won't send the `IMPRESSION` ping. Still, `shield_id` should include `activity-stream-extended-triplets:holdback` in other pings of Activity Stream.
Notes for QA testing:

This patch implements a holdback experiment for the extended triplets added in bug 1568909. There are two branchs in this experiment:

* The `control` branch (99%), in which one should see the extended triplets if the profile age is younger than 7 days;
* The `holdback` branch (1%), in which one should NOT see the extended triplets regardless of the profile age.

To test the `control` branch is straightforward, simply use a new profile, it should show the triplets on the about:home or about:newtab. It's worth checking the `shield_id` field in the onboarding `IMPRESSION` telemetry ping, it should include the string `activity-stream-extended-triplets:control`. You can find how to check the telemetry in this [doc](https://github.com/mozilla/activity-stream/blob/master/content-src/asrouter/docs/debugging-docs.md#how-to-test-telemetry-pings). 

It's hard to verify the `holdback` branch since it only accounts for 1% of the targeting audience. However, we can manually enroll themselves into this branch by overwriting `trailhead.extendedTriplets.experiment` in about:config, simply set it as `holdback` then restart the browser. Users in this branch will not see the extended triplets, hence it won't send the `IMPRESSION` ping. Still, `shield_id` should include `activity-stream-extended-triplets:holdback` in other pings of Activity Stream.
Notes for QA testing:

This patch implements a holdback experiment for the extended triplets added in bug 1568909. There are two branchs in this experiment:

* The `control` branch (99%), in which one should see the extended triplets if the profile age is younger than 7 days;
* The `holdback` branch (1%), in which one should NOT see the extended triplets regardless of the profile age.

To test the `control` branch is straightforward, simply use a new profile, it should show the triplets on the about:home or about:newtab. It's worth checking the `shield_id` field in the onboarding `IMPRESSION` telemetry ping, it should include the string `activity-stream-extended-triplets:control`. You can find how to check the telemetry in this [doc](https://github.com/mozilla/activity-stream/blob/master/content-src/asrouter/docs/debugging-docs.md#how-to-test-telemetry-pings). 

It's hard to verify the `holdback` branch since it only accounts for 1% of the targeting audience. However, we can manually enroll ourselves into this branch by overwriting `trailhead.extendedTriplets.experiment` in about:config, simply set it as `holdback` then restart the browser. Users in this branch will not see the extended triplets, hence it won't send the `IMPRESSION` ping. Still, `shield_id` should include `activity-stream-extended-triplets:holdback` in other pings of Activity Stream.

Back to Bug 1571817 Comment 2