1536008 - [Shield] Pref-Flip Study: activity-stream-pktnewtabH12019-release66layoutstest1, 66, Release

Status: RESOLVED FIXED

(Shield :: Shield Study, enhancement)

Description

[Experimenter Bot]

activity-stream-pktnewtabH12019-release66layoutstest1

Large scale study to test out various combinations of layouts of newtab/homepage.

More information: https://experimenter.services.mozilla.com/experiments/activity-stream-pktnewtabh12019-release66layoutstest1/

Comment 1

[Su-Young Hong]

[Tracking Requested - why for this release]:

Comment 2

[Marius Coman [:mcoman], Ecosystem QA]

Pref-Flip Study: activity-stream-pktnewtabH12019-release66layoutstest1 FF66 Release
Targeted: Firefox Release 66
Firefox Release 67

We have finished testing the Pref-Flip Study: activity-stream-pktnewtabH12019-release66layoutstest1 FF66 Release experiment.

During testing, no new issues were encountered, except the already known issue from the previous reduced version of the study, that is still reproducible:

Bug 1536812 - The user-friendly message is not displayed and the whole section is entirely collapsed if all the "Recommended by Pocket" cards are dismissed

QA’s recommendation: GREEN - SHIP IT

Reasoning:

• We have not found any new issues and the known issue is not impacting the study release due to its low severity.

Testing Summary:

• Full Functional test suite: TestRail;
• Verified that the “Telemetry Pings” are successfully sent to the server;

Tested Platforms:

• Windows 10 x64;
• Mac OS 10.14.3;
• Ubuntu 18.04 x64.

Tested Firefox versions:

• Firefox Release 66.0.2
• Firefox Beta 67.0b4

Comment 3

[Liz Henry (:lizzard)]

Untracking since we have this information easily findable now in Experimenter.