Closed Bug 1622934 Opened 5 years ago Closed 4 years ago

[Experiment] Pref-Flip Experiment: WebRender Continued: v2 (Nightly Only) Fx 76.0 to 80.0 Nightly

Categories

(Shield :: Shield Study, task, P3)

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: experimenter, Assigned: joy)

References

()

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

gfx.webrender.all.qualified

    What are the branches of the experiment and what values should
    each branch be set to?

- Treatment enabled 50%:

Value: true

WebRender is enabled
        
- Control disabled 50%:

Value: false

WebRender is disabled
        

    What version and channel do you intend to ship to?

45% of Nightly Firefox 76.0 to 80.0

    Are there specific criteria for participants?

normandy.telemetry.main.environment.system.gfx.features.wrQualified.status == ‘available’
windows 10
nightly release channel
Intel primary graphics card: normandy.telemetry.main.environment.system.gfx.adapters[0].vendorID == "0x8086"
Countries: all

Locales: all

    What is your intended go live date and how long will the experiment run?

Apr 01, 2020 - Apr 01, 2021 (365 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

Produce  a dashboard similar to the one listed in https://jira.mozilla.com/browse/DS-283.
Powered enough to be able to detect those differences described in https://docs.google.com/document/d/1mo76Ub0l5cNIII0oKqoVn25Dop4nLKKf0CVhvK4_Wps/edit at the mean level.


We want to continously test the performance and stability effects of webrender on Nightly Windows 10 with Intel graphics population. The study is almost a year long with enrollment every day.

    Who is the owner of the data analysis for this experiment?

sguha@mozilla.com

    Will this experiment require uplift?

False

    QA Status of your code:

GREEN - https://docs.google.com/document/d/1xJRs8izJyYbdS2HfvoqKsFMWuwW6rOfXZzd9Xp7LOGk/edit

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/webrender-continued-v2-nightly-only/

WebRender Continued: v2 (Nightly Only)

this is restarting the experiment that fed dashboards listed here: https://jira.mozilla.com/browse/DS-283.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://jira.mozilla.com/browse/DS-283
More information: https://experimenter.services.mozilla.com/experiments/webrender-continued-v2-nightly-only/

User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: WebRender Continued: v2 (Nightly Only) → [Experiment] Pref-Flip Experiment: WebRender Continued: v2 (Nightly Only) Fx 76.0 to 80.0 Nightly
User Story: (updated)
Start Date: 2020-04-01 End Date: 2021-04-01
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.