1532767 - Run a pref-flip experiment to ensure Process Priority Manager does not negatively impact page load or retention

Status: RESOLVED FIXED

(Data Science :: Experiment Collaboration, task)

Description

[Mike Conley (:mconley) (:⚙️)]

Brief description of the request:

We'd like to ensure that the Process Priority Manager doesn't have any negative impacts on page load time or user retention when enabled.

The pref that would need to be flipped is dom.ipc.processPriorityManager.enabled, set to true for treatment, and false for control. The only platform that should be tested is Windows Desktop, and the only releases that should be tested are 67+.

Link to any assets:

Bug 1476981 is the bug that enabled the Process Priority Manager on Nightly.

Is there a specific data scientist you would like or someone who has helped to triage this request:

Corey Dow-Hygelund or Felix Lawrence.

Comment 1

[Jess Mokrzecki [:jmok]]

Hi Mike,

What is the desired timeline for this?

Comment 2

[Mike Conley (:mconley) (:⚙️)]

(In reply to Jess Mokrzecki [:jmok] from comment #1)

Hi Mike,

What is the desired timeline for this?

Hi jmok,

We'd love it if we could run this experiment on the Beta population sometime soon after the next uplift, once Beta becomes 67. Perhaps late March?

Comment 3

[Mike Conley (:mconley) (:⚙️)]

Hi joy! Is there anything else we need to prepare or do in order for this experiment to be ready to run on Beta 67 when it releases?

Comment 4

["Saptarshi Guha[:joy]"]

The description looks okay but we would need an Experimenter page setup. Has that been started?

https://experimenter.services.mozilla.com/

Comment 5

[Mike Conley (:mconley) (:⚙️)]

(In reply to "Saptarshi Guha[:joy]" from comment #4)

The description looks okay but we would need an Experimenter page setup. Has that been started?

https://experimenter.services.mozilla.com/

I've started putting one together at https://experimenter.services.mozilla.com/experiments/process-priority-manager-on-windows/, but I think I need some help.

I'm unsure how big the population size needs to be. I'm unsure how big the branch sizes need to be. I've filled in the form as best I can (although some fields that I can fill can't be saved because there are other fields on the same form that I don't have good answers for, and they all seem to be required to save drafts... so I've left them blank).

Can you offer any guidance?

Comment 6

["Saptarshi Guha[:joy]"]

Yes, this is what i'm here to do! Will work on this and get back to you.
Cheers
Saptarshi

Comment 7

["Saptarshi Guha[:joy]"]

Final Report: https://metrics.mozilla.com/~sguha/mz/process_priority/report.1.html