Closed Bug 1535042 Opened 7 years ago Closed 6 years ago

Assess predictive power of the VIDEO_DROPPED_FRAMES_PROPORTION probe

Categories

(Data Science :: Investigation, task)

x86
Windows 10
task
Not set
normal
Points:
3

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: esmyth, Assigned: ccd)

Details

(Whiteboard: [dsperf])

Brief Description of the request (required):

We believe that a VIDEO_DROPPED_FRAMES_PROPORTION greater than 5% negatively affects user engagement and retention and that the effect is more significant when the rate exceed 10%. Please analyze telemetry from Firefox Desktop nightly and beta between versions 47 and 54 inclusive to assess whether the VIDEO_DROPPED_FRAMES_PROPORTION probe has predictive value for user engagement and retention. Specifically, please consider

  • Independent variable: VIDEO_DROPPED_FRAMES_PROPORTION.
  • Dependent variables: Retention, session length, active hours, URI count
  • Group by: Days, weeks
  • Possible segments: OS, memory, cores, VIDEO_CAN_CREATE_H264_DECODER

Business purpose for this request (required):

To produce a metric to guide efforts related to media playback performance and quality of experience.

Requested timelines for the request or how this fits into roadmaps or critical decisions (required):

Rough analysis requested by EOD March 20th. Full analysis by EOD April 5th.

Links to any assets (e.g Start of a PHD, BRD; any document that helps describe the project):

https://docs.google.com/spreadsheets/d/1ki6WIzuI9Nes6KEWFys2lSVLo4VO0vLWTrTNs7MG9pc/edit#gid=345668385&range=K11

Name of Data Scientist (If Applicable):

Corey Dow-Hygelund

Assignee: nobody → cdowhygelund
Status: NEW → ASSIGNED
Points: --- → 3

Media team has made request to make VIDEO_DROPPED_FRAMES_PROPORTION and VIDEO_PLAY_TIME permanent and collected in release. Looks to be riding the FF69 train. This task will be revisited in a couple months, once adequate data has been collected.

Should this bug be closed then?

Flags: needinfo?(cdowhygelund)

Yes, it makes sense to close and adding a new one then.

Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Flags: needinfo?(cdowhygelund)
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.