1275995 - Exclude WinXP users from e10s release criteria analysis

Status: RESOLVED FIXED

(Toolkit :: Telemetry, defect)

Description

[:Felipe Gomes (needinfo for replies!)]

It's been decided that WinXP is not gonna be part of the initial rollout of e10s, and the code to make that happen is landing in bug 1275039.

In order to not be flying blind when we do want to analyse e10s data from WinXP in the future, the block will only apply to the release channel, and not on beta.

With that in mind, it's important that we filter WinXP users from the current analysis to make sure we're looking at the right set of people. And please make sure that the filter apply to both "test" and "control" groups so that the comparison between them is correct.


(Note: a similar consideration applies for OS X 10.6 - 10.8 (<= Lion) on Beta 47. From beta 48 on it no longer matters because e10s will be blocked for all users/channels on those versions.)

Comment 1

[Chris Peterson [:cpeterson]]

chutten: we should also exclude XP users from the Engagement Ratio dashboards. Is that something your work for this bug would cover? Or will rvitillo need to change something on his side?

https://sql.telemetry.mozilla.org/dashboard/e10s-client-count

Comment 2

[Roberto Agostino Vitillo (:rvitillo)]

(In reply to Chris Peterson [:cpeterson] from comment #1)
> chutten: we should also exclude XP users from the Engagement Ratio
> dashboards. Is that something your work for this bug would cover? Or will
> rvitillo need to change something on his side?
> 
> https://sql.telemetry.mozilla.org/dashboard/e10s-client-count

Done.

Comment 3

[Chris H-C :chutten]

https://github.com/vitillo/e10s_analyses/tree/master/beta47-week4

Windows XP users are explicitly filtered out of the analysis. Mac OSX 10.6-10.8 are left in because there are too few clients on those platforms in the experiment to push the needle.