1123888 - Telemetry report: results of common Flash video sites

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Benjamin Smedberg]

This is the bug tracking getting results from the experiment in bug 1108668.

I'd like the following initial breakdown:

A1. top 25 sites grouped by pageOrigin
A2. A1, but broken down by locale
A3. A1, but broken down by geo (if we store geo in telemetry currently)

B1. top 25 sites grouped by topOrigin

Roberto, I'm hoping that I can use spark for this, but I might need some hand-holding!

Comment 1

[Roberto Agostino Vitillo (:rvitillo)]

(In reply to Benjamin Smedberg  [:bsmedberg] from comment #0)
> This is the bug tracking getting results from the experiment in bug 1108668.
> 
> I'd like the following initial breakdown:
> 
> A1. top 25 sites grouped by pageOrigin
> A2. A1, but broken down by locale
> A3. A1, but broken down by geo (if we store geo in telemetry currently)
> 
> B1. top 25 sites grouped by topOrigin
> 
> Roberto, I'm hoping that I can use spark for this, but I might need some
> hand-holding!

I don't see any reason why you couldn't use Spark for this :) You can start by following instructions on http://robertovitillo.com/2015/01/16/next-gen-data-analysis-framework-for-telemetry/.

Comment 2

[Benjamin Smedberg]

Got this done. For privacy reasons, I'm not going to post the full dataset, but the top-25 sites by pageOrigin are:

Page Origin     Count
1     www.youtube.com     3397031
2     www.dailymotion.com     2637945
3     www.twitch.tv     2090178
4     www.facebook.com     1671252
5     www.starsports.com     1572814
6     www.amazon.com     543928
7     live.mycanal.fr     394498
8     www.amazon.de     388718
9     ok.ru     329014
10     www.ustream.tv     284156
11     chaines-tv.orange.fr     280232
12     www.katsomo.fi     275353
13     www.bbc.co.uk     250093
14     ads2.contentabc.com     235221
15     go.sky.com     213824
16     colors.in.com     207629
17     www.xvideos.com     206335
18     www.hotstar.com     205984
19     xhamster.com     185640
20     www.cnn.com     185108
21     viaplay.fi     166748
22     www.odnoklassniki.ru     165233
23     moonwalk.cc     155320
24     www.bloomberg.com     154189
25     tools.bongacash.com     153107