1293954 - Make HW Survey data available on games.mozilla.org

Status: RESOLVED FIXED

(Cloud Services :: Metrics: Product Metrics, defect, P1)

Description

[Alessio Placitelli [:Dexter]]

The data generated from the HW survey notebook needs to be promptly available on games.mozilla.org.

I'm not sure if we can directly store data there from the notebook or if some S3 dance is needed.

Comment 1

[Alessio Placitelli [:Dexter]]

:cvan, do you know who owns games.mozilla.org now or are you still responsible for it?

Comment 2

[Christopher Van Wiemeersch [:cvan]]

Alessio, Andre Vrignaud (CC'd) owns games.mozilla.org (and openwebgames.com), last time I heard.

Comment 3

[Alessio Placitelli [:Dexter]]

(In reply to Christopher Van Wiemeersch [:cvan] from comment #2)
> Alessio, Andre Vrignaud (CC'd) owns games.mozilla.org (and
> openwebgames.com), last time I heard.

Thanks Christopher!

Andre, do you own games.mozilla.org?

Comment 4

[Andre Vrignaud [:andre] [Seattle - PST]]

I own the game sites from a product management perspective, but Jukka and Harald have source/posting access. Note that we need to get the page rebuilt with new text, reordering of items, etc before posting - *and* I need to have legal and BD review one last time. Oh, and we need to coordinate the blog post announcing. :)

If we are working to get the page up on the site, I'd ask that we post behind auth, and not link directly from the home page until we're fully ready. I can give guidance on which tile we'll replace on the home page in a bit. That help? :)

Comment 5

[Alessio Placitelli [:Dexter]]

(In reply to Andre Vrignaud [:andre] [Seattle - PST] from comment #4)
> I own the game sites from a product management perspective, but Jukka and
> Harald have source/posting access. Note that we need to get the page rebuilt
> with new text, reordering of items, etc before posting - *and* I need to
> have legal and BD review one last time. Oh, and we need to coordinate the
> blog post announcing. :)

Crystal clear, thanks!

> If we are working to get the page up on the site, I'd ask that we post
> behind auth, and not link directly from the home page until we're fully
> ready. I can give guidance on which tile we'll replace on the home page in a
> bit. That help? :)

Sort of, working in that direction! :-D

I'm interested in the process to get the HW Survey notebook JSON output from the Spark cluster to the games.mozilla.org website, so that the website has data to display.

Basically, I'd love to understand where to put the JSON files, and possibly how. Should I talk this over with Jukka and Harald?

Comment 6

[Andre Vrignaud [:andre] [Seattle - PST]]

I'm guessing Ali (already CCed) might have the first part of this (getting the data), but yes, Harald and Jukka will be able to help with how/where to post. Looking forward to this going live! :)

Comment 7

[Alessio Placitelli [:Dexter]]

(In reply to Andre Vrignaud [:andre] [Seattle - PST] from comment #6)
> I'm guessing Ali (already CCed) might have the first part of this (getting
> the data), but yes, Harald and Jukka will be able to help with how/where to
> post. Looking forward to this going live! :)

Me too!

@Ali, I can make the spark job put the data in a public S3 bucket, that can be accessed through a similar URL:

https://analysis-output.telemetry.mozilla.org/games-hardware-survey/data/latest.json

Would that be enough for the visualization website on games.mozilla.org to pickup (CORS headers should be set)?

Comment 8

[Ali Almossawi]

:Dexter Yes, that would be fine, so long as cors is enabled as you point out.

Comment 9

[Andre Vrignaud [:andre] [Seattle - PST]]

I've chatted with folks, and we should go ahead and add Silverlight, Flash, and Unity Web Player plugin availability if possible. We should also add WebGL1 availability, but hold off on showing WebGL2 data until it's released in 50 or 51. But good to prep that now, since we're so close. 

Do we have a final list of the telemetry data points we think we can get for this 1.0 launch? I'd like to sort them, and come up with a recommended way to present for Ali to consider. (Basically just thinking through bucketing into categories based on what we have.)

Comment 10

[Alessio Placitelli [:Dexter]]

(In reply to Andre Vrignaud [:andre] [Seattle - PST] from comment #9)
> I've chatted with folks, and we should go ahead and add Silverlight, Flash,
> and Unity Web Player plugin availability if possible. We should also add
> WebGL1 availability, but hold off on showing WebGL2 data until it's released
> in 50 or 51. But good to prep that now, since we're so close. 
> 
> Do we have a final list of the telemetry data points we think we can get for
> this 1.0 launch? I'd like to sort them, and come up with a recommended way
> to present for Ali to consider. (Basically just thinking through bucketing
> into categories based on what we have.)

Sure, let's move this conversation to bug 1293955, which is about adding these fields.

Comment 11

[Alessio Placitelli [:Dexter]]

Attachment: Store reports in the public bucket.

Pending review: can't r?harter until we make the repo public (or grant him privileges :) )

Comment 12

[Alessio Placitelli [:Dexter]]

Attachment: Store reports in the public bucket.

Comment 13

[Alessio Placitelli [:Dexter]]

Attachment: Store reports in the public bucket.

Comment 14

[Ryan Harter [:harter]]

Thanks, Alessio. 

I reviewed the pull request here:
https://github.com/mozilla/firefox-hardware-survey/pull/3

Comment 15

[Ryan Harter [:harter]]

Comment on attachment 8781887 [details] [review]
Store reports in the public bucket.

I'll look out for the revisions posted in the pull request. Thanks!

Comment 16

[Alessio Placitelli [:Dexter]]

Attachment: hwsurvey-weekly-20162108-20162708.json

Here's the updated report for the past week, as requested in the PR.

Comment 17

[Alessio Placitelli [:Dexter]]

Attachment: hwsurvey-weekly-20162108-20162708.json

Comment 18

[Ryan Harter [:harter]]

Comment on attachment 8781887 [details] [review]
Store reports in the public bucket.

As noted in the PR, this LGTM. There's one outstanding comment from Roberto which I think you'll have to Acknowledge before merging. Ping with any questions!

Comment 19

[Alessio Placitelli [:Dexter]]

Roberto, it looks like this is blocked on your comment on the PR. Leaving the ni? around so that you see this once you're back!

Comment 20

[Alessio Placitelli [:Dexter]]

This was reviewed and merged. Closing the bug.