1372967 - Access to MDN database

Status: RESOLVED WONTFIX

(Infrastructure & Operations Graveyard :: WebOps: Community Platform, task)

Description

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

Hi,

In order to enrich the Open Innovation Strategy research arounf communities and contributors we need a way to pull information from the MDN platform and get some stats

https://wiki.mozilla.org/Innovation/Projects/Open_Innovation_Strategy 

Janet pointed us here to request access. Also it would be easier for us if we also can get some data structure definitions to know from where to pull this data.

Thanks!

Comment 1

[Joey Krejci [:joeyk]]

Hey Ben would this be your team that provides access to this DB?

Comment 2

[Ben (:bensternthal)]

Depends...

This answer is relevant to both this bug and bug 1372970.

A few things:

1. Can you outline what specific information you are looking for, what you are going to do.
2. Has this request been reviewed by legal / data privacy?
3. Depending on those answers we can decide the path forward.

Comment 3

[Joey Krejci [:joeyk]]

Cool, thanks Ben!

Nukeador can you answer the questions above so we can figure out how to proceed forward? Thanks!

Comment 4

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

Here's what it would be ideal from MDN.

- # of contributors over time ... ideally broken down by type of contribution (writing vs. localization vs. other)

- # of contributions over time ... by type

- relating that to MDN traffic stats + maybe even newsletter sign-ups

Intermediate analysis would include:

- adding in understanding the size and changes to the core/regular/casual groupings (core = 80% of contributions, regular = 15% of contributions, casual = 5% of contributions)

- adding in an understanding of attraction/retention ... # who are new in any given year vs. returning

Bonus:
- we can now look across at what others are contributing to in code/issues given a set of email addresses, so we could see the cross-pollination of MDN into other contributions.

The legal review was done to the overall work around gathering and analyzing contributors data here: https://bugzilla.mozilla.org/show_bug.cgi?id=1346730

Comment 5

[Joey Krejci [:joeyk]]

Hey Ben how would you like to proceed forward now that we have those answers?

Comment 6

[Ben (:bensternthal)]

Oops I should have copy pasted my response from the other bug here....


OK I read through the legal bug. I would request that you get an additional review (they may simply state a new review is not necessary) from legal/privacy.

I request this because:

1. The legal request is specific to granting a 3rd party access to publicly accessible data from a dashboard. This is a request to grant access to non publicly available information.. essentially a DB dump.

2. I would like specific sign off from legal/privacy that this is OK for the two sites you have requested this for, SUMO and MDN. Both sites contain PII, so I want explicit permission that this is OK. I am not "expert" enough in our user agreements to make a call.

Comment 7

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

Understood, we will explore this with legal. At the same time I don't know if these sites have an API that can provide us with the needed info without deep access to the DBs.

Comment 8

[Joey Krejci [:joeyk]]

Hey Nukeador, 

Just wanted to follow up and see if you had reached out to Legal yet for this issue? Let me know, thanks!

Comment 9

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

We got some initial data directly from MDN team, but we need to make a team decision at the All Hands about how to get access to MDN and Kitsune for future analysis. So basically, we are in pause after the all hands ;-)

Comment 10

[Joey Krejci [:joeyk]]

Hey Nukeador any update on this? If not Im just gonna close it out as WONTFIX, let me know thanks!

Comment 11

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

Hi,

We still need to figure out the best approach to get the data into the analytics dashboard. I hope that by late this quarter, but I can't be sure right now.

Cheers.

Comment 12

[Eric Ziegenhorn :ericz]

Hi Ruben, I'd like to close this and your Kitsune access bugs for lack of forward movement and there not being any action for us still.  Any objections?  Thanks!

Comment 13

[Rubén Martín [:Nukeador] ❌ [away till Aug 31st]]

I guess that's OK. I'm cc'ing Henrik here (just FYI), ideally in the future we would like to see these data incorporated in our community dashboard.

Comment 14

[Eric Ziegenhorn :ericz]

Ok thanks for your understanding Ruben and let us know if we can help in the future!

Comment 15

[Henrik Mitsch [:hmitsch]]

Ruben, thanks for the CC. I took note of it in the Community Analytics icebox.

-Henrik