560465 - provide an easy way for researchers to learn about how to get access to a limited copy of bugzilla.mozilla.org

Status: RESOLVED FIXED

(bugzilla.mozilla.org :: General, enhancement)

Description

[timeless]

Actual results:
recently a group of researchers slurped bugzilla.mozilla.org. Historically we'd have banned a group for doing automated spidering. We've also historically provided sanitized database dumps to researchers on request.

Problem:
There's no easy way for a researcher to know that we frown on people slurping our, that we offer database dumps, and how to request a dump.

Expected results:
Some page on bugzilla.mozilla.org or near mozilla.org should indicate to researchers/others our general policy and some guidelines for how to make a request. From memory it's done by filing a bug in bugzilla.

Comment 1

[Gervase Markham [:gerv]]

We could have a page.cgi page titled "For Researchers", linked from the b.m.o. front page. It could also contain an offer to review papers which use Bugzilla data.

Gerv

Comment 2

[Gervase Markham [:gerv]]

Attachment: Template for researchers

Timeless, does this look right?

Gerv

Comment 3

[Gervase Markham [:gerv]]

justdave: if you are doing a b.m.o. update round, I want to ride the wave :-) Can you drop this template into template/en/custom/pages directory, and add a link to it from the front page?

Perhaps

| <a href="page.cgi?id=researchers.html">Data For Researchers</a>

next to the Bugzilla User's Guide | Release Notes items?

Gerv

Comment 4

[Dave Miller [:justdave]]

Before we start actively advertising this, I need some clarity about how the requests are processed.  I have one in the queue right now that I passed along for approval a couple days ago and haven't got a response on yet, and it always feels like there's no real plan from a procedural standpoint for deciding who we're allowed to give these to.  To date it's just been going up my management chain, but this is perhaps something that ought to go through the Foundation?

The main reason we're sticky on giving it out is because it does contain personally identifiable information about the users in the database, which is very difficult to anonymize.  We *do* remove all of the confidential bugs, products, and groups, and all of the user password hashes, but the actual list of users and their email addresses is still included, because it's insanely difficult to remove them from the bugs activity table.

Comment 5

[Gervase Markham [:gerv]]

Yep, OK, fair enough. Take it off the train; let's get some more clarity first.

Gerv

Comment 6

[Gervase Markham [:gerv]]

ISTR Myk used to be the guy for this a while back. And perhaps Frank has policy insights too. I seem to remember their being a requirement for bona fide institutions and some sort of ethics committee review...

Dave: are you currently just getting approval from your management chain?

Gerv

Comment 7

[Dave Miller [:justdave]]

Yeah, we've handed out a good dozen or so of these in the last 3 or 4 years, justin's been the one approving them for the last couple years.

Comment 8

[Gervase Markham [:gerv]]

We now have clarity on how requests are processed - we send them the agreement from 608221. So we can now go ahead and tell people it's possible to get this data.

Gerv

Comment 9

[Gervase Markham [:gerv]]

justdave: can you approve the text here? Then I'll work with dkl and glob to get it put up on b.m.o. with a link.

Gerv

Comment 10

[Dave Miller [:justdave]]

Comment on attachment 441048 [details]
Template for researchers

First two paragraphs are great.  I'm not going to be a contact person for this though.  Stuff will get lost if we do that.  File a bug in b.m.o :: Administration perhaps? (Or maybe we make a new component for it?).

Also, is your license header correct?  That's an awful lot of contributors for 3 paragraphs of human-readable text. :)

Comment 11

[:glob ✱]

you'll need to use [% terms.Bugzilla %] instead of Bugzilla in order for this to pass tests.

Comment 12

[David Lawrence [:dkl]]

Attachment: Patch to add new page for instruction on obtaining sanitized BMO data (v1)

Comment 13

[Gervase Markham [:gerv]]

Comment on attachment 651863 [details] [diff] [review]
Patch to add new page for instruction on obtaining sanitized BMO data (v1)

r=gerv. Nit: "A_n_ agreement".

Gerv

Comment 14

[David Lawrence [:dkl]]

Thanks

Committing to: bzr+ssh://[e-mail]/bmo/4.0
modified extensions/BMO/template/en/default/hook/index-additional_links.html.tmpl
added extensions/BMO/template/en/default/researchers.html.tmpl
Committed revision 8274.

Committing to: bzr+ssh://[e-mail]/bmo/4.2  
modified extensions/BMO/template/en/default/hook/index-additional_links.html.tmpl
added extensions/BMO/template/en/default/pages/researchers.html.tmpl                    
Committed revision 8298.