1618666 - Document process for requesting and preparing extracts for researchers

Status: NEW

(bugzilla.mozilla.org :: Documentation, task)

Description

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

This is bouncing around in people's heads and we need it in our docs.

Comment 1

[jnavas]

Hello, I am a PhD student currently on a research stay at the DataScienceLaboratory at Ryerson University, Toronto ON, Canada. I am collaborating with a research team on a project. We need access to the following datasets: current Bugzilla database, last MozReview database, current Phabricator database, and (this we already have) mercurial revisions database. At least the last 10 years of data.

We need to cross data from the three databases: bugs, reviews and revisions/commits. Can you please point me in the right direction on how to gain access to these? What we need is a dump of those databases in order to be able to import them locally and read them, as the amount of data is huge, via REST interfaces would take ages to dowload.

Our names and email addresses are: Jose Navas, jnavas[at]itcr[dot]ac[dot]cr, and Hadi Jahanshahi, hadi[dot]jahanshahi [at] ryerson[dot]ca

The rough idea is: Preemptive patch quality assessment may save time and resources that is required to fix defects at a later stage. Constructing the potential features to indicate a defect-inducing patch requires a rigorous exploration of software repositories. However, it necessitates preparation of an extensive dataset. Mozilla source code evolution, review processes, and bug tracking are managed and executed in three different, albeit semantically related, systems: Bugzilla, MozReview, and Mercurial. We aim to extract, clean, integrate and transform these archives into a well-formed, SQL-friendly dataset. Furthermore, we open the MozX along with its schema to help researchers execute their own queries. In addition to patch quality assurance, the wide range of attributes may support investigation of other research questions.

Comment 2

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

(In reply to jnavas from comment #1)

Hello, I am a PhD student currently on a research stay at the DataScienceLaboratory at Ryerson University, Toronto ON, Canada.

Hi, jnavas, this bug is to capture our need to review our process.

Please file a bug in administration to request the extract.

Thank you.