1047299 - Import data from mofointegration to Baloo

Status: RESOLVED WONTFIX

(Community Building :: Systems and Data, task)

Description

[Adam Lofting (:adamlofting)]

The tables to import which will be used in the aggregations are:

* vw_adhoctribution
* vw_mozfest
* vw_transifex
* vw_webmaker_events
* vw_webmaker_events_coorganizers
* vw_webmaker_events_mentors

These views should match the Baloo Schema 0.1, with any additional columns explained in the Schema Documentation: https://wiki.mozilla.org/Baloo/Schema/0.1

DB Access info is in: Bug 1042057

Comment 1

[Sheeri Cabral [:sheeri]]

How to:
https://mana.mozilla.org/wiki/display/BIDW/Runbook:+Baloo+DW+ETLs

Schema + extra:
https://wiki.mozilla.org/Baloo/Schema/0.1

Conversion points:
https://wiki.mozilla.org/Contribute/Conversion_points#Mozilla_Foundation_.28MoFo.29

Comment 2

[Sheeri Cabral [:sheeri]]

Adam - Are there contributor conversion points yet?

They all seem to have "tbc" under them in the conversion points documentation, including mozfest, the info from the ad-hoc logger (which I assume is in the vw_adhoctribution table), transifex, and webmaker events.
https://wiki.mozilla.org/Contribute/Conversion_points#Mozilla_Foundation_.28MoFo.29

Comment 3

[Adam Lofting (:adamlofting)]

The "tbc" were for other columns on the wiki page about recognition and contributor pathways, but the conversion points are in the first column of each of the teams on that page (the metrics datasource column).

This ticket was just for the loading of the raw data (sorry if splitting this out caused confusion). Loading those 6 tables in their entirety will give you the raw data needed for building the aggregations specified in separate bugs for each MoFo team. 

This bug for example is for aggregations for Webmaker: https://bugzilla.mozilla.org/show_bug.cgi?id=1047309

In there is a link to an etherpad with example queries for how to match the 'generally phrased' conversion points on the wiki page with the specific data in those 6 tables from the integration DB.