499963 - Set up databases and scripts for data warehouse on support production

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[[:Cww]]

We're pushing SUMO 1.2 on Thursday.  In advance of that, we should have Kettle + DBs set up on the production server so that push can go faster and smoother.

Steps:

1) Set up kettle:  see bug 499039
2) Set up sumodw database (data warehouse database) using the create schema in /scripts/metrics/dwschema
3) Set up user with INSERT/UPDATE and SELECT privs on this database
4) Put dbname/usernames/passwords for both the tiki database and the new datawarehouse database into a kettle.properties file (see /scripts/metrics/kettle.properties.dist for what to put where).  Put this kettle.properties file in ~/.kettle/ for the user that will be running the actual jobs.
5) cd /path/to/data-integration/ (this is required, I don't know why but it sometimes breaks without being in the right place)
6) kitchen.sh -norep -file /path/to/scripts/metrics/j_sumo_initialize.kjb
7) kitchen.sh -norep -file /path/to/scripts/metrics/j_sumo_etl.kjb

if everything goes well, we can cronjob that last step to run at 4 AM nightly.

See also bug 499347 for how it was done on stage.

Comment 1

[Shyam Mani [:fox2mike]]

All done. Cloned the VM, pm-app-kettle01 is the kettle prod instance

Comment 2

[Shyam Mani [:fox2mike]]

Database setup in tm-sumo01-master01.