965575 - Create b2gtw Datazilla Project

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Jonathan Eads ( :jeads )]

Attachment: SQL statements converting perftest schema to b2g version

We need to create a new datazilla project called "b2gtw" to support test automation data coming from Jenkins TW. 

Please carry out steps 1-7 listed below to create the new project. NOTE: steps 2-3 require a full set of database permissions.

1.) Update stage and production with the current datazilla repository

2.) To create the required project database, run the following manage command as the datazilla_stage user on the admin node:

manage.py create_perftest_project --project b2gtw --perftest_host datazilla-rw-vip.db.scl3.mozilla.com --objectstore_host datazilla-rw-vip.db.scl3.mozilla.com --perftest_type MySQL-TokuDB --objectstore_type MySQL-Aria --cron_batch small

This command will create two new databases for the "b2gtw" project.

3.) Execute the sql statements found in the attached file b2g_perftest_alterations.sql. The modified table structure is required to manage b2g type performance data.

4.) Update the following line in datazilla/datazilla/settings/local.py on stage and production.

ALLOWED_PROJECTS = os.environ.get("ALLOWED_PROJECTS", "b2g|games|jetperf|marketapps|microperf|pushlog|stoneridge|talos|test|webpagetest|b2gtw")

5.) Update the crontab to include the new changes in crontab.txt (https://github.com/mozilla/datazilla/blob/master/crontab.txt)

6.) To get the new project into the memcache, the following manage.py command should be run on stage and production:

./manage.py reset_cached_datasources

7.) Run `apache graceful` on stage and production

At this point

https://datazilla.mozilla.org/b2gtw

should load a web page that looks like an empty version of https://datazilla.mozilla.org/b2g

Comment 1

[Chris Turra [:cturra]]

we'll need to schedule this work with a DBA. i am copying :cyborgshadow to review the datazilla user permissions and sql statements attached here.

Comment 2

[Sheeri Cabral [:sheeri]]

The sql statements look fine, and the datazilla_moz user has the permissions needed. (the datazilla_stage user does not).

Comment 3

[Sheeri Cabral [:sheeri]]

When did you want to schedule this work?

Comment 4

[Chris Turra [:cturra]]

:jeads - as discussed on irc, all the steps outlined in your description have now been executed and we have a page loading at:

  https://datazilla.mozilla.org/b2gtw

\o/