Closed Bug 1252580 Opened 8 years ago Closed 8 years ago

[sumo] Please check on status of monthly DB import

Categories

(Data & BI Services Team :: DB: MySQL, task)

Product:
Data & BI Services Team
Component:
DB: MySQL
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mythmon, Assigned: team73)

References

Details

Hello.

There is a cron job in the database infrastructure that once a month imports the data from our production environment to our staging environment. In particular, I think it dumps the data from suport_mozilla_com on the host db-sumo-rw, and imports it into support_allizom_org on db-support-dev-rw.

I think something has gone wrong with this, or it is still in progress. Usually it would be done by now. In particular, db-support-dev-rw has a different schema than db-support-dev-ro. This makes me think there is a replication problem, but I'm not sure.

The exact issue I'm testing is the presence of the `csat_email_sent` field on the `users_profile` table.
Group: metrics-private
Hi,

We have created one CR and will work on it.
https://secure.pythian.com/track/cr/1038207
It appears the script is still running:
[root@dev3.db.scl3 ~]# date && ps aux | grep import_sumo
Tue Mar  1 22:21:27 UTC 2016
root       690  0.0  0.0 103304   872 pts/5    S+   22:21   0:00 grep import_sumo
root     13230  0.0  0.0 106092  1212 ?        Ss   13:45   0:00 /bin/sh /usr/local/bin/import_sumo
Blocks: 1164035
The job populates stage and dev. The stage db has completed it's import and it is now running the dev import. In order to save space on the machine I implemented a change in the way the import is handled. Rather than uncompress the dump, I have it piping the output of gunzip to mysql. This is most likely the reason for it to be taking longer than normal. This can be modified as well. There is about a five hour difference from when the dump file comes in and when the import job kicks off. I will move up the import job in order to have it complete sooner.
dev has completed next month it should finish much earlier
[pythian.beebe]
Thanks Matt; Closing this by EOD (PST)
Thanks for checking on this everyone. Next time I'll be a bit more patient. Stage is working fine now, so I think this bug can be closed now.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.