665117 - [AMO-allizom] Refresh database from production

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[krupa raj[:krupa]]

Attachment: preview-accounts

Please update preview.amo's database with a fresh copy from production.

I have attached a list of accounts we want re-populated in preview.

Thanks.


Please disable cron jobs while this runs.

Comment 1

[Jeremy Orem [:oremj]]

Wil, approval?

Comment 2

[Wil Clouser [:clouserw]]

> Please disable cron jobs while this runs.

The way we did this last time (and should do it in the future) is that production is imported to a second database and when it completes preview is flipped to point to that db.  We don't want extensive downtime like we've had in the past.

Note that the new database needs to be dumped just like the current one and needs to be in phpmyadmin.

Comment 3

[Wil Clouser [:clouserw]]

Marking major.  What's the ETA?  This is blocking us from upgrading jetpacks to the just-released 1.0 SDK.

Comment 4

[Wil Clouser [:clouserw]]

Apparently this doesn't block us as none of the production jetpacks are the right version anyway.  -> back to normal.

Comment 5

[Jeremy Orem [:oremj]]

Have been running it since about 10am this morning. Usually takes around 12 hours. I'll let you know when it is done.

Comment 6

[Jeremy Orem [:oremj]]

Done.

Comment 7

[Wil Clouser [:clouserw]]

This broke builder authentication:

 f.authentication:CRITICAL Authentication database connection failure: (1044, "Access denied for user 'addons_reskin'@'10.2.83.%' to database 'addons_zamboni'") 

That's critical to fix as it's blocking dev

Comment 8

[Wil Clouser [:clouserw]]

I assume also builder-next

Comment 9

[Jeremy Orem [:oremj]]

Forgot I need to update settings_local for builder. Fixed.

Comment 10

[Dumitru Gherman [:dumitru]]

http://dumitru.pastebin.mozilla.org/1256739

this was still not working and nagios was sending alerts:

[20:48] < nagios-sjc1> | [98] pm-app-sphinx02:File Age - /data/sphinx/preview.addons/addons.spd is CRITICAL: FILE_AGE CRITICAL:                               mrz-
          /data/sphinx/preview.addons/addons.spd is 28970 seconds old and 139674114 bytes                                                                     nagios-p~
[20:49] < nagios-sjc1> | [99] pm-app-sphinx01:File Age - /data/sphinx/preview.addons/addons.spd is CRITICAL: FILE_AGE CRITICAL:                               nagios-s~
          /data/sphinx/preview.addons/addons.spd is 29056 seconds old and 139674114 bytes       


checking on tm-stage01-master01:

mysql> show grants for 'addons_reskin'@'10.2.83.%';
+----------------------------------------------------------------------------------------------------------------------+
| Grants for addons_reskin@10.2.83.%                                                                                   |
+----------------------------------------------------------------------------------------------------------------------+
| GRANT USAGE ON *.* TO 'addons_reskin'@'10.2.83.%' IDENTIFIED BY PASSWORD '*5D6A14E69E2430CB51607F381712D5DC20ABD4F1' |
| GRANT ALL PRIVILEGES ON `addons_zamboni2`.* TO 'addons_reskin'@'10.2.83.%'                                           |
| GRANT ALL PRIVILEGES ON `addons_reskin`.* TO 'addons_reskin'@'10.2.83.%'                                             |
+----------------------------------------------------------------------------------------------------------------------+
3 rows in set (0.00 sec)


so I :

mysql> grant all privileges on addons_zamboni.* to 'addons_reskin'@'10.2.83.%';
Query OK, 0 rows affected (0.05 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.12 sec)


and re-indexing works now.