615904 - Recover category data from migration

Status: VERIFIED FIXED

(support.mozilla.org :: Knowledge Base Software, task, P1)

Description

[James Socol [:jsocol, :james]]

Because of bug 615787, we've lost all the category data we had last night. New articles are going to have to be moved manually but articles we migrated can be fixed.

We have the migration SQL, we just need to use it to do something like:

UPDATE wiki_document SET category = FOO WHERE id = BAR;

for all 5700 articles we migrated. Shouldn't be terribly difficult to create some SQL.

Comment 1

[James Socol [:jsocol, :james]]

Attachment: restore category data as it existed in the migration

I generated this with PHP because iPython was being a jerk and not writing all the SQL to the file.

There were 5705 documents as of the migration, this file has 5705 UPDATE statements restoring the category to whatever it was in the migration SQL. I created it by reimporting the migration data and then pulling out the ID and Category of each document.

Comment 2

[James Socol [:jsocol, :james]]

Attachment: for the indiscriminately curious

For those who are curious here's the PHP script I used.

Comment 3

[Paul Craciunoiu [:paulc]]

Comment on attachment 494429 [details]
restore category data as it existed in the migration

Q/C:
1. Should we also move templates to the Templates category? Should be something like:
UPDATE wiki_document SET category = 60 WHERE is_template = 1;
2. I've nothing against this giant SQL but wouldn't it be easier to say:
UPDATE wiki_document SET category = _blah_ WHERE id IN (1,2,3,4...);

Comment 4

[James Socol [:jsocol, :james]]

1. We can but meh.
2. That's much tougher to generate than this was.

Comment 5

[Paul Craciunoiu [:paulc]]

Comment on attachment 494429 [details]
restore category data as it existed in the migration

r+
James will add that line for templates and I've tested this: the counts are the same. No rows changed afaict.

Comment 6

[James Socol [:jsocol, :james]]

Attachment: adds the template coercion

Here's the final SQL with the template coercion added at the end.

Comment 7

[James Socol [:jsocol, :james]]

You can now test the fix on support-stage. Keep in mind that it only affects articles that were present during the migration. Anything else that was added later is wherever it last was before the fix.

Comment 8

[Rebecca Billings [:rbillings]]

Verified on support-stage that articles have been put back into the Troubleshooting category, and Navigation [which was full yesterday after the release] has zero articles.