472317 - Push Sumo 0.8.1 to prod on date Tuesday 20th January 2009.

Status: VERIFIED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Laura Thomson :laura]

This is a tracking bug for now, tag will be added (when it exists).

Comment 1

[Laura Thomson :laura]

As part of this push, you'll need to re-generate the htaccess rules via:

sudo webroot/htaccess.sh

Comment 2

[Laura Thomson :laura]

This is slipping, will advise new date.

Comment 3

[E. Cooper [:ecooper]]

For bug 470554, manual_index.php will need to be run to reindex. Please refer to comment 8 of bug 470554.

For bug 470378, the sphinx.conf on prod will need to be edited and some file perms need to be updated. Refer to comments 5 and 8 of bug 470378.

Comment 4

[Laura Thomson :laura]

From bug https://bugzilla.mozilla.org/show_bug.cgi?id=470550, we'll need to recreate the se_words table, as per https://bugzilla.mozilla.org/attachment.cgi?id=356203

Comment 5

[Laura Thomson :laura]

From bug 470365, copy scripts/sphinx/search.conf.php.dist to scripts/sphinx/search.conf.php and add production setup details, as per Nelson.

Comment 6

[Laura Thomson :laura]

Tag is https://svn.mozilla.org/projects/sumo/tags/0.8/0.8.1_20080115_r21592/

Comment 7

[Nelson Ko [:nkoth]]

Before running manual_index.php in comment 3, please delete lastindexingtime.txt so as to force a fresh index from scratch. If you have already run it, you can always delete lastindexingtime.txt and rerun it.

Also, delete lastindexingtime-f.txt and then run manual_index_forums.php to do a fresh from scratch index of the forums.

Comment 8

[Nelson Ko [:nkoth]]

PLEASE NOTE that the following se_words table must be recreated prior to indexing using manual_index.php to avoid the same bug 470550 appearing again.

(In reply to comment #4)
> From bug https://bugzilla.mozilla.org/show_bug.cgi?id=470550, we'll need to
> recreate the se_words table, as per
> https://bugzilla.mozilla.org/attachment.cgi?id=356203

Comment 9

[Laura Thomson :laura]

So, to summarize:
1.  Switch to tag
https://svn.mozilla.org/projects/sumo/tags/0.8/0.8.1_20080115_r21592/

2.  Copy scripts/sphinx/search.conf.php.dist to
scripts/sphinx/search.conf.php and add production setup details that point to loadbalancer host/port for sphinxd

3. Re-generate the htaccess rules via:
sudo webroot/htaccess.sh

4. From bug 470550, we'll need to recreate the se_words table, by running
https://bugzilla.mozilla.org/attachment.cgi?id=356203

5.  Delete webroot/lastindexingtime.txt and webroot/lastindexingtime-f.txt.

6.  The sphinx.conf file will need to be edited and some file
perms need to be updated. (Refer to comments 5 and 8 of bug 470378.)  Specifically:

6.1 Update sphinx.conf so it points to the correct location for the stopwords, that is scripts/sphinx/stopwords.txt
6.2 Copy scripts/sphinx/stopwords.txt.dist to scripts/sphinx/stopwords.txt and set read/writable by Apache

7. Run
php webroot/manual_index.php 
to re-index pages.

8. Run 
php webroot/manual_index_forums.php 
to re-index forums.

9.  Verify creation of webroot/lastindexingtime.txt and webroot/lastindexingtime-f.txt.

Comment 10

[Reed Loden [:reed]]

chizu's out sick, so reassigning to oncall (justdave).

Comment 11

[Reed Loden [:reed]]

(In reply to comment #9)
> So, to summarize:
> 1.  Switch to tag
> https://svn.mozilla.org/projects/sumo/tags/0.8/0.8.1_20080115_r21592/

Done, though I screwed up and switched to that exact tag, when I should have swapped to that tag + /webroot due to how we have it set up.

> 3. Re-generate the htaccess rules via:
> sudo webroot/htaccess.sh

Done.

The rest has been left for chizu to do, per discussion with laura. Note that the scripts directory is still using the old tag, so it'll need to be changed over to the new tag.

Comment 12

[Nelson Ko [:nkoth]]

on testing this on the load test cluster, discovered another step that is needed:

10. run "./usr/bin/indexer --all" if this is the first time indexing, otherwise run "./usr/bin/indexer --all --rotate"

Comment 13

[matthew zeier [:mrz]]

Where are we with this one?  What needs to happen to close this?

Comment 14

[Laura Thomson :laura]

It should be closed (0.8.1 was pushed), and the Sphinx related items that are outstanding I will put in a new ticket.  They should be done by chizu in a maintenance window although I don't anticipate problems.