616585 - Global search shows empty result / no results because global-messages-db.sqlite gloda database file is corrupt

Status: NEW

(MailNews Core :: Database, defect)

Description

[Peter Jentsch]

User-Agent:       Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; de; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12
Build Identifier: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; de; rv:1.9.2.13) Gecko/20101129 Thunderbird/3.1.7

When doing a global search, the result tab opens but remains empty with an empty title. See http://getsatisfaction.com/mozilla_messaging/topics/thunderbird_3_search_not_working for a screenshot. 


Reproducible: Always

Steps to Reproduce:
1. Enter search term in "global search" box, press enter

Actual Results:  
Tab opens, but remains empty

Expected Results:  
Tab opens and shows search results. 

Also happens when starting in safe-mode

Comment 1

[Peter Jentsch]

Attachment: Console log of starting Thunderbird in safe mode, starting a global search and quitting

Comment 2

[Ludovic Hirlimann [:Usul]]

Is indexing enabled ?

Do you have a global-messages-db.sqlite file in your profile ?

Comment 3

[Peter Jentsch]

Yes, I do have global indexing enabled. I also have spotlight indexing enabled, if that matters. 

And yes, I also have global-messages-db.sqlite file in my profile.

Comment 4

[Peter Jentsch]

Doing an integrity check on the database shows it's corrupt. (See following log). Moving the file global-messages-db.sqlite away fixes the problem for me (indexing seems to start over). 

sqlite> select count(*) from messages;
16753
sqlite> vacuum;
Error: database disk image is malformed
sqlite> pragma integrity_check;
*** in database main ***
On page 59435 at right child: 2nd reference to page 76255
On tree page 27501 cell 4: 2nd reference to page 75336
On tree page 27501 cell 4: Child page depth differs
On tree page 27501 cell 5: Child page depth differs
On tree page 76409 cell 91: 2nd reference to page 75319
On tree page 76409 cell 91: Child page depth differs
On tree page 76409 cell 92: 2nd reference to page 75314
On tree page 76409 cell 93: 2nd reference to page 75486
On tree page 76409 cell 94: 2nd reference to page 75317
On tree page 76409 cell 95: 2nd reference to page 75191
On tree page 76409 cell 96: 2nd reference to page 75190
On tree page 76409 cell 97: 2nd reference to page 75221
On tree page 76409 cell 98: 2nd reference to page 75490
On tree page 76409 cell 99: 2nd reference to page 75509
On tree page 76409 cell 100: 2nd reference to page 76174
On tree page 76409 cell 101: 2nd reference to page 76171
On page 76409 at right child: 2nd reference to page 76170
On page 6 at right child: invalid page number 76560
On tree page 47840 cell 103: 2nd reference to page 74601
On tree page 47840 cell 103: Child page depth differs
On tree page 47840 cell 104: 2nd reference to page 75302
On page 47840 at right child: 2nd reference to page 75318
Page 75269 is never used
rowid 4779 missing from index frecency
rowid 4780 missing from index frecency
rowid 4890 missing from index frecency
rowid 4891 missing from index frecency
rowid 4892 missing from index frecency
rowid 27677 missing from index attribQuery
rowid 34630 missing from index attribQuery
rowid 79742 missing from index attribQuery
rowid 79753 missing from index attribQuery
rowid 79786 missing from index attribQuery
rowid 79808 missing from index attribQuery
rowid 80033 missing from index attribQuery
rowid 81972 missing from index attribQuery
rowid 90597 missing from index attribQuery
rowid 201051 missing from index attribQuery
rowid 209885 missing from index attribQuery
rowid 219371 missing from index attribQuery
rowid 219893 missing from index attribQuery
rowid 219929 missing from index attribQuery
rowid 220668 missing from index attribQuery
rowid 220679 missing from index attribQuery
rowid 220737 missing from index attribQuery
rowid 220748 missing from index attribQuery
rowid 220758 missing from index attribQuery
rowid 220769 missing from index attribQuery
rowid 220779 missing from index attribQuery
rowid 221067 missing from index attribQuery
rowid 230592 missing from index attribQuery
rowid 232248 missing from index attribQuery
rowid 232371 missing from index attribQuery
rowid 233696 missing from index attribQuery
rowid 233745 missing from index attribQuery
rowid 233798 missing from index attribQuery
rowid 234129 missing from index attribQuery
wrong # of entries in index attribQuery
Error: database disk image is malformed

Comment 5

[Peter Jentsch]

Unfortunately I don't feel like posting the corrupt messages database here for further analysis.

Comment 6

[Ludovic Hirlimann [:Usul]]

(In reply to comment #5)
> Unfortunately I don't feel like posting the corrupt messages database here for
> further analysis.

No problem. Let's ask the developer if he want's more information. Andrew ?

Comment 7

[Andrew Sutherland [:asuth] (he/him)]

Corrupt databases are only actionable in the sense that we should be detecting them better and automatically deleting the database.  I've created an explicit gloda bug for that and made this bug depend on that.  Since the empty search result is the user-visible impact of this problem, I'm keeping this bug around.  We probably actually have a bunch of similar reports, so some dupe cleanup could be in order; whatever is left standing should depend on bug 616859.

Peter, thank you for the proactive and thorough investigation!