1913320 - Gloda indexing stalled on an IMAP Sent folder using Maildir

Status: RESOLVED DUPLICATE of bug 1907603

(Thunderbird :: Search, defect)

Description

[alex89]

Attachment: Снимок экрана (1).png

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36

Steps to reproduce:

Thunderbird 128.1.0esr x64, Windows 10
Some messages are not being found through the search tool, even though they are displayed in folders. I have checked that the search terms are correct. I decided to re-index the messages. I closed Thunderbird and deleted the global-messages-db.sqlite file. After launching Thunderbird again, automatic indexing began, but for some reason it started from the Sent folder and only indexed 14-15 messages before freezing. The progress bar does not move and nothing happens.

Actual results:

Reindexing the "global-messages-db.sqlite" database is not working. I am using the maildir message storage type.

Expected results:

All messages in folders should be reindexed automatically.

Comment 1

[alex89]

The issue was repeated on several other computers. When using the maildir message storage system, the search function did not work properly, and indexing did not function correctly.

Comment 2

[Hartmut Welpmann [:welpy-cw]]

Is there anything appearing in the error console (Ctrl-Shift-J) after the reindexing has started?

Comment 3

[alex89]

(In reply to Hartmut Welpmann [:welpy-cw] from comment #2)

Is there anything appearing in the error console (Ctrl-Shift-J) after the reindexing has started?

Here is what is written in the console at this moment 10 minutes after launching thunderbird with the "global-messages-db.sqlite" deleted

1723996710548 addons.xpi WARN Checking C:\Program Files\Mozilla Thunderbird\distribution\extensions for addons
1723996711867 addons.xpi WARN Addon with ID [e-mail] already installed, older version will be disabled
1723996711867 addons.xpi WARN Addon with ID [e-mail] already installed, older version will be disabled
Макет был принудительно применён перед полной загрузкой страницы. Если таблицы стилей ещё не загружены, то это может спровоцировать отображение нестилизованного содержимого. msgHdrView.js:4214:7
TypeError: aPart is null
MimeMessage.sys.mjs:142:7
NotFoundError: No such JSProcessActor 'BrowserToolboxDevToolsProcess' 2
tb.account.size_on_disk - Attempted to set the scalar to an incompatible value.

I noticed that it looks like the search stopped producing normal results only for messages, presumably after updating to 128 nebula. I can't say it's 100%, because updates were installed on different computers on different dates. Maybe I'm wrong and there was a similar thing with version 115.

On other computers where the maildir message database is also used, there is an effect that not all messages are found through message search.

Comment 4

[Hartmut Welpmann [:welpy-cw]]

(In reply to alex89 from comment #3)

Here is what is written in the console at this moment 10 minutes after launching thunderbird with the "global-messages-db.sqlite" deleted

[...]
TypeError: aPart is null
MimeMessage.sys.mjs:142:7

This is from this function.

Apparently Gloda has problems processing an encrypted message. Maybe debugging Gloda as described here can help to identify the offending message.

Comment 5

[alex89]

This may be true, but the problem exists on 7 computers and different accounts that use maildir, with a different set of messages.

1. all these computers 7 computers have problems.

processing an encrypted message all profiles? - unlikely

2. All computers have processing freezes in the Sent folder

3. I found that all these computers do not index messages, it does not matter if global-messages-db.sqlite is deleted or not, indexing is envious on the Sent folder

4. The other 40 computers that use mbox do not have such a problem.

5. IMPORTANT! If you create a new profile of problematic users and synchronize messages in mbox format, all messages will be indexed

The problem is clearly in maildir and indexing is hanging in the Sent Items folder. This happens even on those computers where I have not deleted global-messages-db.sqlite

Comment 6

[alex89]

(In reply to Hartmut Welpmann [:welpy-cw] from comment #4)

(In reply to alex89 from comment #3)

Here is what is written in the console at this moment 10 minutes after launching thunderbird with the "global-messages-db.sqlite" deleted

[...]
TypeError: aPart is null
MimeMessage.sys.mjs:142:7

This is from this function.

Apparently Gloda has problems processing an encrypted message. Maybe debugging Gloda as described here can help to identify the offending message.

Good afternoon, do you have any other thoughts considering what I have listed above?

Comment 7

[Hartmut Welpmann [:welpy-cw]]

(In reply to alex89 from comment #6)

Good afternoon, do you have any other thoughts considering what I have listed above?

Other than trying to identify one of the messages Gloda can't process and providing the corresponding EML file to further investigate the cause of this, I am afraid not.

Comment 8

[alex89]

(In reply to Hartmut Welpmann [:welpy-cw] from comment #7)

(In reply to alex89 from comment #6)

Good afternoon, do you have any other thoughts considering what I have listed above?

Other than trying to identify one of the messages Gloda can't process and providing the corresponding EML file to further investigate the cause of this, I am afraid not.

How about this? If you create a new profile of problematic users and synchronize messages using the MBOX storage method, all messages will be indexed without errors.
Does Global ignore this message when using mbox?
Also, if you restart Thunderbird many times, a random number of messages from 9 to 15 will be indexed, each time reducing the number of general messages to index, which is contrary to what prevents a specific message?

Comment 9

[Hartmut Welpmann [:welpy-cw]]

(In reply to alex89 from comment #8)

How about this? If you create a new profile of problematic users and synchronize messages using the MBOX storage method, all messages will be indexed without errors.

All I can say is that an IMAP Sent folder (with about 350 messages) I synced in a new profile using Maildir was indexed flawlessly. So this doesn't seem to be a general problem with Maildir.

Does Global ignore this message when using mbox?

Since messages are stored as EML files using Maildir, the message data may very well end up in Gloda differently for some kind of messages (which would be the bug).

Also, if you restart Thunderbird many times, a random number of messages from 9 to 15 will be indexed, each time reducing the number of general messages to index, which is contrary to what prevents a specific message?

What happens if you copy just about 20 messages from the Sent folder to a new folder, are they getting indexed correctly?

Comment 10

[Hartmut Welpmann [:welpy-cw]]

Or maybe this is just a duplicate of bug 1907603 which just got fixed.

Comment 11

[Wayne Mery (:wsmwk)]

(In reply to Hartmut Welpmann [:welpy-cw] from comment #10)

Or maybe this is just a duplicate of bug 1907603 which just got fixed.

Alex, that bug is fixed. Does your problem still reproduce?

Comment 12

[alex89]

(In reply to Wayne Mery (:wsmwk) from comment #11)

Alex, that bug is fixed. Does your problem still reproduce?

Wayne Mery, yes, it really helped to solve my problem. I checked on several computers and the issue was resolved.

There is one important thing to note, however: before the indexing was completed, I had to click on "Repair folder" which was inconvenient as it required me to re-download 40,000 emails with a total size of 21GB However, the problem has been resolved and that's good.

Before the update, the process did not yield any results. Even after clicking on "Repair folder", indexing would still hold/stop.

Comment 13

[alex89]

(In reply to Wayne Mery (:wsmwk) from comment #11)

Alex, that bug is fixed. Does your problem still reproduce?

An online translator helped me. I think I wrote it wrong. That's what I meant:

Wayne Mery, yes, it really helped to solve my problem. I checked on several computers and the issue was resolved.

Indexing did not work, I had to click on "Restore folder", which was inconvenient, since it required re-downloading 40,000 emails with a total volume of 21 GB, however, the problem was solved, indexing was successful and that's good.

Before the update, the process did not yield any results. Even after clicking on "Repair folder", indexing would still hold/stop.

Comment 14

[Hartmut Welpmann [:welpy-cw]]

Thanks for reporting back.