Ok, thanks for the new IMAP:4 log with all the other accounts disabled. Still see the same result (which is probably good since account cross-talk would be really bad). I think we need to look directly inside the INBOX.msf file and see exactly what value is stored for ```highestRecordedUID```. It's in the text of the file somewhere but I don't know how to decode it. However there is a perl program you can run on INBOX.msf file. I've used it a few times and it's referenced here: https://bugzilla.mozilla.org/show_bug.cgi?id=1923355#c7. The direct URL to the program mork.pl is https://www.ggbs.de/extensions/mork.pl. If you are willing to run it directly on your INBOX.pl for your 500k account, cd to the directory in your tb profile containing your INBOX.msf, e.g., ```cd ~/.thunderbird/kgmivl5o.default-release/ImapMail/localhost``` then with tb shutdown, run the mork.pl program: ```perl ~/Downloads/mork.pl INBOX.msf | less``` It may take a while to parse the file before it displays anything. Once it prints the output, search for ```highest``` and it should find info like this: ``` fixedBadRefThreading = 1 flags = 83014 ( Elided Mail Inbox ImapPersonal ImapBox ) forceReparse = 0 highestModSeq = 43595 (275861) highestRecordedUID = 8e76 (36470) <------------- most important value! highWaterKey = 8e76 (36470) <------------- interesting but not as important. imapFlags = e000 (57344) mailboxName = INBOX MRMTime = 1754417379 (Tue Aug 5 14:09:39 2025) MRUTime = 1754677797 (Fri Aug 8 14:29:57 2025) numMsgs = 89a1 (35233) numNewMsgs = 47ec (18412) onlineName = INBOX sortColumns = byId (ascending) sortOrder = 1 ( ascending ) sortType = 15 ( byId ) totPendingMsgs = 0 UIDValidity = 611de794 (1629349780) unreadPendingMsgs = 0 version = 1 viewFlags = 0 ( ) viewType = 0 ( eShowAllThreads ) ``` Note the value for ```highestRecordedUID``` and ```highWaterKey```, in hex followed by decimal in parens. Then run TB again and after any folders finish downloading, shutdown TB and run mork.pl on INBOX.msf again and see if the values have changed. My guess is that highestRecordedUID does not change and that causes the messages with that UID and higher to be downloaded again on each startup. (Of course, if it doesn't change, "why not" is the big question. Or if it does, why are the same message headers getting re-downloaded -- also a big question.) Note1: In the IMAP:4 last log you have provided, the **first** occurrence of a line that says ```got stored highest UID=605618 for folder=INBOX``` is the initial value read from INBOX.msf and the **last** line that says ```store new highest UID=610904 for folder=INBOX``` is the last value written to INBOX.msf. So after you shutdown this TB run, you should see 610904 as the highestRecordedUID in the INBOX.msf file. Note2: I haven't seen any problem running mork.pl. It seems just to be "read only" on the target .msf file and doesn't write to it. But if you don't want to run it in place directly on your INBOX.msf in your profile, you can copy your INBOX.msf somewhere and run mork.pl on it there. Be sure to do any copy of Inbox.msf with tb shut down. Note3: I don't know the details but the mork DB is getting replaced soon. I think work is in progress. So please ignore the "editorial" comments in the mork.pl file. :).
Bug 1912195 Comment 34 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
Ok, thanks for the new IMAP:4 log with all the other accounts disabled. Still see the same result (which is probably good since account cross-talk would be really bad). I think we need to look directly inside the INBOX.msf file and see exactly what value is stored for ```highestRecordedUID```. It's in the text of the file somewhere but I don't know how to decode it. However there is a perl program you can run on INBOX.msf file. I've used it a few times and it's referenced here: https://bugzilla.mozilla.org/show_bug.cgi?id=1923355#c7. The direct URL to the program mork.pl is https://www.ggbs.de/extensions/mork.pl. If you are willing to run it directly on your INBOX.msf for your 500k account, cd to the directory in your tb profile containing your INBOX.msf, e.g., ```cd ~/.thunderbird/kgmivl5o.default-release/ImapMail/localhost``` then with tb shutdown, run the mork.pl program: ```perl ~/Downloads/mork.pl INBOX.msf | less``` It may take a while to parse the file before it displays anything. Once it prints the output, search for ```highest``` and it should find info like this: ``` fixedBadRefThreading = 1 flags = 83014 ( Elided Mail Inbox ImapPersonal ImapBox ) forceReparse = 0 highestModSeq = 43595 (275861) highestRecordedUID = 8e76 (36470) <------------- most important value! highWaterKey = 8e76 (36470) <------------- interesting but not as important. imapFlags = e000 (57344) mailboxName = INBOX MRMTime = 1754417379 (Tue Aug 5 14:09:39 2025) MRUTime = 1754677797 (Fri Aug 8 14:29:57 2025) numMsgs = 89a1 (35233) numNewMsgs = 47ec (18412) onlineName = INBOX sortColumns = byId (ascending) sortOrder = 1 ( ascending ) sortType = 15 ( byId ) totPendingMsgs = 0 UIDValidity = 611de794 (1629349780) unreadPendingMsgs = 0 version = 1 viewFlags = 0 ( ) viewType = 0 ( eShowAllThreads ) ``` Note the value for ```highestRecordedUID``` and ```highWaterKey```, in hex followed by decimal in parens. Then run TB again and after any folders finish downloading, shutdown TB and run mork.pl on INBOX.msf again and see if the values have changed. My guess is that highestRecordedUID does not change and that causes the messages with that UID and higher to be downloaded again on each startup. (Of course, if it doesn't change, "why not" is the big question. Or if it does, why are the same message headers getting re-downloaded -- also a big question.) Note1: In the IMAP:4 log you just sent, the **first** occurrence of a line that says ```got stored highest UID=605618 for folder=INBOX``` is the initial value read from INBOX.msf and the **last** line that says ```store new highest UID=610904 for folder=INBOX``` is the last value written to INBOX.msf. So after you shutdown this TB run, you should see 610904 as the highestRecordedUID in the INBOX.msf file. Note2: I haven't seen any problem running mork.pl. It seems just to be "read only" on the target .msf file and doesn't write to it. But if you don't want to run it in place directly on your INBOX.msf in your profile, you can copy your INBOX.msf somewhere and run mork.pl on it there. Be sure to do any copy of Inbox.msf with tb shut down. Note3: I don't know the details but the mork DB is getting replaced soon. I think work is in progress. So please ignore the "editorial" comments in the mork.pl file. :).