1794611 - Mails from POP3 accounts are downloaded over and over again (duplicates)

Status: RESOLVED DUPLICATE of bug 1796903

(MailNews Core :: Networking: POP, defect)

Description

[Thomas Ludwig]

Attachment: popstate.dat

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:105.0) Gecko/20100101 Firefox/105.0

Steps to reproduce:

I'm using TB 102.3.2 on Arch Linux with 3 POP3 accounts and 1 IMAP account. I've been using maildir for several years if that matters.

In my accounts settings I selected to leave the mails on the server and delete them after 30 days. This has worked for me reliably for many years.

Actual results:

Starting with version 102.3.* the same mails from my POP3 accounts are downloaded over and over again. I can easily delete the duplicates from the context menu of the respective account but next time when new mails are fetched the duplicates are downloaded again.

Removing the popstate.dat files for those accounts didn't solve the problem.

The attached files contains the popstate.dat files for those 3 accounts. My mail adresses are removed.

Expected results:

The duplicate mails should not have been downloaded every time again. This has reliably worked in the past.

Comment 1

[Ping Chen [:rnons] (away)]

Thank for providing the popstate.dat, can you also get the logs of one account when doing "Get Messages"?
https://wiki.mozilla.org/MailNews:Logging#Main_module_options_within_MailNews, set mailnews.pop3.loglevel to All, then check the Error Console.

Comment 2

[Thomas Ludwig]

:rnons , thanks for this hint! I found one entry in the error console which might be relevant:

services.settings: Failed to load last_modified.json: TypeError: NetworkError when attempting to fetch resource. Utils.jsm:330

Comment 3

[Thomas Ludwig]

Another observation: if I do not delete the duplicates via the context menu it seems that they won't be downloaded again.

Comment 4

[b4]

Re. comment #2: This is random noise, please follow the instructions from comment #1 to provide a log from the error console with pref mailnews.pop3.loglevel set to All.
Re. comment #3: The function of deleting duplicates is provided by an add-on, it's not part of TB. Whatever the add-on does should not lead to re-download of messages. Messages that shouldn't be downloaded again are registered in popstate.dat, and that should not be affected by whether the message in the inbox was moved or deleted (manually or by an add-on).

Comment 5

[Thomas Ludwig]

Sorry, you're right, of course. The function of deleting duplicates is provided by the add-on "Remove Duplicate Messages". And this add-on seems to be the culprit, indeed. Because after disabling this add-on and manually removing the duplicates the problem doesn't occur any more.

So my conclusion is: some event in the past - which I can't replicate - had somehow caused the download of duplicates. I had always deleted those duplicates with that add-on - but it seems to have a malfunction. As the problem is gone after manually deleting the duplicates it seems that it wasn't a problem in Thunderbird itself.

Sorry for the noise!

Comment 6

[Thomas Ludwig]

I'm sorry to say that even after disabling the mentioned add-on the problem occured again. My observations from comment #5 regarding the add-on were obviously unfortunate coincidences. I will to provide a log from the error console before long.

Comment 7

[Thomas Ludwig]

Attachment: console-export-2022-10-17_17-46-32.txt

Comment 8

[Thomas Ludwig]

Log file from error console added.

Comment 9

[Thomas Ludwig]

FWIW, I've created a new profile and the problem hasn't shown up so far. I haven't deleted the old profile yet. So if you want me to perform some tests or provide more logs, please say so.

Comment 10

[Wayne Mery (:wsmwk)]

(In reply to Thomas Ludwig from comment #9)

FWIW, I've created a new profile and the problem hasn't shown up so far. I haven't deleted the old profile yet. So if you want me to perform some tests or provide more logs, please say so.

Thanks for saving it - Ping may need to see it.

Comment 11

[Thomas Ludwig]

The problem has also shown up in the new profile.

However, I noticed that everything works as expected if I disable "Until I delete them" in the leave on server settings.

So I suspect this problem is related to bug #1796903

Comment 12

[Thomas Ludwig]

So far the problem hasn't shown up again. This seems to confirm that this is a duplicate of bug #1796903