Open Bug 798411 Opened 13 years ago Updated 3 years ago

Corrupted folder index displays first message's content in other messages (Mail data at Offset=0 in IMAP offline-store file is used for other mail) after moving Sent message to some other folder

Categories

(Thunderbird :: General, defect)

Product:
Thunderbird
Component:
General
Version:
15 Branch
Platform:
x86
Linux
Type:
defect

Tracking

(Not tracked)

People

(Reporter: james, Unassigned)

References

(Depends on 1 open bug)

Details

User Agent: Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:15.0) Gecko/20100101 Firefox/15.0.1 Build ID: 20120907073724 Steps to reproduce: I have experienced this bug for some time over multiple versions of Thunderbird, and on multiple machines. I am currently on Thunderbird 15.0.1+build1-0ubuntu2 on Ubuntu Quantal (prerelease). The server for the affected mail folders is running Dovecot 1.2.15-7 on Debian Squeeze (stable); the problem dates back to at least Dovecot 1.0.15 on Debian Lenny. Actual results: Occasionally, at least twice a week under moderate to heavy use, the .msf folder index of an IMAP mail folder will become corrupted such that a message will appear correctly in the message list pane, but the message reader pane for that message (and replying or forwarding) will retrieve the contents of the very first message in the folder instead. The mail folder itself (ImapMail/servername/foldername) remains intact, but Thunderbird continues displaying the wrong content for the affected message until Repair Folder is run on the folder. The most frequently affected folder is currently 854 MB with 5,226 messages.
We've fixed a few issues siilar to this one in 16, can you check and let us know if you still have the issue ?
I'm now running 16.0.1+build1-0ubuntu1, have reindexed all folders, and will watch to see if the problem recurs within the next 2-3 weeks. Thanks!
It is still happening, although seemingly less often. The problem seems to happen mostly with messages that I've sent, and then moved from my Sent folder into another folder.
Still happening on 16.0.2+build1-0ubuntu0.12.10.1.
Still happening on 17.0+build2-0ubuntu0.12.10.1. Dragging an affected message to another folder seems to work around the problem for that message.
(In reply to James Renken from comment #0) > Actual results: > the .msf folder index of an IMAP mail folder will become corrupted > such that a message will appear correctly in the message list pane, > but the message reader pane for that message (and replying or forwarding) > will retrieve the contents of the very first message in the folder instead. FYI. If offline-use=On folder and if Bug 501851 happened, such phenomenon can occur, because "first message in the folder" is usually mail of smallest UID, and because the mail of smallest UID is usually fetched first and is usually placed at offset=0 in offline-store file. > Bug 501851 If appending to IMAP offline-store file is interfered with other software, > mail data at offset=0 in offline-store(length=102,256 bytes) is used as mail data I can say nothing about "your case is Bug 501851 or not".
Interesting. I do have offline-use=On for all folders, but I'm not running any antivirus, search indexing, or backup processes that I'm aware of.
Setting dependency to Bug 501851 for ease of tracking because external symptom is similar.
Depends on: 501851
Still happening on 17.0.5+build1-0ubuntu1.
I have a similar problem that began when I upgraded to version 3 from 2.28. For some reason I then decided to go back to 2.28 and something got corrupted. When I receive more than one or two messages, the message contents of messages 3, 4, etc. all look the same as one of the first one or two messages. The messages come from a POP server (san.rr.com). My only fix is to leave the original messages on the server and read them from a different installation of Thunderbird. (I am now running the latest version on Windows 7 and the problem persists).
Still happening on 17.0.7+build1-0ubuntu0.13.04.1.
(In reply to Dave from comment #10) > The messages come from a POP server (san.rr.com). This bug is report of "problem with IMAP". Download process in IMAP and download process in POP3 is absolutely different, although similar copy/move mechanism in mail data appending to file is used in both cases. Please don't mix POP3 case in report of problem with IMAP.
(In reply to James Renken from comment #7) > but I'm not running any antivirus, search indexing, or backup processes that I'm aware of. Who can interfere "Tb's offline-store file open upon mail fetch" is not other software only; Tb's other task can iterfere, and offline-store file open fails if too many file handles. And, IIRC, "writing sent mail copy to Sent" doesn't execute explicite folder open which is done by "Folder click at folder pane". (IIRC, Rebuild-Index was not automatically executed by sent mail copy i the past when outdated .msf condition exists in local Sent folder.) (In reply to James Renken from comment #11) > Still happening on 17.0.7+build1-0ubuntu0.13.04.1. Is wrongly shown message "mail which is placed at offset=0 in offline-store file"?
(In reply to WADA from comment #13) > (In reply to James Renken from comment #11) > > Still happening on 17.0.7+build1-0ubuntu0.13.04.1. > > Is wrongly shown message "mail which is placed at offset=0 in offline-store > file"? Yes, that's correct.
Compact is a Tb's task which can interfere "Sent file open" by auto-sync for mail data fetching to Sent(offline-store file), because "Compact in IMAP" = "request EXPUNGE to server" + "Compact of offline-store file" and "Compact of offline-store file" does "Move nstmp to Sent with Replace Mode" at end of Compact process. Do you enable auto-compact? If Yes, dialog before auto-compact enabled? mail.prompt_purge_threshhold = true (auto-compact is eabled) mail.purge_threshhold_mb = nn (MegaBytes) mail.purge.ask = true (dialog before auto-compact is enabled) Note: After change to true, restart of Tb is mandatory. Never check "Do this automatically..." at dialog. If checked, manual ask=true setting and restart of Tb is needed again. If auto-compact is enabled, show "dialog before auto-compact", and reply "No"(or Cancel) when dialog is shown in daily use, and do "Compact Folders" manually when Tb is not busy. Is frequency of problem reduced?
(In reply to WADA from comment #15) > Do you enable auto-compact? If Yes, dialog before auto-compact enabled? The only purge-related setting in my prefs is: mail.purge_threshold_migrated = true
If default is used, entry is not written to prefs.js. Check via Config Editor please, to see your current setting including default value. (Tools/Options/Advanced/General, Config Editor, if Win)
Summary: Corrupted folder index displays first message's content in other messages → Corrupted folder index displays first message's content in other messages (Mail data at Offset=0 in IMAP offline-store file is used for other mail)
(In reply to James Renken from comment #3) > The problem seems to happen mostly with messages that I've sent, > and then moved from my Sent folder into another folder. By whom and when is "then moved from my Sent folder into another folder" executed after "save sent mail copy to Sent folder by Tb"? Does your problem occur on "Sent" folder? Or on "another folder"?
(In reply to WADA from comment #15) > Do you enable auto-compact? If Yes, dialog before auto-compact enabled? > mail.prompt_purge_threshhold = true (auto-compact is eabled) > mail.purge_threshhold_mb = nn (MegaBytes) > mail.purge.ask = true (dialog before auto-compact is enabled) > Note: After change to true, restart of Tb is mandatory. > Never check "Do this automatically..." at dialog. > If checked, manual ask=true setting and restart of Tb is > needed again. mail.prompt_purge_threshhold = true mail.purge_threshhold_mb = 20 mail.purge.ask = true I have not been seeing the dialog in daily use, since I regularly compact folders at the end of each session, when there's little or no other activity going on.
(In reply to WADA from comment #18) > (In reply to James Renken from comment #3) > > The problem seems to happen mostly with messages that I've sent, > > and then moved from my Sent folder into another folder. > > By whom and when is "then moved from my Sent folder into another folder" > executed after "save sent mail copy to Sent folder by Tb"? > Does your problem occur on "Sent" folder? Or on "another folder"? I typically drag sent messages out of the Sent folder, and into another folder, shortly after sending them. The problem most frequently occurs when trying to view the (recently moved) message in the new destination folder. (I believe it has occurred with other messages in the past, but this is the most frequent and reproducible scenario.)
James writes "I’ve mostly abandoned my previous pattern of moving messages from the Sent folder into another folder, which was most likely to trigger this bug. I was unable to reproduce it during some casual testing."
(In reply to Dave from comment #10) > I have a similar problem that began when I upgraded to version 3 from 2.28. > ... > The messages come from a POP server (san.rr.com). Dave writes he hasn't seen this in a long time. (But I'm not sure this would have been this bug anyway)
Status: UNCONFIRMED → NEW
Ever confirmed: true
Summary: Corrupted folder index displays first message's content in other messages (Mail data at Offset=0 in IMAP offline-store file is used for other mail) → Corrupted folder index displays first message's content in other messages (Mail data at Offset=0 in IMAP offline-store file is used for other mail) after moving Sent message to some other folder
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.