379039 - Some random messages not showing in Inbox IMAP folder.

Status: RESOLVED INCOMPLETE

(Thunderbird :: Mail Window Front End, defect, P2)

Description

[Marcel Touma]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.3) Gecko/20070309 Firefox/2.0.0.3
Build Identifier: 2.0.0.0 (20070326)

Some reandom messagens are not shown in the inbox IMAP folder. They reappear if the index file is rebuild.

The message that is not shown, but appear in the alert box.

Messages are not lost, they just don't appear.

Odd behavior: sometimes the message that is not seen in the inbox, can be seen in a saved search of the inbox.

Reproducible: Always

Steps to Reproduce:
1.Set an IMAP account
2.Use IMAP IDLE do receuve messages

Actual Results:  
Frequently, messages are not shown.

Expected Results:  
The messagens should be in the inbox.

Comment 1

[David :Bienvenu]

Is there anything different about those messages? Can you send me the IMAP account Inbox.msf file that shows this problem, and tell me the subject&sender of the message that doesn't appear? Thx!

After that, does clicking on the "rebuild index" button on the imap inbox folder properties dialog make the message show up?

Comment 2

[Marcel Touma]

David, I will wait the problem happens again to send you the bad msf file.

Yes, that's what I am doing. I have to always click the Rebuild Index button to solve the problem.

Comment 3

[David :Bienvenu]

An IMAP protocol log might also help:

http://www.mozilla.org/quality/mailnews/mail-troubleshoot.html#imap

though if they're showing up in the new mail alert, that means they're ending up in the .msf file.

Are you viewing messages threaded, or sorted flat, e.g., by date?

Comment 4

[Marcel Touma]

I will log the IMAP protocol...

I am viewing sorted flat... I thought could be a date problem, so I tried to sort by Order Received, with no sucess too.

Comment 5

[Marcel Touma]

Attachment: image showing the affected inbox

Comment 6

[Marcel Touma]

Attachment: image showing the saved search of the affected inbox

Comment 7

[Marcel Touma]

Hello,

I attached 2 images that show the problem: one of my inbox (red arrow shows where the message should be), and other of a saved search of the same inbox. Both ordered by "Order Received".

I made a backup of the IMAP log and my inbox.msf file, but before I add these files, I'd like to eliminate some confidential info without jeopardizing any relevant data to solve this bug. What can be changed inside these files?

Comment 8

[Marcel Touma]

The number of the message that disappeared of the inbox is 4744.

Comment 9

[Majken Connor [:Kensie]]

Anything confidential should be fine to change.  Replace it with x, so for an email address you can easily replace it with [e-mail] so we know it's still an email address.  Same for ips, x.x.x.x, replace names with [NAME] etc.  Also, I believe Bienvenu was suggesting you email the files directly to him rather than adding them to the bug, if that makes a difference in how much you want to scrub the file.

Comment 10

[Marcel Touma]

Hi Bienvenu, did you receive the files i emailed you?

Comment 11

[David :Bienvenu]

Marcel, were those files generated with 1.5.0.x? They show a kind of corruption that's fixed in 2.0 (and I think 1.5.0.11 or 12).

Comment 12

[David :Bienvenu]

I take it back - just in 2.0 - see bug 371672 - that's the bug for the corruption fix, so we won't create corrupt .msf files.

I'm not sure if that's connected to your duplicate problem.

Comment 13

[Marcel Touma]

The files were generated in 2.0... I have only changed some emails and personal data inside the files.

Comment 14

[Marcel Touma]

Guys, I am still having this problem and noticed that this duplicated/lost messages issue is happening with the arrival of new messages.

Do you have any updates?

Comment 15

[Poope]

hi guys, 
I face the same problem.
Something's strange: the file that doesn't appear in the inbox seems to appear as an duplicate of another. 
The strange thing is that if I sort my inbox with method "G" (?) (today, yesterday, last week...) it appears totally correct. I can mark it. I can flag it and so on. 
It hides behind a duplicate of another mail and reappers as original as I toggle the sorting algorithm. 
This is totall reproducable. And it has to do something with this one special mail. As I can move it to another imap folder and back - no matter... 
I use tb 2.0.0.6 which is my first installation of tb.

Comment 16

[HUIT]

Hello,

I'm running TB version 2.0.0.6, using IMAP, and I am having a problem which
looks like this one.

Thunderbird notifies me about recently received mail, my message filters move
the mail to their respectful destinations, the mailbox names are displayed in
bold and the number in parenthesis next to the mailbox name denotes an accurate
amount of new messages.  However, when I select the mailbox to view its
contents, the new messages do not appear in the list.

It is possible to recover the mail by rebuilding the index of the mailbox. 
Naturally, I would like to avoid having to do that every time.  The problem is
intermittent.  I stated noticing it two weeks ago.

Thank You,
huit

Comment 17

[HUIT]

Also, the messages may appear in saved search folders

Comment 18

[Seb]

Hi
I'm running TB version 2.0.0.7, using IMAP
I got the same problem as describe above by HUIT
I confirm that the mail header is duplicated (and more).
But no problem with Notification and Virtual folders.
The problem appears with new messages, every day but not always on the same folders. 
I receive about 150 mails / day which are dispatched in different folders by filters


Seb

Comment 19

[Benrifkah Bergsten-Buret]

I'm having the same problem.  Message doesn't appear in the list for my IMAP folders but will appear for saved searches of the folder.  Message re-appears when I rebuild the index.

TB: 2.0.0.9 (20071031)
OS: Windows XP
Add-ons:
 - Header scroll extension 0.3.2
 - KnujOn 0.31
 - Mailbox Alert -0.13.1
 - Quicktext 0.9.9.9
 - Talkback 2.0.0.9
 - View Headers Toggle Button 2.0.1

I would include folder files but they contain way too much confidential information for me to try and scrub.  I can create an IMAP log if anyone thinks it would be useful but the message is obviously getting to the folder or the saved search wouldn't be able to find it.

Comment 20

[HUIT]

Yes, I'm on 2.0.0.9 too.  I am still having the same problem!

huit

Comment 21

[HUIT]

I had posted a separate bug for this: bug 397115

It probably should be labeled as a copy of this bug at this point.

Comment 23

[Dan Mosedale (:dmosedale, :dmose)]

This is effectively dataloss, since if you don't have a saved search, you'll never see the message again unless you know to rebuild the MSF file.  Bumping severity, adding dataloss keyword, and marking as wanted+ for Tb3.

Adding qawanted in the hopes of verification on the trunk as well as (ideally) a reproducible test case.

Comment 24

[Wayne Mery (:wsmwk)]

it will be useful for people to report whether you see this in the current beta.
it's stable for most people. but backup your profile first.
  http://www.mozillamessaging.com/en-US/thunderbird/early_releases/

Poope if i remember correctly there is a seperate bug that mentions this problem in the context of "group"

Comment 25

[WADA:World Anti-bad-Duping Agency]

(In reply to comment #1)
> Can you send me the IMAP account Inbox.msf file that shows this problem,

A comment poster of Bug 414723 Comment #20 attached "corrupted .msf" and ".msf after rebuild index" to that bug.
David Bienvenu, if you'll have time, please look into it.

Comment 26

[Wayne Mery (:wsmwk)]

wrong component

Comment 27

[Wayne Mery (:wsmwk)]

everyone who sees this problem - we need more feedback and testing:
a) if you have new message "alert" turned on, do you see this problem with it disabled?
b) please try beta release** and report results (although it is not clear if beta 2 picks up what is mentioned in bug 414723 comment 34)

possible dupes bug 264800, bug 378884.  xref Bug 299865 New messages don't display in inbox after being retrieved, esp comment 15

** backup your profile before using 
 http://en-us.www.mozillamessaging.com/en-US/thunderbird/early_releases/

Comment 28

[Wayne Mery (:wsmwk)]

there's not enough information or interest here to continue this bug