716810 - Some messages in offline (mailing list) folder become empty with dash in "from" field

Status: UNCONFIRMED

(Thunderbird :: Folder and Message Lists, defect)

Description

[Yuri]

Attachment: screenshot

User Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1
Build ID: 20111226113142

Steps to reproduce:

I am subscribed to LLVMdev mailing list. Messages arrive to the IMAP server.
Messages are moved into the dedicated to LLVMdev folder by mail filter in thunderbird.


Actual results:

I see that some messages in the dedicated to the mailing list folder are empty, no subject and only one dash in "from" field. "Date" field is filled. Please see the attached screenshot.

This is a major issue since mail data is being lost as a result of this bug.

Comment 1

[Yuri]

In the mail folder file one of these messages looks like this:

From - Tue Dec 20 17:35:46 2011
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00000000

From - Tue Dec 20 17:40:35 2011
...

Comment 2

[Hashem Masoud]

(In reply to Yuri from comment #1)
Is that shown when you view the source of the message?

Comment 3

[Yuri]

This is how the message looks in the folder file on disk, when one looks with an editor.

Comment 4

[WADA:World Anti-bad-Duping Agency]

(In reply to Yuri from comment #1)
> In the mail folder file one of these messages looks like this:
> 
> From - Tue Dec 20 17:35:46 2011
> X-Mozilla-Status: 0001
> X-Mozilla-Status2: 00000000
> 
> From - Tue Dec 20 17:40:35 2011
> ...

What is shown as mail body at message pane for the mail of "From=- and null Subject"?
What is shown by View/Message Source for the mail?
Is mail data following next "From - Tue Dec 20 17:40:35 2011" line shown as mail at thread pane? Is shown mail body correct one followig the "From - ..." line?

When first fetch of mail data, Tb uses "From - Tue Dec 20 17:35:46 2011" line and X-Mozilla-Status:/Status2: lines as place holder of mail in offline-store file, and uses lines after it as mail data. And, after Compact, Tb changes it to "From " line only.
Does X-Mozilla-Status:/Status2: follow second "From - Tue Dec 20 17:40:35 2011" line you pasted? (if X-Mozilla-Status:/Status2: exists, this is usually data for diferent mail from previous mail of "null line only", for both server and Tb.)

For From, Subject etc. at thread pain, Tb obtains it by "UID fetch NNN (UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (From To Subject ...".
Some of IMAP servers doesn't return message header as-is for BODY[HEADER.FIELDS, and Gmail IMAP is an example of such server. Gmail IMAP construncts Subject: header with subject data which Gmail extracted from Subject: header when BODY[HEADER.FIELDS) request.
And, Web mailer, who shows " " as From of a mail when "From " line is uploaded as mail data via IMAP by Tb(due to bug 426651), is known.
If your server uses the "From - ..." line in mail data as From: header, "-" can be returned as From: header from server to BODY[HEADER.FIELDS), although it won't usually occur because first line is null line(i.e. no message header.)

If one of next happens, phenomeno you saw can happen. (it sounds (A) as you say "empty")
(A) IMAP server sent null line only as mail data, for the mail of "From=- and null Subject", and lines after "From - Tue Dec 20 17:40:35 2011" line is correct mail data.
(B) IMAP server sent null line, "From - Tue Dec 20 17:40:35 2011" line, and subsequsnt lines as mail data.

If (A), "Save as .eml of Tb" saves .eml file of null line only, and if (B), Tb saves the null line and "From - Tue Dec 20 17:40:35 2011" line as mail data with subsequent lines.

Can you attach IMAP log? (see bug 402793 comment #28)
(1) Find a folder which has mail of "null Subject, From=-" and number of mails is small(call FolderX).
(2) Show "Order Received" column(if IMAP, UID of mail).
(3) Enable IMAP logging, restart Tb.
(4) Folder Properties, Repair Folder, sort by "Order Received" in ascending order, check thread pane, message pane, View/Message Source of the mail and mail of next UID.
(5) View offline-store file content(file of FolderX instead of FolderX.msf).
(6) Terminate Tb, check IMAP log file content.
    What is returned for the mail from server?
Remove/remove personal information from log file and irrelevant mail data lines from log file before attach to bug, please. Never paste data if long data, please.

Comment 5

[David :Bienvenu]

If you repair the folder using folder properties, do you see your messages again? Or are they corrupt on the server?

Comment 8

[Yuri]

Repairing folder doesn't help.

I am trying to use imap logger as described in https://wiki.mozilla.org/MailNews:Logging :
NSPR_LOG_MODULES=imap:5 NSPR_LOG_FILE=/home/yuri/imap.log thunderbird .

This creates an empty log file only. Why imap logging doesn't work?

Comment 9

[Wayne Mery (:wsmwk)]

Yuri do you still see the problem?

(In reply to Yuri from comment #8)
> Repairing folder doesn't help.
> 
> I am trying to use imap logger as described in
> https://wiki.mozilla.org/MailNews:Logging :
> NSPR_LOG_MODULES=imap:5 NSPR_LOG_FILE=/home/yuri/imap.log thunderbird .

^ this doesn't look valid to me


> This creates an empty log file only. Why imap logging doesn't work?

Comment 10

[Yuri]

I saw this again and again for a very long time. I believe I saw this fairly recently too. So this shouldn't be just closed. Will update once I see it.

Comment 11

[Wayne Mery (:wsmwk)]

Yuri,
Have you seen this in the last couple years?

Comment 12

[[e-mail]]

Haven't seen this in the last years.