786961 - emails not completely downloaded from Gmail(POP3)

Status: RESOLVED WORKSFORME

(Thunderbird :: Folder and Message Lists, defect)

Description

[Ravi Kishor Shakya]

Attachment: screenshot showing gmail inbox with the email(that was not downloaded to Thunderbird) highlighted

User Agent: Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:14.0) Gecko/20100101 Firefox/14.0.1
Build ID: 20120713225625

Steps to reproduce:

I have setup Thunderbird to download mails from Gmail using POP.
The Thunderbird inbox has 1052 emails and the Gmail inbox has about 17000 emails.
I downloaded new emails to Thunderbird from Gmail



Actual results:

Some new messages are not downloaded to Thunderbird inbox and are left out as such in Gmail inbox.


Expected results:

All the new emails from Gmail inbox should have been downloaded.

Comment 1

[Ravi Kishor Shakya]

Attachment: Thunderbird inbox with the email absent

Comment 2

[Ludovic Hirlimann [:Usul]]

can we get an imap log to analyse what's going on ? see https://wiki.mozilla.org/MailNews:Logging for documentation.

Comment 3

[Ravi Kishor Shakya]

Hi Ludovic, I shall attach the pop3.log (I use POP3) shortly. Thanks

Comment 4

[WADA:World Anti-bad-Duping Agency]

(In reply to Ravi Kishor Shakya from comment #0)
> Steps to reproduce:
> I have setup Thunderbird to download mails from Gmail using POP.
> The Thunderbird inbox has 1052 emails and the Gmail inbox has about 17000
> emails.

When Gmail account's option setting of POP3 is following,
   Settings, Forwarding and POP3/IMAP, POP Download:
     [x] Enable POP for mail that arrives from now on
it's prety normal status.

> I downloaded new emails to Thunderbird from Gmail

Do you mean that you downloaded "new mails that arrived from now on"?

> Actual results:
> Some new messages are not downloaded to Thunderbird inbox and are left out
> as such in Gmail inbox.
> Expected results:
> All the new emails from Gmail inbox should have been downloaded.

If "Enable POP for mail that arrives from now on" is used, three kinds of mail exist.
(a) mails arrived before POP3 was enabled at Gmail's settings.
(b) mails arrived after POP3 was enabled at Gmail's settings,
    and downloaded via POP3.
(c) mails arrived after POP3 was enabled at Gmail's settings,
    but not downloaded yet via POP3.
And, status of mail (b) depends on Gmails's following POP setting.
  When messages are accessed with POP : mail disposition after download via POP

Does your "Some new messages are not downloaded" mean "some of mail (c) are not downloaded to Tb's Inbox"?
Or you use "Enable POP for all mail" and some of mail (c) were not downloaded by Tb?

Anyway, this bug is POP3 case, so bug 791497(IMAP only issue) is irrelevant. Removing from "Depends on:".

Comment 5

[WADA:World Anti-bad-Duping Agency]

Gmail's default is "Conversation view on", but Tb shows each mail(when threading is disabled). And "threading by Gmail" and "thrading by Tb" is not absolutely same.
Please use "Conversation view off of Gmail" and "threading off of Tb" for ease of problem analysis.

Example of your "Not downloaded new mail" looks some mails in Gmail's conversation with timestamp of "4:13 am"(6 mails in conversation) and "4:58 am"(1 mail in conversation).

In subject of conversation of "4:58", "22.08.2012" is seen.
Was the mail actually arrived after you enabled POP of Gmail?

How was the mail added to Gmail's mail DB?
If uploaded to Inbox via IMAP, mail is added to [Gmail]/All Mail and Gmail Label of "Inbox" is adde to the mail. In this case, the mail is not "mails arrived" in Gmail's POP3.

Do you use Gmail's filtering? Filtering in Gmail may affect on mail status of "mails arrived". For example;
If Skip Inbox(Archive) is executed by filter, an if Gmal Label of "Inbox" is added to the mail, I think the mail is not "mails arrived" for Gmail's POP3.

Comment 6

[Ravi Kishor Shakya]

Hi,
1) Please find the pop3.log.zip attached.
2) Yeah the new emails were not getting downloaded from Gmail(POP3) for the (c) case mentioned above i.e. 
(c) mails arrived after POP3 was enabled at Gmail's settings,
    but not downloaded yet via POP3.
3) please note that the emails were not part of threaded conversation.
4) There is no message filters set in Thunderbird and the emails were not the ones affected by filtering in Gmail (they do not meet the filtering criteria)
5) In subject of conversation of "4:58", "22.08.2012" is seen because it's content had that date mentioned but that email was sent out by the sender on 29 August.
6) I have been downloading Gmail emails using POP3 for about a year now. So I enabled POP3 download in Gmail a year back.
7) I have noted that this problem occurs when there are fairly large number of emails(in this case > 1000) in the Thunderbird inbox. 
Thanks

Comment 7

[Ravi Kishor Shakya]

Attachment: POP3 log

log file after enabling MailNews Logging

Comment 8

[WADA:World Anti-bad-Duping Agency]

Following is Gmail Help found by Google search for "recent: gmail pop".
> http://support.google.com/mail/bin/answer.py?hl=en&answer=13291
>  Some mail was not downloaded
> http://support.google.com/mail/bin/answer.py?hl=en&answer=47948
>  Using POP on multiple clients or mobile devices
>  What is 'recent mode?'

If connection loss etc. happens after RETR of a Gmail POP mail by Tb, it may be similar to "download by other client was done before Tb downloads".

Try download by "recent mode". Because "not downloaded new mail" looks sent on 29 Aug, you can download it again.
(1) Create new Tb's POP3 account with different server name, with same username,
    with "recent mode".
    If you currently use pop.gmail.com, define with pop.googlemail.com.
    If you currently use pop.goolemail.com, define with pop.gmail.com.
    Add "recent:" to user name.
(2) Check "Leave Messages on Server", with disabling any automatic deletion.
(3) Disable any automatic new mail check of this account.
(4) Enable POP3 logging to see UIDL of mails, and restart Tb.
(5) Do Get Msgs" only once for the account.

Is mail you want downloaded by recent mode?
Is same UIDL assinged by Gmail POP3 for same mail? (Tb writes UIDL in X-UIDL: header)

Comment 9

[Wayne Mery (:wsmwk)]

Ravi see questions in comment 8.

It would also be good to determine it still happens in version 16

Comment 10

[Ravi Kishor Shakya]

Hi Wayne,
In fact, with the emergence of this issue I had stopped using TB. However, I will update to version 16 and start reusing it to see if the issue persists and will update you. Thanks

Comment 13

[Wayne Mery (:wsmwk)]

WFM per comment 10