Closed Bug 712595 Opened 13 years ago Closed 11 years ago

IMAP folders not updated after remote folder changes

Categories

(Thunderbird :: Folder and Message Lists, defect)

Product:
Thunderbird
Component:
Folder and Message Lists
Version:
8 Branch
Platform:
x86_64
Linux
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 693204

People

(Reporter: lohner, Unassigned)

Details

User Agent: Mozilla/5.0 (Ubuntu; X11; Linux x86_64; rv:8.0) Gecko/20100101 Firefox/8.0 Build ID: 20111115183813 Steps to reproduce: I have an IMAP Server (dovecot) running. On a server at home I have tbird running fetching mails and filtering. I read mails on my laptop. Actual results: Folders are not always updated. To update, I stop and restart thunderbird, then the mails show up. Mails also show up if I click on a folder where the contents have changed. Sometimes Mails do NOT show up when clicking on a folder that definitely has new mails. Here when I close the thunderbird UI (running under ubuntu) the thunderbird-bin process is still running (using high CPU) and needs to be killed manually. Expected results: Folders should be updated automatically and correctly.
Same thing seen on Gentoo build of Thunderbird 8.0 We use server side filtering, and thunderbird is set to sync all folders. Some times they do update but not every sync. Manually syncing also doesn't pull the items down. They _aren't_ marked as read but simply placed into another folder.
Did you check the When getting new messages for this account always check this folder (that's visible by right clicking on the folder and selecting properties) ?
No, that option is not checked. Is there a way to enable it for 200-some folders at once? The updating works fine on my laptop when I start tbird, and continues working fine until a suspend or hibernate, then it stops updating.
(In reply to Ludovic Hirlimann [:Usul] from comment #3) > Did you check the When getting new messages for this account always check > this folder (that's visible by right clicking on the folder and selecting > properties) ? It is enabled for mine. It does not help.
Are you seeing already reported problem of bug 693204 ? If you don't have very many/very big IMAP folders, and if very frequent new mail check of the very many IMAP folders is not mandatory, please try next. - Max chached connections = 1 - Disable IDLE command use - When you want to know mail's status change by other IMAP clients, click other IMAP mail folder of the IMAP account, then click the IMAP folder. > Sometimes Mails do NOT show up when clicking on a folder that definitely has new mails. > Here when I close the thunderbird UI (running under ubuntu) > the thunderbird-bin process is still running (using high CPU) > and needs to be killed manually. New mail check of an IMAP folder by Tb is curretly done by one of next. - status command for an IMAP folder - "uid NNN:* fetch Flags" where NNN is next UID(1 + highest UID of currently existent mail) at connection where the IMAP folder is alredy selected. If "uid xxx fetch" is needed but no connection for the IMAP folder exists, "select the IMAP folder" is requested at existent connection for other folder. In any case, known problem exists. If IDLE comand is used, and if connection is lost while IDLE, Tb fails to detect connection loss, and waits fo long time until timeout in IDLE process happens. Infinite loop(CPU 100%) after closing of Tb window(unexpected retry loop is suspected. Tb never terminates in this case) is also reported to some other bugs. And, if connection error happens in special situation, Tb may enter retry loop. "(using high CPU) and needs to be killed manually" may be such case. Do you enable "automatic new mail check for the IMAP account by Tb"? Do you enable "IDLE command use"? (Server Settings/Advanced) If both are Yes, will frequency of your problem be reduced by disabling of "use IDLE command" option? (In reply to lohner from comment #4) > Is there a way to enable it for 200-some folders at once? Yes. mail.server.default.check_all_folders_for_new=true(default is false) is provided for it. mail.server.serverN.check_all_folders_for_new=true may also be available, but I don't know. This hidden option should be used very carefully, because message filter action at folder A which moves/copies mail to folder B can invoke message filter action at folder B which moves/copies mail to folder A. This can easily generate infinite loop.
The issue still exists, but for my Inbox. When I leave my PC in the morning, then receive e-mails through the day and read or move some of them, the new messages are still in my inbox in Tb when I come home. They come in, but they won't go away anymore after webmail operations. I need to either restart Tb or go offline and online and then fetch new mails. My IMAP connection is configured to use IDLE so it usually knows about new messages pretty fast, but it doesn't work when moving mails to a subfolder.
(In reply to Yves Goergen from comment #7) > I need to either restart Tb or go offline and online and then fetch new mails. If Tb is up for long time without re-boot of OS, and if IDLE is used and cached connection is used, and if IP adress assigned to PC is changed by DHCP or IP address of server is changed by DNS round robin etc., "re-initiation of connection from scratch including DNS Lookup" is required(known issue of Tb). This can be forced by "going Work Offline/Work Online". I sometimes saw similar issue even on POP3 account during with SeaMonkey especially after resume/wake-up of hybernation of PC(Win-XP). Request to POP3 server by Mail&News and/or HTTP server y Browser sometimes times out. In this case, "going Work Offline/Work Online" is a simple/easy workaroud. Even if issue of bug 693204 is worked around by procedure like comment #6, above issue can occur. Get IMAP log and check what happens when you see your problem, please. (Here is not support forum. Here is B.M.O to report Tb's bug, so data for problem analysis is needed for fixing Tb's bug by developers.)
The IP address of the client and the server do not change. Local public IP address only changes at night (daily DSL reconnect) but that has never been an issue. Over day, it also is not always a problem. Today for instance it was up to date. I have enabled my IMAP log and noticed that it can get very large (2 MB after a minute). The current setting is "imap:5,timestamp". Can I reduce it so that it's still useful for an analysis? Or will I need the full details to select an interesting range later?
(In reply to Yves Goergen from comment #9) > I have enabled my IMAP log and noticed that it can get very large (2 MB > after a minute). The current setting is "imap:5,timestamp". Can I reduce it > so that it's still useful for an analysis? Or will I need the full details > to select an interesting range later? imap:4 may cut log for message data. Please try it. If you are MS Win user, using DebugView and SET NSPR_LOG_FILE=WinDebug(and without timestamp parm) is a way to get ad-hoc IMAP log without termination/restart of Tb, while important event like suspend/resume occurs. See bug 402793 comment #6 for it.
Stupid log! Could somebody tell me that restarting Thunderbird will delete the log and recreate it? Anyway, going offline and back online didn't help today. Maybe the active log was guilty of that. I had to restart Tb to bring it back in sync with reality. It just didn't notice that some messages in my inbox were deleted. Refetching and switching folders had no effect at all. I've followed the log before the restart and have seen that it contains lots of e-mail addresses and other data but nothing obvious to me. It was about 6 MB long. If somebody would want to analyse the log, how could I send it to them confidentially?
(In reply to Yves Goergen from comment #11) > If somebody would want to analyse the log, how could I send it to > them confidentially? email, zipped
Flags: needinfo?(lohner)
(In reply to Yves Goergen from comment #11) > Anyway, going offline and back online didn't help today. Did you do required step if Ibbox is already selected at folder pane? (1) Inbox is selected at folder pane, and proglem occurs. (2) Go Work Offline mode => Inbox is not selected at any cached connection (3) Go back Work Online mode => no one tries to reconnect to server, until next Biff iterval etc happens. 　=> Inbox is still not selected at any cached connection (4) Click other folder than Inbox, then click Inbox again => By explcit folder open request, Inbox is seleced at a cached connection. This step 4 is mandatory after going offline and back online, if you wany to force Inbox access immediately. "Lack of this step 4" was reason of complaint of "workaroud doesn't work" in many cases in other bugs. Anyway, to bug opener, what is essential difference of your problem from already known bug 693204?
The difference is that TB dpesn't pick up NEW mails in folders until I click on that folder, or unless I close and open again. The bug is still present with 17.0.8
Flags: needinfo?(lohner)
(In reply to lohner from comment #14) > The difference is that TB dpesn't pick up NEW mails in folders until I click > on that folder, or unless I close and open again. The bug is still present > with 17.0.8 In comment #0, you say; > Sometimes Mails do NOT show up when clicking on a folder that definitely has new mails. Is new mails shown by foldder click in your case? Is new malls is not shown by foldder click in your case? If mbox == Other than Inbox, and if the Mbox is not included in automatic new mail check, and if the Mox is Offline-Use=Off folder or auto-sync=Off, and if the Mbox is not selected at any cached connection, it's pretty normal phenomenon. Please note; Because IDLE works on selected Mbox at a cached connection only, and bcause number of cached connections is never infinite, even when an Mbox was once selected at a cached connection, the mbox is de-selected at the cached connection when other Mbox is selected at the cached connection. Please clearly state phenomenon/conditions/operations etc.
(In reply to WADA from comment #15) > In comment #0, you say; > > Sometimes Mails do NOT show up when clicking on a folder that definitely has new mails. > Is new mails shown by foldder click in your case? > Is new malls is not shown by foldder click in your case? For me it's the former - the e-mails show when I click on the folder. There is also indication that I have new, unread messages in such folder but they don't show up in unified view and they only appear in the folder after clicking on it (and then they also show up in unified view). > If mbox == Other than Inbox, and if the Mbox is not included in automatic > new mail check, and if the Mox is Offline-Use=Off folder or auto-sync=Off, > and if the Mbox is not selected at any cached connection, it's pretty normal > phenomenon. > Please note; > Because IDLE works on selected Mbox at a cached connection only, > and bcause number of cached connections is never infinite, > even when an Mbox was once selected at a cached connection, the mbox is > de-selected > at the cached connection when other Mbox is selected at the cached > connection. I have set cached connections to 20 (server allows more, I have about 15 folders); explaining more: * mbox = other than Inbox; true * mbox is included in automatic new mail check (folder properties, selected 'when getting new messages for this account, always check this folder'; * mbox has enabled 'select folder for offline user'; I have also set 'mail.server.default.check_all_folders_for_new' to true; IDLE works on on k9mail
I think I may have a solution to this. At some point there was a flag added to the prefs that older accounts did not get. If you can create a new account and this solves the problem, then that was probably it. You can also add it manually for each mail server. In the config editor, add a Boolean with value "true" called "mail.server.server?.check_new_mail" where ? is the server number (do this for each mail server you have).
No, that's not it. I just added that flag for my IMAP account and went over to the web mail. The first message marked as read still made it to Thunderbird within a second, but deleting it wasn't applied and marking another message read was also ignored. I couldn't even synchronise this by disconnecting and reconnecting Thunderbird, which helped sometimes. It would probably have synchronised after restarting Thunderbird, which I haven't tested anymore. Your solution does not work for me.
You have to set the flag and then restart Thunderbird. Not clear to me that you did that. You may want to double check you did it on the right server number as well.
(In reply to wojtek from comment #16) ? they don't show up in unified view and they only appear in the folder after > clicking on it (and then they also show up in unified view). Please don't interland this bug(== issue in communication between IMAP server and Tb) with "problem in Ubified Folder of Unified View"(== issue in view refresh, issue in search re-invocation). If Unified view, this bug is applicable to "real mail folder" only. Unified View Inbox <= Unified Folder == Virtual Folder == a Search Folder | +-- accountA <= real folder of "Inbox of accountA" == Inbox of accountA in All folder view | +-- accountB <= real folder of "Inbox of accountB" == Inbox of accountB in All folder view
FYI. If your IMAP server supports CONDSTORE, CONDSTORE relevant bug in Tb may be relevant. Read bug 912216, and disable Tb's CODSTORE support(see bug 912216 comment #6). FYI. (In reply to Brian Weichel from comment #17) > In the config editor, add a Boolean with value "true" called "mail.server.server?.check_new_mail" > where ? is the server number (do this for each mail server you have). This setting is merely a part(half) of "Check new messages every NN minutes" of Server Settings.
I did restart, got the right number and didn't check a view. Although views (search folders) are broken, too, in that I always need to enter them twice to have current contents. It seems Thunderbird still has massive issues in doing its core job: Displaying current and accurate mailbox contents. How long does this software exist now? How old is IMAP now?...
(In reply to Yves Goergen from comment #18) Yves, you are right, that didn't fix the problem. Thunderbird still does not sync remote changes correctly, and a new account has the same problems that an old account does.
"not updated" in following bug summary has double meaning, as known by original comment #0. > Bug summary : IMAP folders not updated after remote folder changes (1) status update of mail at server is not reflected in Tb (2) new mail is not automatically retrieved from server It sounds major problem of this bug is (1). So, duping to bug 693204, in order to avoid confusion, in order to avoid useless "me too" comment without data such as IMAP log. If your problem is absolutely different from bug 693204, please re-open this bug, with "clear description of your problem" and "detailed description on difference of your problem from that bug", with ataching data which is neede for problem analysis, such as IMAP log. .
Status: UNCONFIRMED → RESOLVED
Closed: 11 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.