1098069 - Constant Freezing for minutes at a time with “Searching Folder...” in status bar, busy spinner, and "(Not Responding)" in title bar for unified folder. Workaround unselect the checkbox "Search Online" in unified folder properties.

Status: NEW

(MailNews Core :: Backend, defect)

Description

[Mark]

Attachment: Screenshot 2014-10-29 10.26.24.png

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:33.0) Gecko/20100101 Firefox/33.0
Build ID: 20141106120505

Steps to reproduce:

Thunderbird 31.2 freezes constantly with the spinning Windows 7 wheel and "(Not responding)" in the title bar, and often times with "Searching folder" in the bottom notification area.

I have 3 IMAP acounts, one Gmail, and two self hosted.

I have....

:: Unchecked "Enable Global Search and Indexer" from advanced settings
:: Set each each set to sync only 120 days
:: Not download messages over 50kb
:: Unsubscribed from the "All mail folder"
:: Tried a fresh install of Thunderbird, but I also used to have this problem on OSX so it must be something to do with my Google account or a much wider problem
:: Followed Google's own Thunderbird recommended optimizations https://support.google.com/mail/answer/78892?hl=en 

Starting with add-ons disabled makes no difference. But taking it off unified folder view seems to help a little. I still get way too many spinning wheels, but at least it doesn't lock up.




Actual results:

Thunderbird freezes and locks up for minutes at a time. I can't click anywhere untill it finished whatever it's doing.


Expected results:

I expect Thunderbird not to freeze up all the time. It's unusable. I love Mozilla and their support for privacy. But if it's unusable I can't use it:(

Comment 1

[Mark]

Just wanted to add that I moved back to OSX 10.10.1, Thunderbird 31.1, and am having the same problem. The freezes are still there, and the app locks up with "searching folder" in the title bar. It usually happens when clicking on Thunderbird in the dock. It's as if bringing the app into focus triggers a query to the IMAP server, which is fine, but I don't believe all other functions of the app should lock up. Clicking anywhere in the window produces the Mac spinning beach ball, until whatever process finishes. It seems shorter on the Mac (about 15 seconds), but maybe it's because I have gotten used to leaving the app and coming back a minute or so later.

Comment 2

[Wayne Mery (:wsmwk)]

Do you have Time Machine enabled and running on the Mac?

If not ...
1. Please start Thunderbird with logging enabled to capature an example time frame using ImapAutoSync:5,imap:5,msgdb:1,timestamp per https://wiki.mozilla.org/MailNews:Logging
2. And is it predictable _enough_ that, in say 5 attempts, you can capture one example with profiler enabled?  https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G

Comment 3

[Mark]

I do have time machine, but my backup hard drive is not always connected. This happens then too. Do you still want me to do 1 & 2 above?

Comment 4

[Wayne Mery (:wsmwk)]

Yes please

Comment 5

[Mark]

Can you explain #1 a bit better? What would my .command file look like?

This?...

#!/bin/sh
export NSPR_LOG_MODULES=imap:5
export NSPR_LOG_FILE=$HOME/imap.log
/Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin &
if on 10.5 change the above line to arch -arch i386 /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin &
ImapAutoSync:5,imap:5,msgdb:1,timestamp

Also for number two, I have captured an instance of the freeze with the Gecko Profiler. Is any personal data collected? Should I PM that to you?

Comment 6

[Wayne Mery (:wsmwk)]

1. looks good.  except you want ImapAutoSync:5,imap:5,msgdb:1,timestamp

2. profiler has no personal data

Comment 7

[Mark]

I have emailed you the link to #2

Comment 8

[Mark]

As for #1 I have created the file, set the permissions, and run it. It opens Thunderbird, but I can't see where to grab the logged info.

Comment 9

[Mark]

OK I found the log file in my user folder. I emailed that to you as well.

Comment 10

[Wayne Mery (:wsmwk)]

Thanks for the info. However, it is lacking in two ways:

1. I see only an imap protocol.  Perhaps I gave you bad advice. Your export needs to be
 ImapAutoSync:5,imap:5,msgdb:4,timestamp

2. The profile run is missing symbols, so I think you may need to use a nightly build from https://ftp.mozilla.org/pub/mozilla.org/thunderbird/nightly/latest-comm-central/ 

Backup your profile before using the nightly.  And, make sure time machine is not running.

Comment 11

[Mark]

#!/bin/sh
export NSPR_LOG_MODULES=imap:5
export NSPR_LOG_FILE=$HOME/imap.log
/Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin &
if on 10.5 change the above line to arch -arch i386 /Applications/Thunderbird.app/Contents/MacOS/thunderbird-bin &
ImapAutoSync:5,imap:5,msgdb:1,timestamp

Is what I used. That log file was the only one that was created.

Comment 12

[Wayne Mery (:wsmwk)]

Let us know when you have data according to comment 10


data from comment 11...

profile: http://people.mozilla.org/~bgirard/cleopatra/?1423015041220#report=291702c1def9926c2f83c8a1b5527542827d3ce3&selection=0,1,7

partial log...
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 12 getquotaroot "INBOX"
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=24 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * QUOTAROOT "INBOX" ""
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=39 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * QUOTA "" (STORAGE 4625131 15728640)
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=15 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: 12 OK Success
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 13 UID fetch 42349:* (FLAGS)
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=58 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * 36862 FETCH (UID 42348 MODSEQ (4208742) FLAGS (\Seen))
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=15 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: 13 OK Success
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:SendData: 14 uid SEARCH UNDELETED
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=0 needmore=1]
626528256[11b8a94b0]: ReadNextLine [stream=1f505b30 nb=215335 needmore=0]
626528256[11b8a94b0]: 24f1e800:imap.googlemail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 3561 3587 3593 3594 3602 3604 3605 3606 3609 3616 3632 3635 3641 3642 3643 3648 3649 3650 3652 3657 3659 3668 3669 3670 3690 3693 3699 3705 3709 3721 3725 3727 3731 3739 3740 3741 3743 3756 3766 3767 3772 3775 3780 3786 3793 3794 3795 3798 3806 3814 3817 3822 3825 3826 3832 3834 3850 3851 3854 3866 3868 3869 3873 3874 3881 3885 3909 3910 3911 3929 3930 3931 3935 3944 3948 3949 3964 3968 
... 
continues for about 500 lines like the line above

Comment 13

[WADA:World Anti-bad-Duping Agency]

(In reply to Wayne Mery (:wsmwk) from comment #12) 
> data from comment 11...

No timestamp, even though you are analyzing performance relevant issue...

>  13 UID fetch 42349:* (FLAGS)

Oh, CONDSTORE is not disabled...

>  14 uid SEARCH UNDELETED

I didn't know Tb uses SEARCH UNDELETED...

>  * SEARCH 3561
> 3587 3593 3594 3602 3604 3605 3606 3609 3616 3632 3635 3641 3642 3643 3648
> (snip)
> 3869 3873 3874 3881 3885 3909 3910 3911 3929 3930 3931 3935 3944 3948 3949
> continues for about 500 lines like the line above

Vary many UIDs in single response...
How many mails do you keep in Inbox of the Gmail IMAP account?

"Searching..." is perhaps corresponds to this "uid SEARCH UNDELETE".
And, ""Searching... is shown for lng time" indictes that it takes long to process SEARCH UNDELETE response.
I don't know when Tb issues "uid SEARCH UNDELETED".
But "uid SEARCH UNDELETED" is perhaps a result of "SELECT Inbox + uid fetch 1:* Flags (CHANGEDSINCE known_modseq)" used by CONDSTORE support.
If CONDSTORE support is disabled, Tb uses "SELECT Inbox + uid fetch 1:* Flags".
In this case, "one UID per a response line", so lo---ng single response won't occur, and  because "known UID is actually existing, and  unknown UD is actually non-existent" is guranteed by full resync after SELECT, Tb perhaps never uses "uid SELECT UNDELETE".

As known by bug 912216, Tb's CONDSTORE support has problems.
Disable CONDSTORE support.
Does problem still occur?

Comment 14

[WADA:World Anti-bad-Duping Agency]

If parsing of SELECT UNDELETED response is simply "get Next token, then append to mutableArray" + "finally sort" like one, performance problem usually won't occur.
I guess issue like ""get Next token, then append to mutableArray, and tries to keep ascending order upon each append, so sort is done for each append of a UID". It may be similar issue to bug 872869.

Why "uid SEARCH UNDELETE".is issued may be "Unified Folder==Search Folder(Virtual Folder)" and "partial resync due to CONDSTORE support". .

Comment 15

[Mark]

I do have a lot of emails in my inbox (doesn't everyone?), and I also use labels (six, not including the gmail defaults). I see there is a patch on the other link. How do I run this to disable CONDSTORE?

Interesting though don't you think that things are much quicker with unified inbox off?

Comment 16

[WADA:World Anti-bad-Duping Agency]

"writing bug number in comment at B.M.O" means "read pointed bug, please" frequently. Have you "*read*" pointed bugs?.

Comment 17

[WADA:World Anti-bad-Duping Agency]

Following is imap log for "Unified Folder" open and "Search Folder" open.
As for "SELECT UNDELED" command use, no difference was observed between "Saved Search Folder" and "Unified Folder".
   (a) Saved Search Folder             : Search Target = Inbox of 2 imap accounts : imap.mail.yahoo.com, imap.gmail.com
                                                         Condition = Match All,
                                                        "Online Search" option : Checked
   (b) Unified Folder named Inbox  : Search Target = Inbox of all IMAP accounts + Inbox of all non-IMAP mail account
                                                         Condition = Match All,
                                                        "Online Search" option = Grayed out. Not checked status.
                                                        (it seems that Tb always uses Online Search when Unified Folder)
If Online Search of Search Folder, usually "not Match All" and other modifier such as "KEYWORD $label1" is added("Tag contains Important" case), so not so many UID is returned to SEARCH commnd. 
There was no difference between "CONDSTORE is enabled" and "CONDSTORE is disabled".
CONDSTORE is relevant to "CHANGEDSINCE is used or not" upon "uid fetch 1:* Flags" for resync after SELECT Mbox.

> 00000003	8:51:01.077	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:SendData: 6 uid SEARCH UNDELETED 	
> 00000004	8:51:01.327	[2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=1639 needmore=0]	
> 00000005	8:51:01.327	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 285 287 288 289 290 293 359 429 430 433 434 500 1121 1132 1136 1142 1143 1146 1150 1157 1168 1179 1189 1202 1204 1206 1208 1209 1212 1213 1214 1215 1216 1217 1218 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1232 1233 1234 1235 1236 1237 1238 1239 1240 1242 1243 1244 1245 1258 1259 1260 1261 1262 1266 1272 1281 1288 1292 1294 1296 1301 1314 1460 1850 1851 1852 1853 1854 1855 185	
> 00000006	8:51:01.327	[2812] 3144[1013d60]: 6 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1876 1877 1878 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 194	
> 00000007	8:51:01.327	[2812] 3144[1013d60]: 0 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 202	
> 00000008	8:51:01.327	[2812] 3144[1013d60]: 4 2025 2026 2027 2028 2029 2030 2031 2032 2033 2078 2088 2117 2130 2150 2151 2181 2297 2372 2383 2384 2385 2386 2396 2397 2400 2401 2402 2403 2404 2405 2406 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 246	
> 00000009	8:51:01.327	[2812] 3144[1013d60]: 5 2466 2467 2468 2469 2470 2471 2472  	
> 00000010	8:51:01.327	[2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=27 needmore=0]	
> 00000011	8:51:01.327	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: 6 OK UID SEARCH completed 	
> 
> 00000017	8:51:01.327	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:SendData: 25 uid SEARCH UNDELETED 	
> 00000018	8:51:01.562	[2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=806 needmore=0]	
> 00000019	8:51:01.562	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958	
> 00000020	8:51:01.562	[2812] 3656[1012320]:  959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 	
> 00000021	8:51:01.562	[2812] 3656[1012320]: 1047 	
> 00000022	8:51:01.562	[2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=34 needmore=0]	
> 00000023	8:51:01.562	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: 25 OK SEARCH completed (Success) 	

Yahoo! imap looks to insert new line at "where he wants" instead of "between two UIDs as done by Gmail imap".

Do you see your problem with following?
  (1) Disable CONDSTORE support of Tb in order to surely rule out unwanted/excess problems.
  (2) At View/Folders/All, create a "Saved Search Folder" under "Local Folders" psuedo account in Tb. Call "Gmail_Inbox".
        Saved Search Folder named "Gmail_Inbox" under "Local Folders" :
             Search Target = Inbox of one Gmail IMAP account in whch pretty many mails are kept.
             Condition = Match All,
             Online Search option : Checked

Comment 18

[Wayne Mery (:wsmwk)]

(In reply to WADA from comment #17)
> Following is imap log for "Unified Folder" open and "Search Folder" open.
> As for "SELECT UNDELED" command use, no difference was observed between
> "Saved Search Folder" and "Unified Folder".
>    (a) Saved Search Folder             : Search Target = Inbox of 2 imap
> accounts : imap.mail.yahoo.com, imap.gmail.com
>                                                          Condition = Match
> All,
>                                                         "Online Search"
> option : Checked
>    (b) Unified Folder named Inbox  : Search Target = Inbox of all IMAP
> accounts + Inbox of all non-IMAP mail account
>                                                          Condition = Match
> All,
>                                                         "Online Search"
> option = Grayed out. Not checked status.
>                                                         (it seems that Tb
> always uses Online Search when Unified Folder)
> If Online Search of Search Folder, usually "not Match All" and other
> modifier such as "KEYWORD $label1" is added("Tag contains Important" case),
> so not so many UID is returned to SEARCH commnd. 
> There was no difference between "CONDSTORE is enabled" and "CONDSTORE is
> disabled".
> CONDSTORE is relevant to "CHANGEDSINCE is used or not" upon "uid fetch 1:*
> Flags" for resync after SELECT Mbox.
> 
> > 00000003	8:51:01.077	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:SendData: 6 uid SEARCH UNDELETED 	
> > 00000004	8:51:01.327	[2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=1639 needmore=0]	
> > 00000005	8:51:01.327	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 285 287 288 289 290 293 359 429 430 433 434 500 1121 1132 1136 1142 1143 1146 1150 1157 1168 1179 1189 1202 1204 1206 1208 1209 1212 1213 1214 1215 1216 1217 1218 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1232 1233 1234 1235 1236 1237 1238 1239 1240 1242 1243 1244 1245 1258 1259 1260 1261 1262 1266 1272 1281 1288 1292 1294 1296 1301 1314 1460 1850 1851 1852 1853 1854 1855 185	
> > 00000006	8:51:01.327	[2812] 3144[1013d60]: 6 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1876 1877 1878 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 194	
> > 00000007	8:51:01.327	[2812] 3144[1013d60]: 0 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 202	
> > 00000008	8:51:01.327	[2812] 3144[1013d60]: 4 2025 2026 2027 2028 2029 2030 2031 2032 2033 2078 2088 2117 2130 2150 2151 2181 2297 2372 2383 2384 2385 2386 2396 2397 2400 2401 2402 2403 2404 2405 2406 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 246	
> > 00000009	8:51:01.327	[2812] 3144[1013d60]: 5 2466 2467 2468 2469 2470 2471 2472  	
> > 00000010	8:51:01.327	[2812] 3144[1013d60]: ReadNextLine [stream=b547248 nb=27 needmore=0]	
> > 00000011	8:51:01.327	[2812] 3144[1013d60]: 8db8800:imap.mail.yahoo.com:S-INBOX:CreateNewLineFromSocket: 6 OK UID SEARCH completed 	
> > 
> > 00000017	8:51:01.327	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:SendData: 25 uid SEARCH UNDELETED 	
> > 00000018	8:51:01.562	[2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=806 needmore=0]	
> > 00000019	8:51:01.562	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: * SEARCH 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958	
> > 00000020	8:51:01.562	[2812] 3656[1012320]:  959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 	
> > 00000021	8:51:01.562	[2812] 3656[1012320]: 1047 	
> > 00000022	8:51:01.562	[2812] 3656[1012320]: ReadNextLine [stream=a8f5a60 nb=34 needmore=0]	
> > 00000023	8:51:01.562	[2812] 3656[1012320]: 876e800:imap.gmail.com:S-INBOX:CreateNewLineFromSocket: 25 OK SEARCH completed (Success) 	
> 
> Yahoo! imap looks to insert new line at "where he wants" instead of "between
> two UIDs as done by Gmail imap".
> 
> Do you see your problem with following?
>   (1) Disable CONDSTORE support of Tb in order to surely rule out
> unwanted/excess problems.

specifically bug 912216 comment 6

How to disable CONDSTORE support by Tb manually.
  Disable CONDSTORE support by Tb for all IMAP accounts.
    mail.server.default.use_condstore = false
  Disable CONDSTORE support by Tb for each IMAP accountFYI. independently.
    mail.server.server#.use_condstore = false

>   (2) At View/Folders/All, create a "Saved Search Folder" under "Local
> Folders" psuedo account in Tb. Call "Gmail_Inbox".
>         Saved Search Folder named "Gmail_Inbox" under "Local Folders" :
>              Search Target = Inbox of one Gmail IMAP account in whch pretty
> many mails are kept.
>              Condition = Match All,
>              Online Search option : Checked

Comment 19

[Mark]

You'll have to forgive me, a mere user. Much of the level of this trouble shooting is beyond me. I did actually read that thread, and Googled how to apply TB patches.

How to disable CONDSTORE support by Tb manually.
  Disable CONDSTORE support by Tb for all IMAP accounts.
    mail.server.default.use_condstore = false
  Disable CONDSTORE support by Tb for each IMAP accountFYI. independently.
    mail.server.server#.use_condstore = false

The above doesn't tell me how to do anything. Are you talking about going to the about:config screen? Above are only a couple of settings. There are quite a few more in the patch so I figured it would be more proficient to apply that. Only thing is that I don't know how to do that. Which is why I asked:)

Comment 20

[WADA:World Anti-bad-Duping Agency]

(In reply to Mark from comment #19)
> The above doesn't tell me how to do anything. Are you talking about going to the about:config screen?

Yes. In Thunderbird, about:config is carefully hidden, because it's dangerous for general users :-)
    (Win) Tools -> Options -> Advanced -> General ->  Config Editor
    (Mac) Preference- > Advanced -> General ->  Config Editor
I want Help->about:about for quick access to about:config :-)

Comment 21

[Mark]

OK thanks for clarifying that. I updated "mail.server.default.use_condstore = false" (I couldn't find any records for the other setting under each server, I tried adding the setting by pasting the full line into the adress bar i.e. "mail.server.server1.use_condstore = false", but that didn't appear to make the record/setting stick).

Unfortunately, after a restart of Thunderbird I'm still seeing the same freezing with a "searching folder" and beach ball (OSX).

Comment 22

[Mark]

Saving a search folder is problematic. "Online Search Option" is greyed out. Also when I save/create the search folder, it tells me "You must choose at least one folder to search for the saved search folder." Even though I have already selected the Gmail IMAP inbox.

Comment 23

[Mark]

Actually I got the search folder to work now. I had selected the row, but it was not obvious that the dot/bulletpoint was actually a check box by the folder.

Comment 24

[WADA:World Anti-bad-Duping Agency]

(In reply to Mark from comment #21)
> Option not held in mailnews.js is not shown in about:config.

To add mail.server.server1.use_condstore = false, you need to do;
   1.  At Context menu, New ->  choose type. "in this case, Boolean, becuse true/flase option.
   2. Paste the name, set vlue

Comment 25

[Mark]

OK thanks for that. I have done it. The issue remains. Interesting though that the search folder that I created is very quick at refreshing. It seems to be an issue with the unified folder. FYI this account has 37000 emails.

Comment 26

[WADA:World Anti-bad-Duping Agency]

(In reply to Mark from comment #25)
> Interesting though that the search folder that I created is very quick at refreshing.

If just after restart, "uid fetch 1:* Flags" + "uid SEARCH UNDELETED" is issued.
If refreshing of the Search Folder, "uid SEARCH UNDELETED" only is issued.
No problem on the Search Folder just after restart of Tb, or after "go Work Offline, go back Work Online"?

> The issue remains. 
> Interesting though that the search folder that I created is very quick at refreshing.
> It seems to be an issue with the unified folder. FYI this account has 37000 emails.

If so, cause is perhaps different Inbox.
Do you keep big Inbox on other IMAP accounts?
How about Inbox of POP3 accounts?
How about Inbox of "Local Folders"?

As known by Folder Properties of Unified Inbox folder at View/Folder/Unfied, "Unified Inbox" is;
   (b) Unified Folder named Inbox  : Search Target = Inbox of all IMAP accounts + Inbox of all non-IMAP mail account
                                                         Condition = Match All,
                                                        "Online Search" option = Grayed out. Not checked status.
Create Search Folder  for each Search Target Folder of Unfied Inbox.
For which folder is your problem observed?

Comment 27

[WADA:World Anti-bad-Duping Agency]

FYI.
File/New/Saved Search... can be used to create Search Folder.

Comment 28

[Wayne Mery (:wsmwk)]

Mark, please see questions in comment 26

Comment 29

[Mark]

It seems to do with Thunderbird and my Gmail IMAP account. The searching folder freeze only happens in unified inbox. Currently I don't use this feature because it interrupts my workflow too much. The experience is that one of two things are happening... either that in unified inbox, Gmail is being checked too long and too often, and/ or the UI locks up while emails are being checked/updated. When not in unified inbox the UI doesn't lock, and the wait/check times are acceptable.

Using unified inbox on Android K9 does not have this problem, which makes me think that it's not an account issue. And that it's a Thunderbird unified/UI issue.

For the questions above..

No problem on the Search Folder just after restart of Tb, or after "go Work Offline, go back Work Online"? - I don't understand if this is a question.

If so, cause is perhaps different Inbox.
Do you keep big Inbox on other IMAP accounts? - Define big? I only Sync 30days and messages under 50kb. My Gmail is by far the biggest.
How about Inbox of POP3 accounts? - I don't use POP3 currently
How about Inbox of "Local Folders"? - No local folders

Comment 30

[Wayne Mery (:wsmwk)]

How does it behave with version 38 beta from http://www.mozilla.org/en-US/thunderbird/channel/ ?

Comment 31

[Mark]

Hi, I have been on Beta for a couple of weeks and it makes no difference. Perhaps the lock ups are slightly less frequent, but that might just be me being optimistic.

Comment 32

[Mark]

This is obviously a long running problem.

http://superuser.com/questions/437117/thunderbird-very-slow-with-gmail/923085#923085

Comment 33

[Mark]

Come on guys. I have narrowed this down to be able to cause and solve this problem.

In unified inbox, right click on inbox -> properties -> uncheck search online.

Then the fun begins. Hitting Update at this point does nothing! Hitting cancel does save the preference though. Until you restart Thunderbird and it's selected itself again!!

Comment 34

[Wayne Mery (:wsmwk)]

(In reply to Mark from comment #29)
> 
> No problem on the Search Folder just after restart of Tb, or after "go Work
> Offline, go back Work Online"? - I don't understand if this is a question.

It is two questions
-  No problem on the Search Folder just after starting THunderbird?
-  No problem on the Search Folder just after "File > Work > Offline, then go back Work Online"?


> If so, cause is perhaps different Inbox.
> Do you keep big Inbox on other IMAP accounts? - Define big? I only Sync
> 30days and messages under 50kb. My Gmail is by far the biggest.

number of messages in each Inbox would be a nice start


(In reply to Mark from comment #31)
> Hi, I have been on Beta for a couple of weeks and it makes no difference.
> Perhaps the lock ups are slightly less frequent, but that might just be me
> being optimistic.

What is your current thinking on this - less frequent? Or no change?


We could use a better profile run. Can you get a new profile please?  
https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G

Comment 35

[Wayne Mery (:wsmwk)]

(In reply to Mark from comment #33)
> Come on guys. I have narrowed this down to be able to cause and solve this
> problem.

Indeed you've gone to great lengths.  Unfortunately I can't reproduce.  And with only 36k messages in your combined inboxes, the obvious way for there to be a performance issue is if any msf files are being rebuilt for the underlying Inboxes.

I've updated the instructions at https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Reporting_a_Thunderbird_Performance_Problem_with_G   A new profile using the latest version 38 would be a great help

Comment 36

[Mark]

HI all, I appreciate your work but I cannot spend any more time on this. I have, unfortunately had to move to web based clients as performance was too slow and frustrating for me. Thank you again for your time, I know it's not easy.

Comment 37

[Wayne Mery (:wsmwk)]

Thanks for the update

Comment 38

[Zarro Boogs]

Ok, as a newbie experiencing this exact problem, and completely daunted by this long, opaque, and highly technical thread, "I've moved on" is an the answer I was hoping for. Am I to understand that the resolution to this issue is "Don't use Thunderbird"? Is there a summary of this somewhere with guidance for newbies as to how to make this email client usable? A straightforward answer would be most appreciated. Thanks.

Comment 39

[Wayne Mery (:wsmwk)]

(In reply to David Kantor from comment #38)
> Ok, as a newbie experiencing this exact problem, and completely daunted by
> this long, opaque, and highly technical thread, "I've moved on" is an the
> answer I was hoping for. Am I to understand that the resolution to this
> issue is "Don't use Thunderbird"? Is there a summary of this somewhere with
> guidance for newbies as to how to make this email client usable? A
> straightforward answer would be most appreciated. Thanks.

start with https://wiki.mozilla.org/Thunderbird:Testing:Memory_Usage_Problems then if you still have trouble please post a support request at https://support.mozilla.org/en-US/questions/new

Comment 40

[Zarro Boogs]

Ok, I was really hoping for a straightforward answer. That "Memory Usage Problems" is a very daunting, technical document to make new users go through just to get this app working. I don't recall ever having to do that for any of the other email clients I've ever used in the last 20 or so year. I think instead I'm going to look for an email client that works right, so you don't have to be a programmer and go through 25 steps of "Troubleshooting memory usage problems" just to be able to use it to write an email.

Comment 41

[Zarro Boogs]

BTW those instructions seem to be out of date, contain a lot of information and steps that simply don't reflect reality of where things are and what they're called or if they're even actually available. You shouldn't be sending newbies to waste their time trying to figure them out, it's pointless.

Comment 42

[Wayne Mery (:wsmwk)]

- I'll be happy to take your suggestsions offline.  But it intentionally attempts to cover all the possibilities  (And yes, a better doc is needed. That takes someone's time.)
- If you have interest in staying with Thunderbird, I don't think anyone said you had to go through all the steps. And it is ordered such that the more common issues are at the top.  users do what they are motivated to do - but zero effort isn't what we are looking for when trying to help seomeone. 

> Am I to understand that the resolution to this issue is "Don't use Thunderbird"?

I don't see how you reach that conclusion - because clearly multiple people invested a lot of time. Unfortunately we did not find the cause of Mark's issue.

Comment 43

[michael.fischer]

I've been dealing with this issue of Thunderbird (Ubuntu 16.04) freezing up very frequently (anecdotally, whenever I click on it and "really need to use it"), and have been searching endlessly for a solution.  I used unified inboxes, and that seems to be where the problem originated in my case.  What worked for me (solved going on a week now) was to right-click on the Inbox (underneath it are all the various inboxes that are unified within it), choose Properties, then unselect the checkbox "Search Online".  I also went into the global Thunderbird preferences, Advanced tab, General sub-tab, deselect "Enable Global Search and Indexer".  Hope this is helpful to others!

Comment 44

[Michael Grant]

I also have a very similar issue and also have a gmail account which I store email in, read, but not deleted. I see exactly the same thing. I get a spinner for several minutes, and it happens constantly.

Following Michael Fisher's recommendation, I disabled the Global Search and Indexer and then stop Thunderbird, remove the global-messages-db.sqlite file from the profile directory, restart Thunderbird, and the problem is now gone.

Thunderbird constantly reads it to refresh something in memory and it can take minutes. What seems to be happening is when this sqlite file gets large, reading it or whatever it's doing, just blocks things for minutes at a time. Perhaps there is a smarter way to use this file to significantly speed things up?

On my system, before I deleted it, it was upwards of 1gb and Thunderbird would freeze for 4-5 minutes, more or less, every few minutes. It definitely froze just after restart, but after about a minute, when I clicked the Unified inbox.

Comment 45

[Michael Grant]

As a comment, this solution of disabling the Global Search and Indexer is also detailed on this page: http://kb.mozillazine.org/Minimize_the_size_of_a_profile

Comment 46

[gene smith]

(In reply to Michael Grant from comment #45)

As a comment, this solution of disabling the Global Search and Indexer is also detailed on this page: http://kb.mozillazine.org/Minimize_the_size_of_a_profile

I'm wondering how many messages are in your various Inboxes and other folders for all your accounts? I've been researching this for probably duplicate bug 1611887.

Comment 47

[Michael Grant]

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Comment 48

[gene smith]

For me the global search only caused somewhat annoying background tb activity with tb running 50-100% cpu until everything is re-indexed. The main problem I am looking at is worked-around by disabling the unified folder's "search online". Did you try only disabling the "search online" and leaving global search enabled? If you could try that it would be appreciated but I understand you probably don't want to do that.
What I'm seeing is that when the gmail inbox with lots of messages is searched (as indicated on status line) that the UI hangs, e.g., you can't scroll messages. The time of the hang/lock-up is proportional to the number of message in the Inbox or whichever unified box has lots of messages.
Anyhow, thanks for the info.

Comment 50

[Wayne Mery (:wsmwk)]

From bug 1611887 gene cites https://searchfox.org/comm-central/rev/25df033ac98c8cb346a8e0c338d1e7647ca23bfb/mailnews/base/src/nsMsgXFVirtualFolderDBView.cpp#238

Can someone create a performance profile of this in action? See https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance

Comment 51

[Brian Haskin (Janzert)]

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

Comment 52

[Wayne Mery (:wsmwk)]

(In reply to Brian Haskin (Janzert) - via bug Bug 1611887 - from comment #51)

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

For some reason this is not very revealing.

Do you also see the performance issue when started in safe mode? Start Windows' safe mode with networking enabled

• win10 https://support.microsoft.com/en-us/help/12376/windows-10-start-your-pc-in-safe-mode
  Still In Windows safe mode, start thunderbird in safe mode
• https://support.mozilla.org/kb/safe-mode-thunderbird

Does problem go away?

Comment 53

[Brian Haskin (Janzert)]

It's still there with both windows and thunderbird in safe mode. If anything it's even worse freezing for ~125 seconds. Note though that I did have to switch from wifi to a USB 10/100 Ethernet adapter in order to get networking working with windows safe mode.

Comment 54

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk) from comment #52)

(In reply to Brian Haskin (Janzert) - via bug Bug 1611887 - from comment #51)

Sure; this is taken with Thunderbird setup on two accounts. One account has 200k messages in the inbox and the second has 400. I enabled Online Search in the unified folder settings and started the performance profile recording while viewing the sent folder. I then selected the unified inbox. The inbox view showed and was responsive for a short time (<1 second) then the lock up and eventual recovery.

Performance profile is https://share.firefox.dev/3hliFUl

For some reason this is not very revealing. [92 seconds of jank with nothing on the stack]

Brian, using a newer version of Thunderbird, please capture another profile. Thanks.

Comment 55

[Wayne Mery (:wsmwk)]

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Comment 56

[Brian Haskin (Janzert)]

Yep, here you go https://share.firefox.dev/3ueQRHl

Doesn't appear to be particularly more informative than the last one though. The freeze does seem to be consistently sub-90 seconds now. Not sure if that's due to changes in Thunderbird or the account though.

Comment 57

[Brian Haskin (Janzert)]

Ack, sorry for the spam. Accidentally cleared an extra needinfo flag.

Comment 58

[Michael Grant]

(In reply to Wayne Mery (:wsmwk) from comment #55)

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Here you go: https://share.firefox.dev/3sgHN2y

What I did to do this was access the Unified inbox foler. I clicked back to one of the individual folders which took several minutes and then clicked on the Unified inbox which then took several minutes more. The buffer said it over-wrapped.

I see from my settings that I am storing mail in mbox format. I'm going to try and delete everthing and reload my mail with the maildir setting.

Let me know if I can do anything else to move this forward!

Comment 59

[przemyslslaw]

Wow. I've been having this painful issue for 2.5 years on two machines (32GB Macbook Pros). I've searched online for a solution several times during this time and even I've started to seriously consider giving up on Thunderbird after 12 years of using it...

Finally, I've found this thread today. Simply unchecking "Search Online" solves the problem. I don't even understand why I need "Search Online", but it does look like it's not worth having it on. Why is it even enabled by default?

I'm amazed that this issue is 7 years old (and the related issue 534520 is 9 years old) and it still hasn't been solved. Unfortunately, I'm sure there are many power users who stopped using Thunderbird because of this issue.

Last but not least, many thanks for your work and for the workaround.

Comment 60

[Stephen Wicklund]

I'm having the same issue. Thankfully, the workaround Mark found does work (disabling the "Search online" option for the Unified Mail view/folder/search).

I did also find another workaround: Add a "filter" to the Unified Mail view/folder/search, which is narrow enough that your result set remains small.

For example, you can set it to: "Status", "Isn't", "Read". This limits the result set to <100 for me, which makes it load quickly.

I like this workaround better than the "Disable search online" one myself, since this way has a bit less background processing. (doesn't re-query the accounts to check for new messages; that doesn't seem necessary, since Thunderbird already detects when new messages come in, and I've confirmed they then show up in the Unified view)

Side-note: If you do use the "Disable search online" workaround, it can mess with the unread-count for the Unified view. I've found that you can fix that by adding some kind of filter to that view/folder/search -- any filter will do, it seems.

Comment 61

[mb1285]

I'm using TB 78.13.0 (32-bit)

This fixed it:

Tools / Options / General / Disk Space - Clear Now

I used Unified folders.
I have left Global Search enabled.

I will just put it in my calendar software to do this "Clear Now" on the first of every month (thanks!).

A while back, I determined to just clear out everything in TB once per month - any e-mail I know I need, I save it, so, everything else can go.

IMO, e-mail programs are not really good for leaving things in, that you want to find later. I determined to leave this to the Windows File Explorer.

Comment 62

[mb1285]

(In reply to mb1285 from comment #61)

Wait, now it's doing it again! . . . Well, the Clear Now button is still good to do

It looks like this is what I want:

Tools / Options / General / Indexing / [un-check] Enable Global Search and Indexer

Comment 63

[Wayne Mery (:wsmwk)]

(In reply to Michael Grant from comment #58)

(In reply to Wayne Mery (:wsmwk) from comment #55)

(In reply to Michael Grant from comment #47)

For me, on the order of 60K messages in gmail and 20K messages in other mailboxes. 3 different imap accounts in total.

It seems like the this it's doing some long query that's causing the freeze.

Thanks Michael. Please create a profile using https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance and post the URL of the uploaded profile.

Here you go: https://share.firefox.dev/3sgHN2y

70% of activity is at "associateView"

Call stack is:

associateView
_applyViewChanges
_enterFolder
open
show
FolderPaneSelectionChange
onselect
EventHandlerNonNull
MozTreeChildren/<
EventListener.handleEvent

Comment 64

[Wayne Mery (:wsmwk)]

(In reply to Brian Haskin (Janzert) from comment #56)

Yep, here you go https://share.firefox.dev/3ueQRHl

Doesn't appear to be particularly more informative than the last one though. The freeze does seem to be consistently sub-90 seconds now. Not sure if that's due to changes in Thunderbird or the account though.

About the same as Michael's - 65% associateView resource:///modules/SearchSpec.jsm

Comment 65

[Wayne Mery (:wsmwk)]

Does this still happen in newer versions?
If it does, a new profile will be helpful https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance