Open Bug 550286 Opened 10 years ago Updated Last year

Columns to display is lost if rebuild index/repair folder is used on an IMAP folder

Categories

(Thunderbird :: Folder and Message Lists, defect)

x86
All
defect
Not set

Tracking

(Not tracked)

People

(Reporter: kmcgrail, Unassigned, NeedInfo)

References

Details

(Keywords: regression, Whiteboard: [regression: tb3.0])

Attachments

(1 file)

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.0.18) Gecko/2010020220 Firefox/3.0.18 GTB6 (.NET CLR 3.5.30729)
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.8) Gecko/20100227 Thunderbird/3.0.3

I have selected "Received" and "Recipient" as column headers to display.

They work as expected.

However, right clicking on a folder, going to properties and selecting rebuild index resets the display columns to default.

Reproducible: Always

Steps to Reproduce:
1.Click icon above vertical scroll
2.Change folder display columns
3.right click on properties for inbox and rebuild index 
4.watch columns revert to default.
Actual Results:  
Columns revert to default

Expected Results:  
I would have expected columns to remain as configured.
Confirmed. It also is a regression.

Shorter steps to reproduce:
1. "Inbox" columns are default
2. Using column picker, remove "Attachments"
3. Click "Rebuild Index" inside "Inbox" "Properties"

Result:
"Attachments" column returns

Builds tested below.

Works:
version 2.0.0.24pre (20091201)

Works:
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1b3pre) Gecko/20090101 Shredder/3.0b2pre

Broken:
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.3a3pre) Gecko/20100304 Shredder/3.2a1pre
Status: UNCONFIRMED → NEW
Ever confirmed: true
Regression range:

Works:
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.3a1pre) Gecko/20091103 Shredder/3.1a1pre
2009-11-03-03-comm-central-trunk

Broken:
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.3a1pre) Gecko/20091104 Shredder/3.1a1pre
2009-11-04-03-comm-central-trunk

http://hg.mozilla.org/comm-central/pushloghtml?startdate=2009-11-03+02%3A00%3A00&enddate=2009-11-04+04%3A00%3A00
Candidate bug 510643.

Can you look at this please David Bienvenu?
Reproduced on linux. Setting "Platform" to "All".

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100216 Thunderbird/3.0.2
OS: Windows 7 → All
I thought all folders in Thunderbird 3 were created with the same default set of columns.

The default set of columns in a subfolder appears to be inherited from whatever the parent folder had at the time of the subfolders creation. And from the parent, not from the root parent folder (for deeply nested folders).
Blocks: 510643
Does tbird rebuild indexes when it starts up?  All my column settings disappear when I restart it (and I have dozens of active folders)...
Duplicate of this bug: 682624
Duplicate of this bug: 682624
Duplicate of this bug: 682624
As mentioned for bug 682684, this problem is due to the transient nature of MSF files which are deleted/recreated when folders are compacted and on various other events which I have not been able to categorise. Message pane preferences should be saved in a more robust structure and the program defaults should be available for edit which would actually solve the issue for many. The Mnenhy addon would help but is unavailable for version 6
I have the same on Earlybird 13.0a2, but only when repairing INBOX folder, other folders are not affected.
Is it possible that the db is not getting committed after changing the thread pane columns? I'll look at the code that persists thread pane columns.
kSmallCommit doesn't do anything. This was the only caller of it. I'll file a bug to get rid of it.
Assignee: nobody → dbienvenu
Attachment #616664 - Flags: review?(mkmelin+mozilla)
Attachment #616664 - Flags: review?(mkmelin+mozilla) → review+
ugh, this is more broken than I thought. We're not getting the contents of the old imap db in the repair folder case, from what I can tell, so lots of things would be broken. I'll have to poke around a bit.
Bug 682624 (not bug 682684, as stated by keithnight above) has been marked as a duplicate of this bug. However, I doubt that it is, as for me the bug only appeared recently, I think with Thunderbird 6 (2011). However, I think that Bug 682624 may be a duplicate of Bug 710056.

I have had the problem in TB for several months - I think from Version 6. It always occurs when all the following conditions are satisfied:

(1) The folder has deleted items; (2) the folder is compacted; (3) the number of remaining items in the folder is 1 or 2; (4) Thunderbird is restarted.

The column headings in that folder after the restart are the ones from Inbox, or, if the folder itself was Inbox, some default settings.

This explains why the problem (for me) seemed to occur at random, and usually with Inbox. I compact Inbox every evening before backing up and shutting down, and the number of items it contains varies between 0 and about 10. I've never observed the problem when the number of remaining items is 0 or more than 4. It /sometimes/ occurs with 3 or 4 items.

I agree with keithknight that "Message pane preferences ... should be available for edit which would actually solve the issue for many". It would solve the problem for me, in that the bug would then set the columns to acceptable values. As it is, I have to manually change them every day.
(In reply to Mike Dallwitz from comment #15)
> Bug 682624 (not bug 682684, as stated by keithnight above) has been marked
> as a duplicate of this bug. However, I doubt that it is, as for me the bug
> only appeared recently, I think with Thunderbird 6 (2011). However, I think
> that Bug 682624 may be a duplicate of Bug 710056.

Mike, thanks for that research. bug 710056 is a relatively recent phenomenon - version 10. So I would think bug 682624 is a duplicate of bug 540857 - version 5. Do you agree? 

(note: some people skipped version 5, and would have first experienced the bug 540857 issue in version 6)
Flags: in-testsuite?
Flags: in-litmus?
Whiteboard: [tb3.0 regression]
same here...
Bug 710056 is marked fixed now, can you all retry your tests to reproduce this?
I mean with TB18 or TB17.
Comment on attachment 616664 [details] [diff] [review]
proposed fix [checked in in comment 26]

What's up with this patch? It may have landed because bug 747102 didn't do this same change. But the is no kSmallCommit anymore in c-c. David, did you forgot the checkin link?
sorry, my failure -> bug only exists in Seamonkey. Thunderbird works well. :)
It would be strange if SM had this different from TB.
I hoped this too, but it seems to be this different...
There are indeed subtle differences between Thunderbird and SeaMonkey. Common to both is that columns can be selected on a per-folder basis (this bug). However, resizing or moving the columns in one folder affects those in all other folders as well for SeaMonkey (except Drafts and Sent folders) in contrast to Thunderbird where column order and relative width are kept separately for each folder. Thus, the latter part wasn't ported to SeaMonkey as it seems.
(In reply to Wayne Mery (:wsmwk) from comment #16)
> (In reply to Mike Dallwitz from comment #15)
> > Bug 682624 (not bug 682684, as stated by keithnight above) has been marked
> > as a duplicate of this bug. However, I doubt that it is, as for me the bug
> > only appeared recently, I think with Thunderbird 6 (2011). However, I think
> > that Bug 682624 may be a duplicate of Bug 710056.
> 
> Mike, thanks for that research. bug 710056 is a relatively recent phenomenon
> - version 10. So I would think bug 682624 is a duplicate of bug 540857 -
> version 5. Do you agree? 
> 
> (note: some people skipped version 5, and would have first experienced the
> bug 540857 issue in version 6)
Flags: needinfo?(dallwitz.m)
(In reply to :aceman from comment #20)
> Comment on attachment 616664 [details] [diff] [review]
> proposed fix
> 
> What's up with this patch? It may have landed because bug 747102 didn't do
> this same change. But the is no kSmallCommit anymore in c-c. David, did you
> forgot the checkin link?

http://hg.mozilla.org/comm-central/rev/935d2a4dc62e
Flags: needinfo?(acelists)
Wayne, what is the question for me here?
Flags: needinfo?(acelists)
(In reply to Wayne Mery (:wsmwk) from comment #16)
> (In reply to Mike Dallwitz from comment #15)
> Mike, thanks for that research. bug 710056 is a relatively recent phenomenon
> - version 10. So I would think bug 682624 is a duplicate of bug 540857 -
> version 5. Do you agree?

Wayne, sorry for the delay in replying. Most of the discussion of the bugs is way over my head. All I can say is that I no longer have the problem in Thunderbird. My last comment was #172 in Bug 710056 (4 Nov 2012), in which I stated that I didn't have the problem in V16.02, although some users had reported that it returned in that version. I haven't noticed the problem since. I just checked V17.0.4, using the procedure that reliably reproduced the problem before, and it's OK.
Flags: needinfo?(dallwitz.m)
I just repaired my imap Inbox to fix a threading problem, and lost the column settings.

(In reply to :aceman from comment #27)
> Wayne, what is the question for me here?

I was thinking you had worked on this before. But maybe it was someone else? Maybe rkent remembers.

And I thought we had fixed this - folder settings being lost on compact or repair - but I'm not finding the fixed bug in https://bugzilla.mozilla.org/buglist.cgi?f1=longdesc&list_id=6728858&short_desc=repair%20folder&o1=anywordssubstr&resolution=FIXED&resolution=DUPLICATE&chfieldto=Now&query_format=advanced&chfieldfrom=2y&short_desc_type=anywordssubstr&longdesc=repair%20folder%20&v1=sort%20column&longdesc_type=allwordssubstr&product=MailNews%20Core&product=Thunderbird

maybe we only fixed the compact case??
Flags: needinfo?(kent)
Flags: needinfo?(acelists)
I tested different imap account's Inbox folder and same results.
So perhaps my memory is faulty that this was all fixed at one point.
Local folder repair does not lose settings.
24.0a1 (2013-05-24)
Assignee: mozilla → nobody
Whiteboard: [tb3.0 regression] → [regression: tb3.0]
Version: unspecified → 3.0
It was rkent who fixed stuff in this area.
Flags: needinfo?(acelists)
I believe that you are talking about Bug 710056. That bug was a subtle db cache issue with lots of symptoms, of which this column loss was only one, in fact my main target was Bug 750569 - Compact Folders window appearing very frequently starting in TB12. I can't really comment on whether that should have impacted the current bug without investigating further.
Flags: needinfo?(kent)
Duplicate of this bug: 1017734
Summary: Columns to display is lost if rebuild index is used on an IMAP folder → Columns to display is lost if rebuild index/repair folder is used on an IMAP folder
I think location to save "Thread pane column choice" is better moved from pretty importnt "msgDatabase for msgDBHdr ==.msf file" to other place such as FolderCache(panace.dat), folderTree.json, sessions.json etc.
A known issue in "save Thread paane column choice in msf" is:
- When multiple messanger windows are opened, column choice is set at each messager window, and held in .XUL element, and saved in .msf.
- When Thunderbird is termnated with multiple messenger window opened, each messenger window saves his own column choice to .msf file.
   "Order of saving" is unpredictable.
- When Tb is restarted, because only one set of  column choice is held in .msf  file,
  "which messenger window's column choice is used after restart" is unpredictable.
This is never imap only issue.
Aceman, 
I can reproduce this. And Kevin can also**. If you are unable to reproduce, what can we do to help the cause?


** Kevin wrote me on 11/17/2015 "Yes, I am still using TB and still having the problem. For example, in 38.3.0, if I add recipient to the columns viewed, then repair the folder, recipient disappears."
Flags: needinfo?(acelists)
See Also: → 710056
Does it only happen for IMAP? Have we ruled out extension interference here (I think there was a bug with that part)?
Flags: needinfo?(acelists)
(In reply to :aceman from comment #36)
> Does it only happen for IMAP? Have we ruled out extension interference here
> (I think there was a bug with that part)?

I can reproduce with no addons with 24.6.0 and 31.3.0. 
Does not reproduce for local folder.
Does not reproduce by using compact folder
Attachment #616664 - Attachment description: proposed fix → proposed fix [checked in in comment 26]
I can still reproduce. I am happy to test a try build if you have a theory for a patch. Or do you need more data?
Flags: needinfo?(acelists)
Bug 392510 *might* be related:  If you have an IMAP server which doesn't support "keywords", and you do rebuild index operation (new name is "Repair Folder"), it will cause .msf only "flags" (aka "tags", like "To Do") to be lost.   Sounds pretty similar to losing columns to display in some situations.   Not sure if the index rebuild/repair folder sometimes gets automatically run during upgrades.
See Also: → 548966
I can confirm this is still an issue on  Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0
Still an issue on Thunderbird Linux 64 52.7.0

Not only columns disapear, also the sorting order is reset.

How to reproduce:

- Add a new column (example, Message Size)
- Change Sort order to Received, Threaded
- Call Repair Folder
- Changes above are now lost!
See Also: → 837620
You need to log in before you can comment on or make changes to this bug.