38.0.1 broke my maildir Inboxes

RESOLVED DUPLICATE of bug 1175242

Status

MailNews Core
Backend
RESOLVED DUPLICATE of bug 1175242
2 years ago
2 years ago

People

(Reporter: Piotr, Unassigned)

Tracking

({regression})

regression

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

2 years ago
User Agent: Opera/9.80 (Windows NT 6.1; WOW64) Presto/2.12.388 Version/12.17

Steps to reproduce:

Using maildir in TB since "some time" (like a year or two) - maildir set with "@mozilla.org/msgstore/maildirstore;1".
Everything running fine (except filtering to subdirs, but that's not THAT huge for me (also, I think this was fixed, but didn't try)), so happy user :)
Updated Thunderbird to 38.0.1 (afair from 31.7.0).
TB on start gave my "too low disk space" warning despite 30+ GB of free space.
Inbox is full of messages, but they're not working, giving something like "Message not found {profile}/mailbox/Inbox?msg=NUMBERS" (sorry, but I had to make a _quick_ fix and restore from backup to 31.7.0).
Sending new message from one account to another works and the message works as expected.
No other broken boxes (sent, subdirs, spam, bin - all work fine).



Expected results:

It should work! ;)
Interesting that it is Inbox only
Component: Message Reader UI → Backend
Product: Thunderbird → MailNews Core

Updated

2 years ago
Keywords: regression

Comment 2

2 years ago
Piotr, are you the same person who posted on mozillazine http://forums.mozillazine.org/viewtopic.php?f=39&t=2941835 ?

I setup a number of maildir accounts under tb 31 (imap, gmail/imap, pop3) and got some messages into them. Then I opened the same profile under TB 38.0.1, no problems. I deleted some of the .msf files in the profile, and (at least under TB 38.0.1) they were recreated just fine.

So I cannot duplicate these issues.

In terms of recovery for you, I would try deleting the .msf files for these folders and see if the recreated .msf files work OK.
See Also: → bug 1175242

Comment 3

2 years ago
(In reply to Piotr from comment #0)
> TB on start gave my "too low disk space" warning despite 30+ GB of free
> space.

Is this message exactly "disk full", or is it "folder full" ?

Also why do you get it on startup? Is TB trying to download new messages into the Inbox?
(Reporter)

Comment 4

2 years ago
(In reply to :aceman from comment #3)
> (In reply to Piotr from comment #0)
> > TB on start gave my "too low disk space" warning despite 30+ GB of free
> > space.
> 
> Is this message exactly "disk full", or is it "folder full" ?

The message is (it's polish): "Na dysku jest zbyt mało miejsca, aby pobrać nowe wiadomości. Spróbuj usunąć stare wiadomości, opróżnić kosz po czym uporządkować foldery poczty i pobrać pocztę raz jeszcze."

So I would say it's "Too low disk space to receive new messages. Try to delete old messages, empty trash ... something something ;) ..."

> Also why do you get it on startup? Is TB trying to download new messages
> into the Inbox?

I suppose yes, it downloads new messages on start.


(In reply to Kent James (:rkent) from comment #2)
> Piotr, are you the same person who posted on mozillazine
> http://forums.mozillazine.org/viewtopic.php?f=39&t=2941835 ?

No.


> I setup a number of maildir accounts under tb 31 (imap, gmail/imap, pop3)
> and got some messages into them. Then I opened the same profile under TB
> 38.0.1, no problems. I deleted some of the .msf files in the profile, and
> (at least under TB 38.0.1) they were recreated just fine.

They're older then 31.x. This "like a year or two" is more like two. Not sure two years ago it was 31.x.


> In terms of recovery for you, I would try deleting the .msf files for these
> folders and see if the recreated .msf files work OK.

I reverted from backup so everything is fine now. I moved my profile to virtualized Windows and reproduced this on virtual machine (installed 31.7.0, added my profile, updated to 38.0.1 and *boom*). So I can do whatever with this as my main TB is working for now.
(Reporter)

Comment 5

2 years ago
(In reply to Piotr from comment #4)
> I reverted from backup so everything is fine now. I moved my profile to
> virtualized Windows and reproduced this on virtual machine (installed
> 31.7.0, added my profile, updated to 38.0.1 and *boom*). So I can do
> whatever with this as my main TB is working for now.

One more notice - it didn't go _exacly_ as before. Now one of my inboxes gives me this: http://i.imgur.com/aWWvlD2.png
The second maildir is OK to view messages, but I can't do anything in it (delete gives me the "Na dysku jest zbyt mało miejsca..." error).

And the "Na dysku jest zbyt mało miejsca..." looks like this: http://i.imgur.com/iJS7ACu.png
(Reporter)

Comment 6

2 years ago
Ooops, I missed attachments on bugzilla. Can upload them here if it's needed. :)
(Reporter)

Comment 7

2 years ago
(In reply to Kent James (:rkent) from comment #2)
> In terms of recovery for you, I would try deleting the .msf files for these
> folders and see if the recreated .msf files work OK.

Ok, now the not funny part starts. I was about to delete those files, so I went to my profile dir and... I can quote here what happend from the linked mozillazine: "Folder "Inbox" disappeared, only "Inbox.sbd" is ok."

I'm sure that the second part from mozillazine ("I recovered "Inbox" folder, get files from it to new Inbox/cur but it doesn't work") will give me exact result as I done that before my original report. Sorry, but the original report was submitted few hours later (I _had_ to have working e-mail, so reverted from backup) and it didnt cover all the facts.

Hope we're closer to solve this. ;)

Comment 8

2 years ago
Piotr, if you are able to duplicate this, then you are the key person in helping us resolve this.

In trying to interpret these reports, one thing that is very confusing for me is that I cannot tell when someone is talking about folders in the file system, and when they are talking about folders in Thunderbird as viewed in the folder pane. So I really don't know what this means, either from the original poster or when confirmed by you:

"Folder "Inbox" disappeared, only "Inbox.sbd" is ok."

because I don't know from where it disappeared, and I don't know what "is ok" means, and I don't know if "Inbox.sbd" is being seen in the Thunderbird folder pane or the file system.

What would be very helpful to me is to get a screenshot of the affected parts of the Thunderbird folder pane both before and after the problem occurs. Also, screenshots of the affected profile file system (including the parent to the Inbox folder) before and after the problem occurs. I am particularly interested in files in those directories that you may think are unrelated, as these odd files may be keys to understanding the problem.

There were so many problems with the old maildir system that it is amazing it worked at all for you. It is likely that the source of this issue is that one of those problems resulted in your actually used maildir information to be working but incorrect, such that when Thunderbird 38 starts using correct entries, the old entries no longer work. That is why I am particularly interested in related or duplicated entries.

Although it is preferable if you post that here, if you are concerned about privacy issues you could email to me at kent@caspia.com instead.
(Reporter)

Comment 9

2 years ago
(In reply to Kent James (:rkent) from comment #8)
> Although it is preferable if you post that here, if you are concerned about
> privacy issues you could email to me at kent@caspia.com instead.

Will contact you one way or another, but I need to find some more free time fot this. Right now still sticking with 31.x.

Comment 10

2 years ago
Me too. ;-)

I could reproduce the issue in Windows 7 / Thunderbird 38.1.0. (without the need of any old Thunderbird versions)
1) I created a new profile
2) I changed "Settings" > "Extended" > "Storage methods for new Accounts" to "one file per message (maildir)"
3) I created a non existing pop account
4) I changed the setting "Account" > "Server Settings" > "Extended" > "Where do you want to save this account?" to "Inbox of another Account: Local Folders"
5) I restarted Thunderbird
6) I created a message and saved it to the drafts folder
7) I copied the message to the inbox

a) On every second start of Thunderbird I get the error: "Not enough memory to download messages. Delete old mails, empty the trash, compress the folders and try again." (error #1 from attachment)
b) After getting the error once, when selecting the message from the inbox I get the error: "error: file not found - the file mailbox:///C:/profile/Mail/Local Folders/Inbox?number=1" could not be found. Please check the address and try again." (error #2 from attachment)

I also included the broken profile in the attachment. I managed to fix it by deleting the folder "\profile\Mail\Local Folders\Inbox\"
Link: http://www.familie-plentz.de/files/TB_issue_1175890_profiles.zip

Hope I could help.

Comment 11

2 years ago
I also seem to have problems in my normal profile, when moving messages by dragging them with the mouse. Unfortunately I could not reproduce this.

Comment 12

2 years ago
The problem should be worse than I thought: I succeeded to reproduce the problem with fewer steps. It looks like pop3 + maildir is broken: (in Thunderbird 38.1.0)

1) I created a new profile
2) I changed "Settings" > "Extended" > "Storage methods for new Accounts" to "one file per message (maildir)"
3) I created a pop3 account (imap works fine for this problem) with non existing credentials
4) I restarted Thunderbird and got the Error

The faulty profile and a mini profile described below can be found here:
Link: http://www.familie-plentz.de/files/TB_issue_1175890_mini_profiles.zip

I tried to reduce the profile to check if there is a wrong setting. First I removed any files but:

\profile\Mail\Local Folders\Trash\cur\
\profile\Mail\Local Folders\Trash\tmp\
\profile\Mail\Local Folders\Unsent Messages\cur\
\profile\Mail\Local Folders\Unsent Messages\tmp\
\profile\Mail\Local Folders\Trash.msf
\profile\Mail\Local Folders\Unsent Messages.msf
\profile\Mail\pop.googlemail.com\Inbox\cur\
\profile\Mail\pop.googlemail.com\Inbox\tmp\
\profile\Mail\pop.googlemail.com\Trash\cur\
\profile\Mail\pop.googlemail.com\Trash\tmp\
\profile\Mail\pop.googlemail.com\Inbox.msf
\profile\Mail\pop.googlemail.com\Trash.msf
\profile\prefs.js

Then I reduced "\profile\prefs.js" to:

user_pref("mail.account.account1.server", "server1");
user_pref("mail.account.account2.server", "server2");
user_pref("mail.accountmanager.accounts", "account1,account2");
user_pref("mail.server.server1.directory-rel", "[ProfD]Mail/pop.googlemail.com");
user_pref("mail.server.server1.hostname", "pop.googlemail.com");
user_pref("mail.server.server1.name", "gibtsnicht@gmail.com");
user_pref("mail.server.server1.storeContractID", "@mozilla.org/msgstore/maildirstore;1");
user_pref("mail.server.server1.type", "pop3");
user_pref("mail.server.server1.userName", "gibtsnicht@gmail.com");
user_pref("mail.server.server2.directory-rel", "[ProfD]Mail/Local Folders");
user_pref("mail.server.server2.hostname", "Local Folders");
user_pref("mail.server.server2.name", "Lokale Ordner");
user_pref("mail.server.server2.storeContractID", "@mozilla.org/msgstore/maildirstore;1");
user_pref("mail.server.server2.type", "none");
user_pref("mail.server.server2.userName", "nobody");
user_pref("mail.serverDefaultStoreContractID", "@mozilla.org/msgstore/maildirstore;1");

With these mini profile Thunderbird still crashes here. I cannot discover any faulty setting. IMO there should be a serious bug in Thunderbird.

Can anyone reproduce it? Do you need further information, or is there anything I could test?

Comment 13

2 years ago
I have the same problem: the Inbox Folder (on harddisk) is deleted on every start of thunderbird since I use maildir (I tried maildir for the first time now with thunderbird version 38 (on linux)).

Comment 14

2 years ago
after the inbox folder (with all messages in it) is deleted, a new one (empty) is created (with only subdir "cur"). the msf-file stil exists, so there are error messages when trying to display the messages in thunderbird.

Comment 15

2 years ago
cyberbeat, the issue now is that those of us who might fix this bug are unable to reproduce it.

If you can make this happen on a new profile, and you could report in glorious detail everything that you did to setup the account that shows this issue, that would be helpful.
Status: UNCONFIRMED → NEW
Ever confirmed: true

Comment 16

2 years ago
Kent James, I can reproduce it, this is what I did:

1. create a new linux-account
2. start-thunderbird
3. don't use the wizzard to create a new account
4. change the global settings to use maildir as default
5. create a new pop3-account
6. in the account-configuration of that pop3-account under "server-settings"=>"extended" switch the radio-box to use local folders as inbox
7. restart thunderbird (so that the pop3-account is not displayed anymore in the folders-view on the left)
8. now drop some mails into the inbox (it must be a top-hierarchy-folder in local-folders, this bug seems to affect every top level-folder of local-folders like drafts/....)
9. restart thunderbird

now you see, that:
- on the disk, the inbox folder is removed and created again (the content is lost)
- in thunderbird the headers are still displayed (because the msf-file was not removed), but when you repair, all mails are gone

I also had this problem without using local-folders as standard-folder for an pop3-account.

Comment 17

2 years ago
Both Samuel and cyberbeat mention they set the POP3 account to store into Local Folders (deferred Inbox). rkent, have you tried that?

Guys, do you have all the problems if you do not set the
"6. in the account-configuration of that pop3-account under "server-settings"=>"extended" switch the radio-box to use local folders as inbox" option ?

Comment 18

2 years ago
Piotr, do you also use the setting "6. in the account-configuration of that pop3-account under "server-settings"=>"extended" switch the radio-box to use local folders as inbox" ?
Flags: needinfo?(a)

Comment 19

2 years ago
I now tested the other case, and get the feeling, that maildir was never really tested with pop3 accounts!?

So a simpler case:

1. create a new linux-account
2. start-thunderbird
3. don't use the wizzard to create a new account
4. change the global settings to use maildir as default
5. create a new pop3-account
6. now drop some mails into the inbox
7. restart thunderbird

After restart the Inbox Subfolder on harddisk is not even recreated! (so trying to fetch new mail results in an error message.)
(Reporter)

Comment 20

2 years ago
(In reply to :aceman from comment #18)
> Piotr, do you also use the setting "6. in the account-configuration of that
> pop3-account under "server-settings"=>"extended" switch the radio-box to use
> local folders as inbox" ?

No, never changed anything in there, so every account has it's own Inbox.
Flags: needinfo?(a)
(Reporter)

Comment 21

2 years ago
But I can also confirm that this happend to my Inbox that motivated me to open this bug:

(In reply to cyberbeat from comment #16)
> now you see, that:
> - on the disk, the inbox folder is removed and created again (the content is
> lost)
> - in thunderbird the headers are still displayed (because the msf-file was
> not removed), but when you repair, all mails are gone


Sorry to be so inactive in "my own bug", but I just don't have enough time right now. :(

Comment 22

2 years ago
(In reply to :aceman from comment #17)
> Both Samuel and cyberbeat mention they set the POP3 account to store into
> Local Folders (deferred Inbox). rkent, have you tried that?
> 
> Guys, do you have all the problems if you do not set the
> "6. in the account-configuration of that pop3-account under
> "server-settings"=>"extended" switch the radio-box to use local folders as
> inbox" option ?
In my first attempt I did this, but my second approach described in comment #12 [windows] (exactly like cyberbeat described it in comment #19 [linux]) omitted this step. It is NOT necessary. Just bring pop3 and maildir together.

(In reply to Kent James (:rkent) from comment #15)
> If you can make this happen on a new profile, and you could report in
> glorious detail everything that you did to setup the account that shows this
> issue, that would be helpful.
Did you follow the steps described in comment #12 / #19?
Did you examine the linked profile from comment #12?
How could I help?

[SemiOT] Is there an easy to compile guide for Visual Studio + Windows + TB? Perhaps I might look into it myself?

Comment 23

2 years ago
(In reply to Samuel Plentz from comment #22) 
> [SemiOT] Is there an easy to compile guide for Visual Studio + Windows + TB?
> Perhaps I might look into it myself?

https://developer.mozilla.org/en-US/docs/Simple_Thunderbird_build

Comment 24

2 years ago
Symptoms are no different than bug 1175242 so let's combine these.
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → DUPLICATE
Duplicate of bug: 1175242
You need to log in before you can comment on or make changes to this bug.