502283 - SQLITE_IOERR when working with profiles located on an SMB server (0 byte sqlite-journal files)

Status: NEW

(Core :: SQLite and Embedded Database Bindings, defect, P5)

Description

[Nathan Pachal]

User-Agent:       Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_7; en-us) AppleWebKit/530.18 (KHTML, like Gecko) Version/4.0.1 Safari/530.18
Build Identifier: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1) Gecko/20090624 Firefox/3.5

Local account are not affected by this issue. When launching firefox from a Mac OS X with Admitmac and an account that has its home directory stored on a Windows 2008 server, the following is displaced in Firefox. 

"The bookmarks and history system will not be functional because one of Firefox's files is in use by another application. Some security software can cause this problem."

Reproducible: Always

Steps to Reproduce:
1.) Install Firefox 3.5.
2.) Logon with a network account and launch firefox.

Actual Results:  
Error message is displayed as a drop down

Expected Results:  
No error message

The follow is in the console log:
7/3/09 2:38:10 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/permissions.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:10 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/permissions.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:10 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/permissions.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:10 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/permissions.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:10 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/permissions.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/search.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/search.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/search.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/search.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/search.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/formhistory.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/formhistory.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/formhistory.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/formhistory.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:11 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/content-prefs.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/content-prefs.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/content-prefs.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/content-prefs.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/signons.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/signons.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/signons.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:12 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/signons.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/sessionstore.js': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:13 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Caches/Firefox/Profiles/zgiehmpb.default/urlclassifier3.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/sessionstore-1.js': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite-journal': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:23 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Application Support/Firefox/Profiles/zgiehmpb.default/downloads.sqlite.lock': 22 (error suppressed) 
7/3/09 2:38:40 PM kernel firefox-bin[14195] Unable to quarantine `/Domain/channelm.local/Users/itnathan/Library/Preferences/cfx#eDEpaJE': 22 (error suppressed)

Comment 1

[administrator]

I can tell you that this is NOT affecting my network when the user accounts are stored on a OS X 10.4 Open Directory (AFP) server.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Nathan, does the problem also occur with Firefox 3.0.x? Would be nice if you could check Firefox 3.0.11, Firefox 3.0.11.

Comment 3

[Nathan Pachal]

Hi,

Version 3.0.10 works most of the time... 3.0.11 doesn't work at all...

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Can you please check bug 497792 comment 5? Does it stop working with the 2nd build?

Comment 5

[Nathan Pachal]

http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2009/04/2009-04-17-04-mozilla1.9.0/ ***Works***
http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2009/04/2009-04-18-04-mozilla1.9.0/ ***Don't Work***

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to comment #5)
> http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2009/04/2009-04-17-04-mozilla1.9.0/
> ***Works***
> http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2009/04/2009-04-18-04-mozilla1.9.0/
> ***Don't Work***

That's really bad. So it is another result of the sqlite upgrade. :(

Nathan, you you please check the following build if the problem still persists for you? It should be fixed in the upcoming 3.0.12:

http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.12-candidates/build1/firefox-3.0.12.en-US.mac.dmg

Shawn and Samuel, this issue still persists on 1.9.1. I have setup a smb connection and I can see the same behavior as reported on this bug with Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1pre) Gecko/20090709 Shiretoko/3.5.1pre

Comment 7

[D. Richard Hipp]

What does that error message mean:  "Unable to quarantine <filename>"?  Is there some kind of virus scanner or other "security" software preventing files from being written?

From the log, it appears that the "unix-dotlock" VFS is being used.  With that
VFS in use, SQLite uses "dot-file" locking, which should work over SMB, NFS, or any other filesystem where file locking is known to be broken.  So it is unclear what the problem is.  Certainly, nothing in that part of SQLite has changed in a long time.  Which SQLite upgrade broke the build?

Comment 8

[Samuel Sidler (old account; do not CC)]

(In reply to comment #6)
> Shawn and Samuel, this issue still persists on 1.9.1. I have setup a smb
> connection and I can see the same behavior as reported on this bug with
> Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1pre)
> Gecko/20090709 Shiretoko/3.5.1pre

And is it fixed in 1.9.0.12? If so, that makes no sense because we should now be using the same sqlite on both branches (that is, 1.9.0.12 uses the same sqlite that 1.9.1.0 uses).

Comment 9

[Nathan Pachal]

(In reply to comment #7)
> What does that error message mean:  "Unable to quarantine <filename>"?  Is
> there some kind of virus scanner or other "security" software preventing files
> from being written?
> 
> From the log, it appears that the "unix-dotlock" VFS is being used.  With that
> VFS in use, SQLite uses "dot-file" locking, which should work over SMB, NFS, or
> any other filesystem where file locking is known to be broken.  So it is
> unclear what the problem is.  Certainly, nothing in that part of SQLite has
> changed in a long time.  Which SQLite upgrade broke the build?

 "Unable to quarantine <filename>" does not have anything to do with security software, as there is no software on that system...

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to comment #7)
> changed in a long time.  Which SQLite upgrade broke the build?

See bug 488710 for the details. It was the upgrade to 3.6.7. Shawn will know more about it.


(In reply to comment #8)
> And is it fixed in 1.9.0.12? If so, that makes no sense because we should now
> be using the same sqlite on both branches (that is, 1.9.0.12 uses the same
> sqlite that 1.9.1.0 uses).

The release candidate of Firefox 3.0.12 doesn't show this problem for me. Nathan can you please x-check? Please see comment 6.

Comment 11

[Samuel Sidler (old account; do not CC)]

For: Shawn

Because you were mean to me on IRC today. 

Love,
Sam

Comment 12

[Nathan Pachal]

So, it would appear that 3.0.12 works as well as 3.0.10 (3.0.11 and 3.5 not working at all.) Also, there is still "Unable to quarantine" error messages pointing to .sqlit stuff in my console log, but Firefox runs... Thanks for your help in sorting this out BTW.

Comment 13

[Shawn Wilsher :sdwilsh]

That's really weird since 3.0.12 and 3.5 both are running the same SQLite with the same compiler options.  I can't explain why one works and the other doesn't.

Comment 14

[Nathan Pachal]

(In reply to comment #6)

Did you get a quarantine message in your console log when you did the smb 3.5 test?

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I have to add that the release candidate of Firefox 3.0.12 also stops working after the profile has been opened with Firefox 3.5. After that 3.0.12 suffers from the same problems. That happens because an empty places.sqlite-journal is lingering around in this profile. Removing this file and starting 3.0.12 again the bookmarks and history systems works fine. 3.0.12 doesn't create a journal file. CC'ing Dietrich and Marco.

Comment 16

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Same happens on Windows too.

Comment 17

[Shawn Wilsher :sdwilsh]

I'm a little confused by the recent summary change.  3.5 (or 1.9.1) is using SQLite 3.6.10 (http://mxr.mozilla.org/mozilla1.9.1/source/db/sqlite3/src/sqlite3.h#110).  As is 1.9.0.12 (http://mxr.mozilla.org/seamonkey/source/db/sqlite3/src/sqlite3.h#110)

Also, an empty places.sqlite-journal file is completely OK.

Comment 18

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Yes, should be 3.6.10.

Comment 19

[Shawn Wilsher :sdwilsh]

To clarify (this bug and it's comments are confusing) - what versions of Firefox are experiencing this?

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Any recent build on 1.9.0 doesn't suffer from that problem anymore. Even the following build works fine: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.12pre) Gecko/2009071004 GranParadiso/3.0.12pre

The issue I have mentioned in comment 15 is still persistent with a recent build of Gran Paradiso (3.0.14pre). So we could cover this on this bug or file a new one?

Nathan, can you verify that removing the empty places.sqlite-journal file from the profile fixes the problem with Firefox 3.0.x?

Comment 21

[Shawn Wilsher :sdwilsh]

(In reply to comment #20)
> The issue I have mentioned in comment 15 is still persistent with a recent
> build of Gran Paradiso (3.0.14pre). So we could cover this on this bug or file
> a new one?
File a new bug please.

Comment 22

[Nathan Pachal]

3.0.12 works 3.5.2 does not work. Hope this helps.

Comment 23

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to comment #21)
> File a new bug please.

I don't think that we should do that. I feel both are the same issue. So after Nathan's comment I checked again with multiple starts of 3.5.3pre:

1. Created a fresh profile with 3.5.3pre on a SMB folder => WFM
2. Restarted 3.5.3pre => Failed
3. Removed places.sqlite-journal and restarted 3.5.3pre => WFM
4. Started 3.0.14pre => Failed
5. Removed places.sqlite-journal and restarted 3.0.14pre => WFM
6. Restarted 3.0.14pre => WFM

At some point the cookies.sqlite-journal also shows the same behavior. It makes me feel that all journal files with a filesize of 0 makes problems.

Comment 24

[Shawn Wilsher :sdwilsh]

So, the difference between 1.9.0 and 1.9.1 (and later) is that we have the shared cache turned on in 1.9.0, but do not in 1.9.1.  I'm wondering if that is the issue here.

Comment 25

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Could be related to bug 444763. We would have to make a regression test for the builds 2008-08-16 and 2008-08-17.

Comment 26

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Mmh it's really hard to track down. There are a couple of issues involved here when doing regression tests. I don't think it is worth doing tests of such old builds because they have an older sqlite3 version which will break Firefox/Shiretoko all the time. On 1.9.0 it was first fixed for Firefox 3.0.1 (bug 417037) and broke again with Firefox 3.0.11 and has been fixed for Firefox 3.0.12 (bug 497792). So it was related to the used sqlite3 version.

When I switch to 3.5 I'm a bit afraid if testing against older sqlite3 versions will help. Given that it is impossible for me to run tests with builds from 2008-08-16 and 2008-08-17. I feel using a debugger would be more helpful. I'll add some debug output which will hopefully help to get closer to this problem.

Comment 27

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: Debug output

This attachment shows some debug output from a Minefield build (090722)

Comment 28

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Can we get any update on this bug? As given in comment 26 I cannot do a regression test due to broken builds so I did a debug session and have identified the code which is causing this problem:

In mozStorageConnection::Initialize we are able to open the database but fail on the following line:

srv = sqlite3_prepare_v2(mDBConn, "SELECT * FROM sqlite_master", -1, &stmt,
                         NULL);

We get an SQLITE_IOERR which is "Some kind of disk I/O error occurred".

Richard, is that a known or already fixed bug in sqlite? Affected database file in this case is places.sqlite.

Comment 29

[D. Richard Hipp]

Didn't we previously determine that the error was SQLITE_IOERR_RDLOCK because
SQLite was not allowed to obtain a read lock on the database file?

Comment 30

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: sqlite3 variable output

I have no idea if that helps but while stepping through the sqlite code the error is raised inside sqlite3RunParser. Variables output is attached.

Comment 31

[Shawn Wilsher :sdwilsh]

(In reply to comment #29)
> Didn't we previously determine that the error was SQLITE_IOERR_RDLOCK because
> SQLite was not allowed to obtain a read lock on the database file?
Yes, we had I thought, but possibly in a different bug?

Comment 32

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Checked the same profile via an AFP connection again and it doesn't show this bug. So it's really SMB related.

Comment 33

[Mike Beltzner [:beltzner, not reading bugmail]]

I don't think we'll block Firefox 3.6 on this as it's not a regression from 3.5; would be nice to get a clearer idea of what's going on. I'm assuming this is OSX-only (as all comments relate to that) since I expect we'd have heard more about this if SMB-based profiles stopped working on Windows. If that assumption is false, renominate, please.

Comment 34

[Gervase Markham [:gerv]]

Bug 451915 - move Firefox/Places bugs to Firefox/Bookmarks and History. Remove all bugspam from this move by filtering for the string "places-to-b-and-h".

In Thunderbird 3.0b, you do that as follows:
Tools | Message Filters
Make sure the correct account is selected. Click "New"
Conditions: Body   contains   places-to-b-and-h
Change the action to "Delete Message".
Select "Manually Run" from the dropdown at the top.
Click OK.

Select the filter in the list, make sure "Inbox" is selected at the bottom, and click "Run Now". This should delete all the bugspam. You can then delete the filter.

Gerv

Comment 35

[Nathan Pachal]

Hi,

I've tried this with Firefox 3.6 and Mac OS X 10.5.8. This issue seems to be resolved. Can anyone else verify this?

Thanks,

Nathan

Comment 36

[Henrik Skupin [:whimboo][⌚️UTC+2]]

No, it's still there with Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.2pre) Gecko/20100311 Namoroka/3.6.2pre

Comment 37

[Munroe]

I have been suffering from this problem for a long time.  However, it looks like with a recent update to FF, my issue as disappeared.

I am running 10.5.8 + FF 3.6.14 and I am not longer having this issue.

Comment 38

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Shawn, have we upgraded sqlite in 3.6.14?

Comment 39

[Shawn Wilsher :sdwilsh]

(In reply to comment #38)
> Shawn, have we upgraded sqlite in 3.6.14?
We have, but what version are you looking for?

Comment 40

[Marco Bonardo [:mak]]

The last upgrade was SQLite 3.7.1 in FF 3.6.11, the next planned upgrade (waiting approval) is 3.7.4 in FF 3.6.15.

Comment 41

[Nathan Pachal]

Hi,

I've tested the release version of Firefox 4.0 and this issue is back though the symptoms are a bit different. When Firefox closes, it will hang and will lease a SQLite lock file behind. When you force quit Firefox, you need to log out/in and delete the lock file before using the Firefox again. As you can imagine, this is not workable. Please let me know if you need more information/logs.

Thanks,

Comment 42

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Marco, what's the version of sqlite for Firefox 4?

Comment 43

[Mike Kaply [:mkaply]]

Could this bug be related?

https://bugzilla.mozilla.org/show_bug.cgi?id=717406

Or is this bug 3.6 only?

Comment 44

[Marco Bonardo [:mak]]

(In reply to Michael Kaply (mkaply) from comment #43)
> Could this bug be related?
> 
> https://bugzilla.mozilla.org/show_bug.cgi?id=717406
> 
> Or is this bug 3.6 only?

can likely be duped to one of the dependencies in bug 719952, there should be one more Mac-centric. Otherwise can be added as a new dependency.

No, this is not 3.6 only.

Comment 45

[Mike Kaply [:mkaply]]

Are there dependencies on later versions of sqlite?

Could sqlite be backleveled to test ?

Comment 46

[Marco Bonardo [:mak]]

(In reply to Michael Kaply (mkaply) from comment #45)
> Are there dependencies on later versions of sqlite?

We always had issues on network drives as far as I remember, though nobody had the time to actually test each of them and figure out if they are due to SQLite or to our usage of it. I think there are issues with file locking, we should probably apply different file locking strategies based on the fs. Though I'm just arguing.

> Could sqlite be backleveled to test ?

Do you mean downgrade? We can't, cause we use the new features.

Comment 47

[Mike Kaply [:mkaply]]

I'm also seeing issues where CPU usage goes way way up with a profile on a network drive. And then Firefox won't close when I try to close it.

Comment 49

[BugBot [:suhaib / :marco/ :calixte]]

In the process of migrating remaining bugs to the new severity system, the severity for this bug cannot be automatically determined. Please retriage this bug using the new severity system.

Comment 50

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:mak, could you have a look please?

For more information, please visit BugBot documentation.

Comment 51

[Mike Kaply [:mkaply]]

Is it worth keeping this open?