477505 - Sync fails even though it claims it's successful

Status: RESOLVED INVALID

(Cloud Services :: General, defect)

Description

[henrik]

User-Agent:       Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b3pre) Gecko/20090208 Shiretoko/3.1b3pre
Build Identifier: 0.2.99

Syncing hasn't worked properly since I upgraded to the 0.3.


Reproducible: Always

Steps to Reproduce:
- Deleted the server data
- Performed a full sync on computer A
- Performed a full sync on computer B

Actual Results:  
Computer B did not get A's changes.


Expected Results:  
Computer B should have gotten A's changes.

See attachment (coming up)

Comment 1

[henrik]

Attachment: Debug log from computer B

Comment 2

[henrik]

This seems to be the same bug as bug #473037

Comment 3

[Dan Mills [:thunder]]

What makes you think this is the same as bug 473037?  They look pretty different to me.

Your bug, I suspect, is caused by the number of bookmarks you have:

2009-02-06 08:09:24	Engine.Bookmarks	INFO	Uploading 36373 records + 331 index/depth records)

36 thousand bookmarks is certainly well above what we've ever tested with.  It looks like the return value from the server can't be interpreted as json.  Either that many bookmarks causes the server to return an error somehow, or maybe the response (which contains every added id) doesn't fit into some buffer, I don't know.

Can you reproduce your problem with fewer bookmarks?

Comment 4

[henrik]

Weird.  I haven't got 36K bookmarks, more like 1769:

$ wc -l bookmarks.html 
    1769 bookmarks.html

I have ~50 rss feeds in there, could that have an impact?

Comment 5

[henrik]

Just to clearify: The bookmarks.html is from Firefox' bookmarks exporter.

Comment 6

[Dan Mills [:thunder]]

bookmarks.html no longer holds your bookmarks, so clearly something went wrong at some point (possibly because of Weave?) and you have all those bookmarks now.

50 rss feeds would've definitely caused a lot of extra bookmark churn.  The bug that caused that has been fixed, but at this point you have to clean up your places db + delete everything on the server...

Comment 7

[Dan Mills [:thunder]]

Oh, that's a freshly exported bookmarks.html?  Hmm, interesting.  Well, I'm guessing something is broken inside your places db, then!

Comment 8

[henrik]

OK, I deleted the server data and places.sqlite (and the firefox and weave json backups) and re-imported the freshly exported bookmarks.html.  Now only 1340 records are uploaded, and things generally look much better.  I'll verify the sync when I get to work tomorrow.

I've upgraded weave frequently since the very first release, I guess it's been too much for my places db.

Comment 9

[Dan Mills [:thunder]]

Thanks for testing so quickly.  I'm going to close this bug as invalid on the basis that we won't support 36K bookmarks (not at this stage in the game, anyway).

Please do open new bugs for any problems you see going forward.