507429 - Partial sync download support

Status: RESOLVED FIXED

(Firefox :: Sync, defect, P1)

Description

[Dan Mills [:thunder]]

We should have the ability to download/upload data in chunks, instead of all at once.

Comment 1

[Ed Lee :Mardak]

http://hg.mozilla.org/users/edward.lee_engineering.uiuc.edu/weave-partial-view/rev/8d2a0e5f8af5
Only fetch a limited number of items on first/update syncs and if we get the same number, ask the server for the ids to fetch later. Also on every download, process some of the backlog and save the list of GUIDs to disk as json for cross-session support.

Comment 2

[Ed Lee :Mardak]

Attachment: super diff

Comment 3

[Dan Mills [:thunder]]

This looks good so far.  I think you should land and open bugs for followup items, including:

* bubbling up statistics to the service, so we can better inform the user.
* making some of the constants more configurable, possibly per-engine: how many items to sync each time (300+150 atm), whether to eventually sync all items, etc.

we already have a standing bug for sync tests, so no need for an extra bug for that.

Comment 4

[Ed Lee :Mardak]

http://hg.mozilla.org/labs/weave/pushloghtml?changeset=ef5a74f7acdb

Comment 5

[Tony Chung [:tchung]]

flagging in-testsuite? for unit test?