693896 - sync: try DELETE /storage some % of the time in grinder

Status: RESOLVED FIXED

(Cloud Services Graveyard :: Server: Sync, defect)

Description

[:Atoll]

Bug 684798 changes the client to use one DELETE /storage request instead of multiple DELETE /storage/{x,y,z} requests, when doing a full data reset.  This may require load tests with a revised grinder worker template. If so, this bug for that. If not, WORKSFORME.

Comment 1

[Pete Fritchman [:petef]]

telliott: how's this look?

    if random.randint(1,100) > 98:
        # delete a random collection here
        # 50% of the time we're in DELETE mode, delete all data
        if random.randint(1, 2) == 1:
            deleteCollectionString = "/%s/%s/storage" % (VERSION, username)
        else:
            collection = random.choice(collections)
            deleteCollectionString = "/%s/%s/storage/%s" % (VERSION, username, collection)

i'd paste a diff, but I need to send you a whole new weave.py to get checked in to the loadtest repo.

Comment 2

[Pete Fritchman [:petef]]

I'm getting a 400 when I do DELETE .../storage.  hmm.

Comment 3

[Philipp von Weitershausen [:philikon]]

(In reply to Pete Fritchman [:petef] from comment #2)
> I'm getting a 400 when I do DELETE .../storage.  hmm.

As per API spec [1] you need to include the 'X-Confirm-Delete' header in the request.

[1] http://docs.services.mozilla.com/storage/apis-1.1.html#apis

Comment 4

[:Atoll]

i believe rfkelly owns this now?

Comment 5

[Ryan Kelly [:rfkelly]]

will do this after the current omg-loadtest-failure craziness on sync stage is over, the last thing we need at the moment is more variables :-)

Comment 6

[Ryan Kelly [:rfkelly]]

Attachment: patch to DELETE all records some portion of the time during loadtest

Comment 7

[Ryan Kelly [:rfkelly]]

http://hg.mozilla.org/services/server-storage/rev/231987bea8e2