793655 - Set up a weekly load test on Marketplace Stage

Status: RESOLVED FIXED

(Cloud Services :: Operations: Marketplace, task)

Description

[Tarek Ziadé (:tarek)]

With the load testing tool we have, we should run a weekly load test on market place. I guess we could do it right after we've deployed a new version on stage so we can compare the speed before and after the upgrade.

What's the most convenient way to do this for you ? a cron ? a manual command line ? an API call ? or through the marteau dashboard ?

Comment 1

[Alexis Metaireau (:alexis)]

This makes me think about statsd: we should make marteau able to send a statsd signal to whoever to know that we are starting a loadtest when doing so.

Comment 2

[Alexis Metaireau (:alexis)]

(started https://github.com/mozilla-services/marteau/issues/12 about that)

Comment 3

[Jason Thomas [:jason]]

I think a manual command line or an API call would work. Ideally we would want to incorporate this into our deploy script [1]. 

Could you point me to documentation?

[1] https://github.com/mozilla/zamboni/blob/master/scripts/update/update.py

Comment 4

[Tarek Ziadé (:tarek)]

it's here : http://marteau.readthedocs.org/en/latest/index.html

The current "marteau" script is not working anymore though because I've protected the server with Browser-ID for adding new load test jobs.  I am going to add a key-based access for the API call.

Comment 5

[Tarek Ziadé (:tarek)]

added https://github.com/mozilla-services/marteau/issues/13

Comment 6

[Tarek Ziadé (:tarek)]

The feature is now deployed.

You can connect to http://client11.scl2.svc.mozilla.com:8080/

then visit /profile to get a key

then, to run a load test on the marketplace stage server:

$ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/

 
see http://client11.scl2.svc.mozilla.com:8080/docs/index.html for more info

Comment 7

[Jason Thomas [:jason]]

I receive a 404 when visiting http://client11.scl2.svc.mozilla.com:8080/profile after I have logged in.

Comment 8

[Tarek Ziadé (:tarek)]

I just realized the client11 was backed up so we were in an older version of the code. It's upgraded now, please try again

Comment 9

[Tarek Ziadé (:tarek)]

just for the record: Jason is working on adding a big button alongside the big red deploy button in chief - so people will be able to run load tests whenever

Comment 10

[Jason Thomas [:jason]]

(In reply to Tarek Ziadé (:tarek) from comment #8)
> I just realized the client11 was backed up so we were in an older version of
> the code. It's upgraded now, please try again

Thanks, it looked like that work. 

I attempted to add a test via cli, it looks like it worked but when visiting the test url I see the following error :

"A server error occurred.  Please contact the administrator."

This is what I am running via cli:

(new)[[e-mail]1 marteau]$ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/
2012-10-04 10:15:33 [6171] [INFO] Sending the job to the Marteau server
2012-10-04 10:15:33 [6171] [INFO] Test added at u'http://client11.scl2.svc.mozilla.com:8080/test/7afbd7ccc65248d09ca7357328c537af'

Comment 11

[Tarek Ziadé (:tarek)]

for the record, jason's issue was fixed (the server was backed up on an older code version)

Comment 12

[Jason Thomas [:jason]]

You can now run loadtests via chief.

http://addonsadm.private.phx1.mozilla.com/chief/addons.stage/loadtest

I am using distribution list [e-mail] to run these tests. Right now oremj, tarek and I are only configured to receive mail to this list. If you need me to add additional users let me know.

Comment 13

[Alexis Metaireau (:alexis)]

Awesome!

Please, add alexis at mozilla.com :-)

Comment 14

[Jason Thomas [:jason]]

(In reply to Alexis Metaireau (:alexis) from comment #13)
> Awesome!
> 
> Please, add alexis at mozilla.com :-)

Done.