With the load testing tool we have, we should run a weekly load test on market place. I guess we could do it right after we've deployed a new version on stage so we can compare the speed before and after the upgrade. What's the most convenient way to do this for you ? a cron ? a manual command line ? an API call ? or through the marteau dashboard ?
This makes me think about statsd: we should make marteau able to send a statsd signal to whoever to know that we are starting a loadtest when doing so.
(started https://github.com/mozilla-services/marteau/issues/12 about that)
I think a manual command line or an API call would work. Ideally we would want to incorporate this into our deploy script . Could you point me to documentation?  https://github.com/mozilla/zamboni/blob/master/scripts/update/update.py
it's here : http://marteau.readthedocs.org/en/latest/index.html The current "marteau" script is not working anymore though because I've protected the server with Browser-ID for adding new load test jobs. I am going to add a key-based access for the API call.
The feature is now deployed. You can connect to http://client11.scl2.svc.mozilla.com:8080/ then visit /profile to get a key then, to run a load test on the marketplace stage server: $ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/ see http://client11.scl2.svc.mozilla.com:8080/docs/index.html for more info
I receive a 404 when visiting http://client11.scl2.svc.mozilla.com:8080/profile after I have logged in.
I just realized the client11 was backed up so we were in an older version of the code. It's upgraded now, please try again
just for the record: Jason is working on adding a big button alongside the big red deploy button in chief - so people will be able to run load tests whenever
(In reply to Tarek Ziadé (:tarek) from comment #8) > I just realized the client11 was backed up so we were in an older version of > the code. It's upgraded now, please try again Thanks, it looked like that work. I attempted to add a test via cli, it looks like it worked but when visiting the test url I see the following error : "A server error occurred. Please contact the administrator." This is what I am running via cli: (new)[firstname.lastname@example.org marteau]$ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/ 2012-10-04 10:15:33  [INFO] Sending the job to the Marteau server 2012-10-04 10:15:33  [INFO] Test added at u'http://client11.scl2.svc.mozilla.com:8080/test/7afbd7ccc65248d09ca7357328c537af'
for the record, jason's issue was fixed (the server was backed up on an older code version)
You can now run loadtests via chief. http://addonsadm.private.phx1.mozilla.com/chief/addons.stage/loadtest I am using distribution list email@example.com to run these tests. Right now oremj, tarek and I are only configured to receive mail to this list. If you need me to add additional users let me know.
Awesome! Please, add alexis at mozilla.com :-)
(In reply to Alexis Metaireau (:alexis) from comment #13) > Awesome! > > Please, add alexis at mozilla.com :-) Done.