If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Set up a weekly load test on Marketplace Stage

RESOLVED FIXED

Status

Cloud Services
Operations: Marketplace
RESOLVED FIXED
5 years ago
3 years ago

People

(Reporter: tarek, Assigned: jason)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

5 years ago
With the load testing tool we have, we should run a weekly load test on market place. I guess we could do it right after we've deployed a new version on stage so we can compare the speed before and after the upgrade.

What's the most convenient way to do this for you ? a cron ? a manual command line ? an API call ? or through the marteau dashboard ?
This makes me think about statsd: we should make marteau able to send a statsd signal to whoever to know that we are starting a loadtest when doing so.
(started https://github.com/mozilla-services/marteau/issues/12 about that)
(Assignee)

Comment 3

5 years ago
I think a manual command line or an API call would work. Ideally we would want to incorporate this into our deploy script [1]. 

Could you point me to documentation?

[1] https://github.com/mozilla/zamboni/blob/master/scripts/update/update.py
(Reporter)

Comment 4

5 years ago
it's here : http://marteau.readthedocs.org/en/latest/index.html

The current "marteau" script is not working anymore though because I've protected the server with Browser-ID for adding new load test jobs.  I am going to add a key-based access for the API call.
(Reporter)

Comment 5

5 years ago
added https://github.com/mozilla-services/marteau/issues/13
(Assignee)

Updated

5 years ago
Assignee: server-ops → jthomas
(Reporter)

Comment 6

5 years ago
The feature is now deployed.

You can connect to http://client11.scl2.svc.mozilla.com:8080/

then visit /profile to get a key

then, to run a load test on the marketplace stage server:

$ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/

 
see http://client11.scl2.svc.mozilla.com:8080/docs/index.html for more info
(Assignee)

Updated

5 years ago
Depends on: 794215
(Assignee)

Comment 7

5 years ago
I receive a 404 when visiting http://client11.scl2.svc.mozilla.com:8080/profile after I have logged in.
(Reporter)

Comment 8

5 years ago
I just realized the client11 was backed up so we were in an older version of the code. It's upgraded now, please try again
(Reporter)

Comment 9

5 years ago
just for the record: Jason is working on adding a big button alongside the big red deploy button in chief - so people will be able to run load tests whenever
(Assignee)

Comment 10

5 years ago
(In reply to Tarek Ziadé (:tarek) from comment #8)
> I just realized the client11 was backed up so we were in an older version of
> the code. It's upgraded now, please try again

Thanks, it looked like that work. 

I attempted to add a test via cli, it looks like it worked but when visiting the test url I see the following error :

"A server error occurred.  Please contact the administrator."

This is what I am running via cli:

(new)[jthomas@addonsadm.private.phx1 marteau]$ marteau https://github.com/mozilla/marketplace-loadtest --server http://client11.scl2.svc.mozilla.com:8080/
2012-10-04 10:15:33 [6171] [INFO] Sending the job to the Marteau server
2012-10-04 10:15:33 [6171] [INFO] Test added at u'http://client11.scl2.svc.mozilla.com:8080/test/7afbd7ccc65248d09ca7357328c537af'
(Reporter)

Comment 11

5 years ago
for the record, jason's issue was fixed (the server was backed up on an older code version)
(Assignee)

Comment 12

5 years ago
You can now run loadtests via chief.

http://addonsadm.private.phx1.mozilla.com/chief/addons.stage/loadtest

I am using distribution list marketplace-loadtest@mozilla.com to run these tests. Right now oremj, tarek and I are only configured to receive mail to this list. If you need me to add additional users let me know.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
Awesome!

Please, add alexis at mozilla.com :-)
(Assignee)

Comment 14

5 years ago
(In reply to Alexis Metaireau (:alexis) from comment #13)
> Awesome!
> 
> Please, add alexis at mozilla.com :-)

Done.
Component: Server Operations: AMO Operations → Operations: Marketplace
Product: mozilla.org → Mozilla Services
You need to log in before you can comment on or make changes to this bug.