Closed
Bug 622311
Opened 14 years ago
Closed 14 years ago
Socorro - make new submitter for load testing
Categories
(Socorro :: General, task)
Tracking
(Not tracked)
RESOLVED
FIXED
1.7.6
People
(Reporter: lars, Assigned: lars)
References
Details
Created a more sophisticated submitter.py. This one is in scripts and will eventually replace the one in .../socorro/collector. For now, I'm leaving that one in place. New options: -s, --delay pause between submission queing in milliseconds (default: 1) -D, --dryrun don't actually submit, just print product/version -N, --numberOfSubmissions the number items to submit (all, forever, 1...) (default: all) -n, --numberOfThreads the number of threads (default: 4) the --numberOfSubmissions option allows the submitter to get a specific number of crashes from the source (specified by --search or -s), or loop through a search over and over. The default behavior is to just submit all the crashes found in a search (this mimics the behavior of the old submitter). Also includes some rudimentary statistics. After one minute, it starts to print the average number of submissions attempted per minute over the last five minutes. This app is BETA. There are known defects: * the --numberOfSubmissions option: all and forever work fine, integers do not. * khan seems to have a defective pycurl module for python26. Actual submissions are not tested. * stats don't settle down until after five minutes of running.
Assignee | ||
Updated•14 years ago
|
Assignee: nobody → lars
Severity: normal → critical
Target Milestone: --- → 1.7.6
Assignee | ||
Comment 1•14 years ago
|
||
examples of use: python26 .../scripts/submitter.py -N forever -s ~lars/breakpad17/testData/500 this will loop through the 500 crashes in my testData directory over and over forever. It will submit as fast as it can. It will only stop with ^C, SIGTERM or SIGKILL python26 .../scripts/submitter.py --delay=200 -N all -s ~lars/breakpad17/testData/1013 this will loop through the 1013 crashes in one of my testData directories. It will submit only 5 per second.
Assignee | ||
Comment 2•14 years ago
|
||
enhancements and corrections are now checked in. * minor modification to the command line parameters * all features of --numberOfSubmissions now work * integrated into the syslog and config system - submitterconfig.py.dist * working components moved into the .../socorro/collector/submitter module * original submitter still intact ** pycurl for python26 is still broken on khan. It works on my workstation at home. we'll modify this app on the fly as our actual needs become more known. (py26)[lars@khan scripts]$ python submitter.py --help submitter 2.0 --delay pause between submission queing in milliseconds (default: 0) -D, --dryrun don't actually submit, just print product/version (default: False) -d, --dumpfile the pathname of a dumpfile to submit (default: None) -?, --help print this list -j, --jsonfile the pathname of a json file to submit (default: None) -n, --numberOfSubmissions the number of crashes to submit (all, forever, 1...) (default: all) --numberOfThreads the number of threads to use (default: 4) -s, --searchRoot a filesystem location to begin a search for json/dump pairs (default: None) --stderrErrorLoggingLevel logging level for the logging to stderr (10 - DEBUG, 20 - INFO, 30 - WARNING, 40 - ERROR, 50 - CRITICAL) (default: 10) --stderrLineFormatString python logging system format for logging to stderr (default: %(asctime)s %(levelname)s - %(threadName)s - %(message)s) --syslogErrorLoggingLevel logging level for the log file (10 - DEBUG, 20 - INFO, 30 - WARNING, 40 - ERROR, 50 - CRITICAL) (default: 10) --syslogFacilityString syslog facility string ("user", "local0", etc) (default: user) --syslogHost syslog hostname (default: localhost) --syslogLineFormatString python logging system format for syslog entries (default: Socorro Submitter (pid %(process)d): %(asctime)s %(levelname)s - %(threadName)s - %(message)s) --syslogPort syslog port (default: 514) --uniqueHangId cache and uniquify hangids (default: True) -u, --url The url of the server to load test (default: https://crash-reports.stage.mozilla.com/submit)
Assignee | ||
Updated•14 years ago
|
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Updated•13 years ago
|
Component: Socorro → General
Product: Webtools → Socorro
You need to log in
before you can comment on or make changes to this bug.
Description
•