629972 - do one time run of .cvs file with new time since install values

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[chris hofmann]

see https://bugzilla.mozilla.org/show_bug.cgi?id=574711#c13 for more details,  but rhelmer has an update of the script that will give us more insight into the scope of the duplicate problem.

Comment 1

[Robert Helmer [:rhelmer]]

OK I now have results for yesterday. I just imitated the way the cron job does it, with overrides for the local socorro version I am using for this (rev 2901):

"""
$ . /etc/socorro/socorrorc 
$ export PYTHONPATH=./socorro/application/:./socorro/thirdparty/
$ SCRIPT_RUN_DATE=`date -d "1 days ago" '+%Y-%m-%d'`
$ python ./socorro/application/scripts/startDailyUrl.py --day=$SCRIPT_RUN_DATE
"""

This generated two files:

20110130-crashdata.csv.gz      (41 MB)
20110130-pub-crashdata.csv.gz  (31 MB)

These look to have all the columns, and the data looks plausible.

chofmann, where should I put these?

Comment 2

[chris hofmann]

if you rename the files they could go in the standard locations.

maybe just prepend "install-time-test" on the front of the file

install-time-test-20110130-crashdata.csv.gz  -> cm-fs01://data/security_group/crash_urls/

install-time-test-20110130-pub-crashdata.csv.gz -> people.mozilla.org://var/www/html/crash_analysis/"$day"

Comment 3

[Robert Helmer [:rhelmer]]

(In reply to comment #2)
> if you rename the files they could go in the standard locations.
> 
> maybe just prepend "install-time-test" on the front of the file
> 
> install-time-test-20110130-crashdata.csv.gz  ->
> cm-fs01://data/security_group/crash_urls/

Done

 
> install-time-test-20110130-pub-crashdata.csv.gz ->
> people.mozilla.org://var/www/html/crash_analysis/"$day"


Done:
http://people.mozilla.com/crash_analysis/20110130/install-time-test-20110130-pub-crashdata.csv.gz


Please reopen if you see any problems.