788055 - [socorro-crashstats] implement CSV output

Status: RESOLVED FIXED

(Socorro :: Webapp, task)

Description

[Robert Helmer [:rhelmer]]

Used by:

topcrashers ( e.g. https://crash-stats.mozilla.com/topcrasher/byversion/Firefox/16.0a1/7?format=csv )

crashes per user ( e.g. https://crash-stats.mozilla.com/daily?p=Firefox&v[]=16.0a1&throttle[]=100&os[]=Windows&os[]=Mac&os[]=Linux&date_start=2012-06-25&date_end=2012-07-09&form_selection=by_version&csv=1&hang_type=any )

Comment 1

[Robert Helmer [:rhelmer]]

Our needs are probably simple enough for this:

https://docs.djangoproject.com/en/dev/howto/outputting-csv/

Comment 2

[Robert Helmer [:rhelmer]]

There is some work done on this:
https://github.com/mozilla/socorro-crashstats/pull/57

Comment 3

[Peter Bengtsson [:peterbe]]

Partial PR for the topcrashers
https://github.com/mozilla/socorro-crashstats/pull/100

Comment 4

[[:jberkus] Josh Berkus]

Peter,

If we run into performance issues, Postgres can also generate CSV from a query. The reason I bring this up is that the Django CSV stuff is, in my experience, very slow and CPU-intensive.  Try the Django way first, of course.

Comment 5

[Robert Helmer [:rhelmer]]

(In reply to [:jberkus] Josh Berkus from comment #4)
> Peter,
> 
> If we run into performance issues, Postgres can also generate CSV from a
> query. The reason I bring this up is that the Django CSV stuff is, in my
> experience, very slow and CPU-intensive.  Try the Django way first, of
> course.

Good point, however our django UI does not talk to postgres (except for session), it would be the middleware doing this.

Currently the middleware does a query and returns JSON, and the views implemented in Django decide whether to render that to HTML, CSV, RSS, etc.

Comment 6

[Robert Helmer [:rhelmer]]

(In reply to Peter Bengtsson [:peterbe] from comment #3)
> Partial PR for the topcrashers
> https://github.com/mozilla/socorro-crashstats/pull/100

Why is the PR closed?

Comment 7

[Peter Bengtsson [:peterbe]]

(In reply to Robert Helmer [:rhelmer] from comment #6)
> (In reply to Peter Bengtsson [:peterbe] from comment #3)
> > Partial PR for the topcrashers
> > https://github.com/mozilla/socorro-crashstats/pull/100
> 
> Why is the PR closed?

That's a "bug" in github. There is a reference to another PR in there which is closed. The #100 is still open.

Comment 8

[Peter Bengtsson [:peterbe]]

The CSV output for Top Crashers has landed
https://github.com/mozilla/socorro-crashstats/commit/fea4b783b148c3f86137a5914419ea5280e2d586

Now Just waiting for the Top Crashers By User report to do the second part.

Comment 9

[Peter Bengtsson [:peterbe]]

PR for the daily report: 
https://github.com/mozilla/socorro-crashstats/pull/155

Comment 10

[[github robot]]

Commit pushed to master at https://github.com/mozilla/socorro-crashstats

https://github.com/mozilla/socorro-crashstats/commit/821cebc048bff72b9417cfa148e40ba1b3c103a0
bug 788055 - csv format output on the /daily report, r=rhelmer