873191 - Create a bulk export dump

Status: RESOLVED FIXED

(Marketplace Graveyard :: API, defect, P1)

Description

[Wil Clouser [:clouserw]]

In bug 873190 we documented how to do a bulk export dump of our Marketplace data.  I'm marking this bug dependent on that one because I think this is one of the scenarios where writing docs first will be beneficial (obviously we can update them as we go too).

This bus is about delivering the actual json file onto disk.  We can follow up with IT afterwards to compress it and figure out a place where it can be accessed.

Since this is essentially another "view" into the data tests will be good here since people probably won't be thinking about this script much once it's finished.

Comment 1

[Andy McKay]

Presumably we'll need to do some filtering here of apps, for a first pass, should we assume only public apps?

Comment 2

[Wil Clouser [:clouserw]]

(In reply to Andy McKay [:andym] from comment #1)
> Presumably we'll need to do some filtering here of apps, for a first pass,
> should we assume only public apps?

sounds reasonable

Comment 3

[Andy McKay]

https://github.com/mozilla/zamboni/commit/7a11ed

Things to do:
- add in cron to generate
- whitelist in the resulting file to serve it out

Comment 4

[Andy McKay]

https://github.com/mozilla/zamboni/commit/7b9196

And bug 875486 added.