868188 - UI for looking at data_dictionary

Status: RESOLVED FIXED

(Socorro :: Webapp, task)

Description

[Selena Deckelmann :selenamarie :selena]

I'd love a way to have a look at data_dictionary, which contains information about transformations of data from breakpad variables to various parts of Socorro.

We have three columns: 

* raw_field: the breakpad variable in meta_data (HBase)
* product: currently NULL, but important and interesting for differentiating between things like Fennec and B2G
* transforms: a JSON blob that has keys and sometimes values that explain how a raw_field is transformed and also where it is transformed

Comment 1

[Peter Bengtsson [:peterbe]]

I don't know what `data_dictionary` is. Is it a database table?

Guessing that it is a table, to get this UI we'd need to write an implementation, a middleware and some place to show the data. 

Would it work if I build a page on the Admin pages of socorro-crashstats?

Comment 2

[Selena Deckelmann :selenamarie :selena]

(In reply to Peter Bengtsson [:peterbe] from comment #1)
> I don't know what `data_dictionary` is. Is it a database table?

Yes! It is a database table.

It contains information about how data is transformed from a raw metadata crash field, into something that is inserted into PostgreSQL. The JSON comes from a spreadsheet that Lars put together a while ago. I was hoping to create this interface to keep track of new fields (currently very difficult), and encourage people to keep sane variable names.

> Guessing that it is a table, to get this UI we'd need to write an
> implementation, a middleware and some place to show the data. 

I'll make a ticket for the middleware.

> Would it work if I build a page on the Admin pages of socorro-crashstats?

Yes, that would be ideal.

Comment 3

[Selena Deckelmann :selenamarie :selena]

Attachment: Screen shot of existing data dictionary spreadsheet

Comment 4

[Peter Bengtsson [:peterbe]]

PR here: https://github.com/mozilla/socorro-crashstats/pull/373

:selena it looks like this: http://cl.ly/Pbhw

Comment 5

[Peter Bengtsson [:peterbe]]

Note-to-self: Here are some sample keys you can use in dev https://gist.github.com/selenamarie/17440b314f380ecf1647

Comment 6

[[github robot]]

Commit pushed to master at https://github.com/mozilla/socorro-crashstats

https://github.com/mozilla/socorro-crashstats/commit/20d38bddfbefffeb97b5c40ebcae9e207e26a5b8
fixes bug 868188 - UI for looking at data_dictionary, r=AdrianGaudebert