872223 - Create middleware service for data_dictionary table

Status: RESOLVED FIXED

(Socorro Graveyard :: Middleware, defect, P1)

Description

[Selena Deckelmann :selenamarie :selena]

I'd like a middleware service that provides JSON to the front end, based on the data in the table data_dictionary, whose columns are: 

* raw_field: the breakpad variable in meta_data (HBase)
* product: currently NULL, but important and interesting for differentiating between things like Fennec and B2G
* transforms: a JSON blob that has keys and sometimes values that explain how a raw_field is transformed and also where it is transformed

Comment 1

[[DEACTIVATED] Adrian Gaudebert]

Selena, do you want me to work on that?

Comment 2

[Selena Deckelmann :selenamarie :selena]

(In reply to Adrian Gaudebert [:adrian] from comment #1)
> Selena, do you want me to work on that?

That would be awesome! :)

Comment 3

[[DEACTIVATED] Adrian Gaudebert]

Hey Selena, can you provide a short example of what the data looks like? Do you want the service to return exactly what the database has or should it perform some kind of transformation?

Comment 4

[Selena Deckelmann :selenamarie :selena]

Attachment: Screenshot of existing data dictionary in a spreadsheet

Here's a screenshot of the existing spreadsheet that holds this data. 

I think just passing the whole JSON to the front-end is sufficient for now. As you can see from the spreadsheet, many columns have no information in them and it isn't easy to predict which columns will or won't be populated. 

Perhaps the best thing for the middleware to do is provide only those keys which have a value specified to the requestor.

Comment 5

[[DEACTIVATED] Adrian Gaudebert]

Pull request: https://github.com/mozilla/socorro/pull/1284

Comment 6

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/603cbbb497f26f853f70bab560cc41f8dd0f1375
Fixes bug 872223 - Added a field service to return data_dictionary information. r=peterbe

https://github.com/mozilla/socorro/commit/840dad1bb3e335e2fadc263597ee9f22f38b20a9
Merge pull request #1284 from AdrianGaudebert/872223-fields-service

Fixes bug 872223 - Added a field service to return data_dictionary infor...