1347229 - Make validate_and_test.py report on keys never seen in crashes

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Peter Bengtsson [:peterbe]]

If you run `python socorro/schemas/validate_and_test.py [url [urls...]]` it will take the JSON schema and test it against every combined crash (combined according to https://github.com/mozilla/socorro/blob/c2ef5e69636f808a958fb9b170ab18b91d3c6d45/socorro/external/boto/crashstorage.py#L338)

But you might have fields in the JSON schema whose type (or sub-structure) never gets tested because the crashes you test against don't contain those fields at all. It might not a reason to raise error but the person running validate_and_test.py should be informed.

Comment 1

[Peter Bengtsson [:peterbe]]

Attachment: Link to Github pull-request: https://github.com/mozilla/socorro/pull/3696

Comment 2

[[github robot]]

Commit pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/449e95d0f56c298710e8444b6a539e4852966b92
fixes bug 1347229 - Make validate_and_test.py report on keys never se… (#3696)

* fixes bug 1347229 - Make validate_and_test.py report on keys never seen in crashes

* less wide

* remove unnecessary assert