1622976 - [docs] document socorro -> telemetry flow

Status: RESOLVED FIXED

(Socorro :: General, task, P2)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

The Socorro processor saves processed crash data to several locations one of which is an AWS S3 bucket destined for Telemetry. After it saves the processed crash report, I don't really know what happens.

This bug covers documenting:

1. the bits in Socorro that are involved
2. the bits in Telemetry that ingest that crash report data
3. documentation for the socorro_crash data set
4. caveats (crash data in socorro_crash doesn't get updated when Socorro reprocesses, etc)
5. how to add fields, make changes, etc

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

This has come up a few times and would be really helpful to have as projects need changes in the socorro_crash data set.

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

The docs for the socorro_crash data set and how it's imported are here:

https://docs-origin.telemetry.mozilla.org/datasets/other/socorro_crash/reference.html

I need to talk to someone about how we add fields. Can we just change the schema in Socorro? Are there other steps? Do we need to fill out a data collection request or make sure one exists for that field?

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

Attachment: pr 5302: bug 1622976: first pass at socorro -> telemetry docs

Comment 4

[Will Kahn-Greene [:willkg] ET needinfo? me]

willkg merged PR #5302: "bug 1622976: first pass at socorro -> telemetry docs" in 028234a.

Comment 5

[Will Kahn-Greene [:willkg] ET needinfo? me]

I verified that the docs look ok on RTD. Marking as FIXED.

Comment 6

[Will Kahn-Greene [:willkg] ET needinfo? me]

Attachment: pr 5338: bug 1622976: clarify that fields to add should be documented

Comment 7

[Will Kahn-Greene [:willkg] ET needinfo? me]

willkg merged PR #5338: "bug 1622976: clarify that fields to add should be documented" in a095a4f.