1149757 - Provide pipeline architecture overview documentation

Status: RESOLVED FIXED

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Description

[Katie Parlante]

We discussed this in standup, logging a bug to make sure we track it.

Here's a diagram whd and I worked out that might be helpful: https://mana.mozilla.org/wiki/display/CLOUDSERVICES/V2+Data+Pipeline

I'm happy to make edits and/or move to a different format (google docs?).

Comment 1

[Rob Miller [:rmiller]]

Updating this bug and taking it over. Documentation will be informed by / based on the current pipeline overview presentation that I gave at the recent data program / measurement team work week.

Comment 2

[Thomas Huelbert]

Hey Rob, should this still be a P1?

Comment 3

[Rob Miller [:rmiller]]

Initial draft of this documentation is complete, is visible to all Mozilla folks at https://docs.google.com/document/d/1o65VLdk9jrV1_QlklT4HduC6IkLjO9OkT9NYW_gfZWo. We don't yet know what the long term home for this document will be. I've created a meta bug (bug 1289173) for tracking the larger process of determining and providing a home for this and all of our documentation efforts.

Comment 4

[Rob Miller [:rmiller]]

Blocked on bug 1303413, which I've added to the blockers list.

Comment 5

[Mark Reid [:mreid]]

Closing this as we now have the overview Rob linked in comment 3, and this one from Roberto's blog post:
https://robertovitillo.com/2017/01/23/an-overview-of-mozillas-data-pipeline/