Closed Bug 1201067 Opened 9 years ago Closed 9 years ago

Derived stream for Telemetry data volume

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Unassigned)

References

Details

As part of bug 1171628, I'd like to set up a new stream containing the following:
submissionDate
clientId
appUpdateChannel
docType
appBuildId
payload size

The output in S3 should be partitioned by
submissionDate
docType (allowed_values = ["main", "saved-session"], so that misc. are bucketed into "OTHER")

The retention period for this data can be quite short - a week or so should be plenty.
Blocks: 1188933
Add a derived budget stream: https://github.com/mozilla-services/data-pipeline/pull/124
Store "payload_size" stream in S3: https://github.com/mozilla-services/puppet-config/pull/1545

whd, can you resolve this when the above changes have been deployed?
Flags: needinfo?(whd)
Priority: -- → P2
This has been deployed. Of note, because this stream is generated with a filter and not a decoder, we had to change the message matchers, see: https://github.com/mozilla-services/puppet-config/commit/50968b7ccd58475ac3e97f4c995bb86ad5cab17b
Status: NEW → RESOLVED
Closed: 9 years ago
Flags: needinfo?(whd)
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.