Closed Bug 1126471 Opened 11 years ago Closed 11 years ago

Create a Heka input plugin for reading data from S3

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Assigned: mreid)

References

Details

This is basically the inverse of the S3SplitFileOutput plugin which writes partitioned data to S3: https://github.com/mozilla-services/data-pipeline/blob/master/heka/plugins/s3splitfile/s3splitfile_output.go The input should accept a "schema" file which acts as a filter to determine which files are read, then fetches each file and sends its contents through the pipeline.
Assignee: nobody → mreid
Blocks: 1129179
Comments from bug triage: - Functionality is there, cleaned up and made part of the build/repo
Status: NEW → ASSIGNED
Status: ASSIGNED → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.