Closed Bug 1254322 Opened 9 years ago Closed 8 years ago

Chunk Sync app logs in S3

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INVALID

People

(Reporter: dcoates, Assigned: whd)

References

Details

(Whiteboard: [SvcOps] [sync-metrics])

For ETL and loading into redshift its better to have many smaller files. Around 400MB before compression is a good size. I don't know the prefix structure the current files follow. It would be ideal if we could do something like https://github.com/awslabs/aws-lambda-redshift-loader#hive-partitioning-style-wildcards
Assignee: nobody → whd
Points: --- → 1
Priority: -- → P1
Due to e10s work, could not get get to it in this sprint. Not sure about when this will be addressed, hence dropping to a P2 (P1 means current sprint).
Priority: P1 → P2
Whiteboard: [SvcOps]
Whiteboard: [SvcOps] → [SvcOps] [sync-metrics]
superseded by bug 1291340
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → INVALID
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.