Closed Bug 1253392 Opened 9 years ago Closed 9 years ago

Enable write access to net-mozaws-prod-metrics-data from Spark scheduled jobs

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Assigned: whd)

References

Details

The normal "Scheduled worker" instances have permission to write to the net-mozaws-prod-metrics-data S3 bucket, but it appears that the scheduled Spark jobs do not. Please add permission for Spark workers to write to that bucket so that Spark jobs can update dashboard data.
Points: --- → 1
Priority: -- → P2
Assignee: nobody → whd
Priority: P2 → P1
Blocks: 1226379
Blocks: 1240849
https://github.com/mozilla/emr-bootstrap-spark/pull/19 This revealed some changes that were made to the IAM role for e.g. s3://telemetry-parquet that are missing from version control, so I'll file a separate PR to rectify that.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
No longer blocks: 1226379
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.