1156254 - Grant Spark cluster instances access to SimpleDB.

Status: RESOLVED FIXED

(Cloud Services Graveyard :: Metrics: Pipeline, defect)

Description

[Roberto Agostino Vitillo (:rvitillo)]

As we decided to switch from a Postgres S3 index to one backed by SimpleDB, we would like to grant Spark clusters read+list access to SimpleDB domains. The current role for Spark clusters is "telemetry-spark-emr" in moz-svc-dev IAM. Wesley, could you please add the required permissions to the role?

Comment 1

[Mark Reid [:mreid]]

Note that Bug 1134217 is for indexing the new pipeline data in S3, not the telemetry-published-v2 data in moz-svc-dev.

Comment 2

[Roberto Agostino Vitillo (:rvitillo)]

Right, but the index for the new pipeline data is going to reside on SimpleDB as well.

Comment 3

[Mark Reid [:mreid]]

Ok good, just making sure.

Comment 4

[Wesley Dawson [:whd]]

We're going to need to discuss migrating telemetry out of old dev again if we continue to require creating / maintaining new resources for it. But for now, to unblock this work, the following entry has been added to the policy: '{"Effect": "Allow","Action": "sdb:*","Resource": "*"}'.

Comment 5

[Roberto Agostino Vitillo (:rvitillo)]

The plan is to move our telemetry infrastructure to the new pipeline/IAM asap.