1590712 - Allow using AWS SES on Databricks

Status: RESOLVED FIXED

(Data Platform and Tools Graveyard :: Operations, task, P1)

Description

[Arkadiusz Komarzewski [:akomar]]

Can we add ses:SendEmail permission to databricks-ec2 IAM role?

:marco needs to send some emails from the notebook he's moving out of ATMO.

Comment 1

[Arkadiusz Komarzewski [:akomar]]

Blake: can you take a look? What are our options here?

Comment 2

[Blake Imsland [:robotblake]]

So I think the best bet is to provision new credentials for this and make them available via databricks secrets. I'll take a look at that and update the bug when I've got a better idea on the scope, should be pretty straight-forward though.

Comment 3

[Marco Castelluccio [:marco]]

Blake, do you have any news?

Comment 4

[Blake Imsland [:robotblake]]

This got lost in the shuffle of the last few weeks, I'll work on this this afternoon.

Comment 5

[Blake Imsland [:robotblake]]

After some delays with sorting out weird SES issues, I've got a working example up and running in databricks.

https://dbc-caf9527b-e073.cloud.databricks.com/#notebook/234791

Feel free to reopen if you run into issues!

Comment 6

[Marco Castelluccio [:marco]]

com.databricks.common.client.DatabricksServiceException: PERMISSION_DENIED: User [e-mail] does not have READ permission on scope data-email to perform this action.

Comment 7

[Blake Imsland [:robotblake]]

Whoops, I'll look at how to broaden the scope of that, sorry for the delay.

Comment 8

[Blake Imsland [:robotblake]]

This should be working now, mind double-checking :marco?

Comment 9

[Marco Castelluccio [:marco]]

Thanks, it worked!