Closed
Bug 1349565
Opened 8 years ago
Closed 8 years ago
Investigate and reduce EMR cluster bootstrap time
Categories
(Data Platform and Tools :: General, enhancement, P1)
Data Platform and Tools
General
Tracking
(Not tracked)
RESOLVED
INVALID
People
(Reporter: jason, Assigned: jason)
Details
(Whiteboard: [SvcOps])
Currently EMR cluster bootstrap for spark takes upwards of 30 minutes (or more) to complete. Investigate why it takes so long and make improvements to reduce time. https://github.com/mozilla/emr-bootstrap-spark
|
Assignee | |
Updated•8 years ago
|
Points: --- → 3
|
|
Assignee | |
Updated•8 years ago
|
Assignee: nobody → jthomas
Priority: -- → P1
|
|
Assignee | |
Updated•8 years ago
|
Component: Metrics: Pipeline → Spark
Product: Cloud Services → Data Platform and Tools
|
|
Assignee | |
Comment 1•8 years ago
|
||
We are investigating using databricks here instead.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → INVALID
|
||
Updated•3 years ago
|
Component: Spark → General
You need to log in
before you can comment on or make changes to this bug.
Description
•