Closed
Bug 1314957
Opened 8 years ago
Closed 8 years ago
Spark clusters should use centralized metastore
Categories
(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)
Cloud Services Graveyard
Metrics: Pipeline
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: rvitillo, Assigned: whd)
References
Details
(Whiteboard: [SvcOps])
User Story
Now that we have a centralized Hive metastore we should configure our Spark clusters to use it so that both Spark & Presto see the same tables.
No description provided.
Comment 1•8 years ago
|
||
hey Blake, I think you are on this, please add effort.
Assignee: nobody → bimsland
Priority: -- → P1
Updated•8 years ago
|
Points: --- → 2
Updated•8 years ago
|
Priority: P1 → P2
Updated•8 years ago
|
Whiteboard: [SvcOps]
Updated•8 years ago
|
Assignee: bimsland → whd
Priority: P2 → P1
Assignee | ||
Comment 2•8 years ago
|
||
https://github.com/mozilla/emr-bootstrap-spark/pull/70
https://github.com/mozilla/emr-bootstrap-spark/pull/72
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Assignee | ||
Comment 3•8 years ago
|
||
Well, this doesn't appear to work with EMR < 5 (spark 2.0), so we're either going to have to migrate everything to later EMR releases or use different configurations to make this happen.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Assignee | ||
Comment 4•8 years ago
|
||
Reapplied now that EMR 4 is dead: https://github.com/mozilla/emr-bootstrap-spark/pull/75
Status: REOPENED → RESOLVED
Closed: 8 years ago → 8 years ago
Resolution: --- → FIXED
Updated•6 years ago
|
Product: Cloud Services → Cloud Services Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•