Closed Bug 1294436 Opened 8 years ago Closed 8 years ago

Spark bootstrap script should import most of the derived Parquet datasets into Hive metastore

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: mdoglio, Assigned: mdoglio)

Details

Attachments

(1 file)

[emr-bootstrap-spark] mozilla:bug-1294436-derived-datasets-emr-bootstrap > mozilla:master
54 bytes, text/x-github-pull-request
Details | Review 
As in bug 1251756 we want to make it easier to access the derived datasets from spark.
This will considerably slow down the bootstrap process of Spark clusters. We will be addressing this issue with the centralized Hive metastore so I am inclined to close this for now, if you are OK with that.
Yeah I thought it could slow down things but I didn't know if that was acceptable or not. Feel free to to close the PR.
Status: ASSIGNED → RESOLVED
Closed: 8 years ago
Resolution: --- → WONTFIX
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: