If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Spark bootstrap script should import most of the derived Parquet datasets into Hive metastore

RESOLVED WONTFIX

Status

Cloud Services
Metrics: Pipeline
P2
normal
RESOLVED WONTFIX
a year ago
a year ago

People

(Reporter: mdoglio, Assigned: mdoglio)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(1 attachment)

(Assignee)

Description

a year ago
As in bug 1251756 we want to make it easier to access the derived datasets from spark.

Comment 1

a year ago
Created attachment 8780112 [details] [review]
[emr-bootstrap-spark] mozilla:bug-1294436-derived-datasets-emr-bootstrap > mozilla:master
This will considerably slow down the bootstrap process of Spark clusters. We will be addressing this issue with the centralized Hive metastore so I am inclined to close this for now, if you are OK with that.
(Assignee)

Comment 3

a year ago
Yeah I thought it could slow down things but I didn't know if that was acceptable or not. Feel free to to close the PR.
(Assignee)

Updated

a year ago
Status: ASSIGNED → RESOLVED
Last Resolved: a year ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.