Closed Bug 1252826 Opened 8 years ago Closed 8 years ago

Support _SUCCESS files in parquet2hive

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rvitillo, Assigned: frank)

References

Details

parquet2hive should ignore a partition that doesn't contain a _SUCCESS file to avoid importing partial data into the Hive metastore.
Depends on: 1252827
Depends on: 1252828
Points: --- → 1
Priority: -- → P3
Blocks: 1255752
No longer blocks: 1251580
Ideally we would want to enable this functionality with an option.
Assignee: nobody → fbertsch
Priority: P3 → P2
Now supports this functionality with a --success-only (-so) flag.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.