Unknown re:dash error for untrusted module ping (HIVE_CANNOT_OPEN_SPLIT)
Categories
(Data Platform and Tools :: General, defect, P2)
Tracking
(Not tracked)
People
(Reporter: jimm, Unassigned)
Details
This started showing up recently, would appreciate some help in understanding what's going wrong.
https://sql.telemetry.mozilla.org/queries/61950/source
Error running query: HIVE_CANNOT_OPEN_SPLIT: Error opening Hive split s3://net-mozaws-prod-us-west-2-pipeline-data/telemetry-untrustedModules-parquet/v2/submission_date_s3=20190313/1552439039_0_ip-172-31-20-140 (offset=0, length=146944): Schema mismatch, metastore schema for row column environment.settings has 14 fields but parquet schema has 13 fields
![]() |
Reporter | |
Comment 1•6 years ago
|
||
adding a limit on submission date of 4/1 helped fixed this.
Comment 2•6 years ago
|
||
Blake, is there something we can do to fix the schema for the files prior to 4/1?
Updated•6 years ago
|
Comment 3•6 years ago
|
||
I think this should work in Presto as it does the pathing differently. For Athena there's not much we can do unfortunately without bumping the version.
Comment 4•5 years ago
|
||
This is no longer relevant in the new pipeline.
Assignee | ||
Updated•3 years ago
|
Description
•