1475223 - Error querying telemetry_core_parquet for 20180710

Status: VERIFIED FIXED

(Data Platform and Tools :: General, defect)

Description

[Mark Reid [:mreid]]

Attachment: pasted_image_at_2018_07_11_03_26_pm.png

Reported by @loines on Slack:

When querying the telemetry_core_parquet table for 20180710, the following error is returned:

Error running query: HIVE_CANNOT_OPEN_SPLIT: Error opening Hive split s3://net-mozaws-prod-us-west-2-pipeline-data/telemetry-core-parquet/v3/submission_date_s3=20180710/app_name=FirefoxReality_googlevr/os=Android/1531258732_ip-172-31-5-116 (offset=0, length=4): s3://net-mozaws-prod-us-west-2-pipeline-data/telemetry-core-parquet/v3/submission_date_s3=20180710/app_name=FirefoxReality_googlevr/os=Android/1531258732_ip-172-31-5-116 is not a valid Parquet File


See attached screenshot for a query to reproduce (I tried it and get the same results).

Comment 1

[Mark Reid [:mreid]]

That file on S3 is only 4 bytes long, so it seems the error message is correct.

Comment 2

[Jason Thomas [:jason]]

The file only contained "PAR1" and mreid asked me to delete it.

delete: s3://net-mozaws-prod-us-west-2-pipeline-data/telemetry-core-parquet/v3/submission_date_s3=20180710/app_name=FirefoxReality_googlevr/os=Android/1531258732_ip-172-31-5-116

Can you please try again?

Comment 3

[Mark Reid [:mreid]]

It works now, thanks Jason!