1355790 - remove or rename the "main_summary_20161030" table in hive

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect, P1)

Description

[Mark Reid [:mreid]]

This table is now the default table when you SELECT from "main_summary" (presumably since it has the highest version).

The expected default table should be main_summary_v3.


STR:
SELECT COUNT(*) FROM main_summary WHERE submission_date_s3 = '20170410' AND sample_id = '10'
# returns 0

SELECT COUNT(*) FROM main_summary_v3 WHERE submission_date_s3 = '20170410' AND sample_id = '10'
# returns more than 0

Comment 1

[Frank Bertsch [:frank]]

Current tables are fixed. Cron job doesn't include this table, so it doesn't look like it should be a problem. If it comes up again we can take another look.

Comment 2

[Mark Reid [:mreid]]

A table called 'default.main_summary_20161030_v3' is still (or again?) showing up in re:dash and acting as the default "main_summary" table.

Comment 3

[Roberto Agostino Vitillo (:rvitillo)]

Do we know what's causing this?

Comment 4

[Frank Bertsch [:frank]]

(In reply to Roberto Agostino Vitillo (:rvitillo) from comment #3)
> Do we know what's causing this?

Apparently sunahsuh was testing some dataset. We're rerunning right now. I think we should add an option to p2h where it doesn't set the non-versioned table.

Comment 5

[Blake Imsland [:robotblake]]

The table has been deleted.