1332395 - Make notebook experimenting with date/datetime/timestamp types

Status: RESOLVED INVALID

(Data Platform and Tools :: General, defect, P3)

Description

[Frank Bertsch [:frank]]

There are a few time types in Presto and Parquet. We should have a notebook experimenting with all of them, casting from string, importing to Presto, etc. This should be reproduceable and readable so we can know which types to use moving forward.

Comment 1

[Rob Miller [:rmiller]]

This is currently in the "Redash (STMO)" component, but AFAICT it doesn't seem to have anything to do with redash, so it's either misfiled or I'm not understanding the issue. Frank, can you help me understand which of these is the case?

Comment 2

[Frank Bertsch [:frank]]

(In reply to Rob Miller [:RaFromBRC :rmiller] from comment #1)
> This is currently in the "Redash (STMO)" component, but AFAICT it doesn't
> seem to have anything to do with redash, so it's either misfiled or I'm not
> understanding the issue. Frank, can you help me understand which of these is
> the case?

The reason this is filed under STMO is largely because that's where a lot of the confusion happens w.r.t. dates, especially because re:dash does it's own casting of dates, and some strings.

I am no sure if we can test that in any sort of reproducible way though. Moving to Presto.

Comment 3

[Rob Miller [:rmiller]]

Ah, gotcha. I just saw that you wanted to create a notebook, and wasn't quite sure how STMO fit into this at all. Thanks for clarifying.

Comment 4

[Anthony Miyaguchi [:amiyaguchi]]

This main_summary time reference sheet might be useful for making the notebook.

https://docs.google.com/spreadsheets/d/1DQk0YQx2PLaY2ZMTdhF2TA-ueZ6g5PWwUqbPWL90AHM

Comment 5

[David Lawrence [:dkl]]

Moving to General.

Comment 6

[Frank Bertsch [:frank]]

Presto is deprecated.