1447013 - Enable parsing of query statements from re:dash metadata

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, enhancement)

Description

[Frank Bertsch [:frank]]

Currently we have the test of the re:dash queries, which is nice for viewing but not necessarily for seeing queries which: touch certain tables, look at certain columns, etc.

Reference: https://sql.telemetry.mozilla.org/queries/52048/source

We have options:
1. Find a way to access the query parser from SQL and parse the statements themselves
2. Add a Postgres extension which hooks into the query parser and allows us to arbitrarily parse them
3. Parse queries _before_ inserting them into the database, and include the parsed JSON output as a separate column

The downside is not all queries are Postgres-like, but most are (see: Presto, Redshift, etc.). This should be good enough.

Comment 1

[Jannis Leidel [:jezdez]]

I've created an issue in our dev repo to track the process of this feature request here: https://github.com/mozilla/redash/issues/381

Given the scope of the feature this would likely not be able to be applied to upstream (given the focus on Postgres-like data sources) but more research would need to be made to fully consider the effort needed.

Comment 2

[:shell escalante]

moving off redash - so not doing new dev on this platform.