1319576 - Create Dashboard for Validation Data in ReDash

Status: RESOLVED DUPLICATE of bug 1374831

(Firefox :: Sync, defect, P1)

Description

[Alex Davis [:adavis]]

Validation data will be landing in ReDash shortly.

This bug is to track the creation of the Dashboards as defined here:
https://mana.mozilla.org/wiki/display/PM/Sync+Data+Integrity

Here is an example of what the query should like if the data lands as planned:
https://sql.telemetry.mozilla.org/queries/1522#2688

Comment 1

[Lina Butler [:lina]]

Alex is unblocked! \o/

Comment 2

[Alex Davis [:adavis]]

Thom, what's the link where you documented the data that landed?

Comment 3

[Thom Chiovoloni [:tcsc] (ex-moco)]

This is the link. https://github.com/mozilla/telemetry-batch-view/blob/master/docs/SyncSummary.md

I'll add it to https://wiki.mozilla.org/CloudServices/Sync/ReDash once I have edit permissions on mozilla wiki (just requested, haven't needed them until now).

Comment 4

[Alex Davis [:adavis]]

Update:
The query is written here but it makes Presto run out of data: https://sql.telemetry.mozilla.org/queries/2527?p_start_date=2017-02-01&p_end_date=2017-02-07

Kit and I are working with Anthony on reformatting the Presto data just of faster validation queries.

Next steps: Kit is creating a parquet notebook with possibly less data for us to test quicker and smaller queries.

Comment 5

[Julie McCracken (:julie)]

Waiting for data to be updated regularly. At that point, we'll close this.

Comment 6

[Julie McCracken (:julie)]

Kit is going to reach out to Anthony who has it running ATMO.