1550767 - Smoke-test FFTV pipeline schema

Status: RESOLVED FIXED

(Data Platform and Tools :: Glean: SDK, task, P1)

Description

[Travis Long [:travis_]]

The pipeline schema added in this PR should be validated to ensure it accepts Glean data from FFTV once it is deployed.

Comment 1

[Travis Long [:travis_]]

According to the FFTV team, the release containing Glean has been pushed back:

AshleyT   [11 minutes ago]
Hi Travis! We initially planned to release this week, however, we had some concerns over quality of the changes so we had to hold back. That means staged rollout will start June 10th and we should be at 100% by June 12th

Comment 2

[Alessio Placitelli [:Dexter]]

Travis, is this blocked on something? Can't we get a sample FFTV ping manually?

Comment 3

[Travis Long [:travis_]]

Dexter, it's not blocked. The schema and everything has been deployed and there may likely be pings there from development and testing. I just haven't had time to come back around to this. We will have live data on the 11th that we can view as well (I think).

Comment 4

[Alessio Placitelli [:Dexter]]

(In reply to Travis Long from comment #3)

Dexter, it's not blocked. The schema and everything has been deployed and there may likely be pings there from development and testing. I just haven't had time to come back around to this. We will have live data on the 11th that we can view as well (I think).

But do we need to do this before we go live? I mean, what's the purpose of this bug? Do we want to catch any schema validation problem before FFTV goes live or just make sure that nothing weird happens when we go live?

Comment 5

[Travis Long [:travis_]]

It was mostly a sanity check to ensure we are collecting data when we go live so we could react if there were any issues so we don't delay the analysis.

Comment 6

[Alessio Placitelli [:Dexter]]

(In reply to Travis Long from comment #5)

It was mostly a sanity check to ensure we are collecting data when we go live so we could react if there were any issues so we don't delay the analysis.

Perfect, thank you for clarifying. I think this should not block Fenix MVP nor be a P1 anymore then :)

Comment 7

[Travis Long [:travis_]]

Here, I went ahead and tested this. Looks like we are getting data into re-dash from their latest builds. I'm satisfied we are collecting data. https://sql.telemetry.mozilla.org/queries/63117/source

https://cep.hindsight.prod.dataops.mozgcp.net/dashboard_output/analysis.dl.dt_org_mozilla_tv_firefox_baseline.summary.tsv
https://cep.hindsight.prod.dataops.mozgcp.net/dashboard_output/analysis.dl.dt_org_mozilla_tv_firefox_baseline.captures.json