1566941 - Moz-fx-data-derived-datasets GCP First Shutdown table missing data for Jun 11, 12, 13, 27

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect, P1)

Description

[George Kaberere [:gkaberere]]

The moz-fx-data-derived-datasets.telemetry.first_shutdown_summary_v4 in GCP is missing data for some days in June (11, 12, 13, 27).

Can replicate if you run the following query:

SELECT submission_date_s3, COUNT(*) FROM ``moz-fx-data-derived-datasets.telemetry.first_shutdown_summary_v4`` WHERE submission_date_s3 IN ("2019-06-09", "2019-06-10","2019-06-11","2019-06-12","2019-06-13","2019-06-14","2019-06-26", "2019-06-27", "2019-06-28") GROUP BY 1 ORDER BY 1

You'll see counts for the days before and after the missing days.

Comment 1

[Anthony Miyaguchi [:amiyaguchi]]

These look like they relate to real job failures from timeouts that haven't been addressed. I can take a look at rerunning the original processing job.

Comment 2

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/telemetry-airflow/pull/549

Comment 3

[Anthony Miyaguchi [:amiyaguchi]]

The job has been backfilled and the test query returns non-zero results now. The processing job has been modified so it won't timeout.