1843523 - Telemetry for nightly 117 not showing up on telemetry.mozilla.org

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Jon Coppeard (:jonco)]

I'm trying to see some recent telemetry but there's no option to select nightly 117 and no data showing up since 2nd July:

https://telemetry.mozilla.org/new-pipeline/evo.html#!aggregates=Median&cumulative=0&end_date=2023-07-02&include_spill=0&keys=!__none__!__none__&max_channel_version=nightly%252F116&measure=GC_MINOR_US&min_channel_version=nightly%252F116&processType=*&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2023-06-05&trim=1&use_submission_date=0

Comment 1

[Eduardo Filho [:efilho]]

Multiple ETL runs got stuck in running due to an extract step failure on June 16 2023, and since July 2 2013 there hasn't been any new executions (probably due to a max number of concurrent executions). Since the extract step of the DAG is not relevant to Measurement Dashboard's data, I marked all "running" runs as success and that got the DAG to execute with Jul 16 date. The DAG is running right now and processing data. I am assessing whether this run will make Measurement Dashboard catch up or if I'll need to run a manual backfill

Comment 2

[Eduardo Filho [:efilho]]

This hasn't been completely fixed, as I'm still backfilling the data, which hasn't been smooth.
However the link posted in the first message works, as well as some 117 data:

https://telemetry.mozilla.org/new-pipeline/evo.html#!aggregates=Median&cumulative=0&end_date=2023-07-02&include_spill=0&keys=!__none__!__none__&max_channel_version=nightly%252F117&measure=GC_MINOR_US&min_channel_version=nightly%252F116&processType=*&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2023-06-05&trim=1&use_submission_date=0

I'll leave this open until data is completely backfilled

Comment 3

[Eduardo Filho [:efilho]]

The data is backfilled and telemetry.mozilla.org is caught up. Marking this fixed!

Comment 4

[Jon Coppeard (:jonco)]

Thanks for addressing this.