Bug 1864968 Comment 0 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

Original comment by
on 
Task instances seem to be getting deleted.  When this happens, the task instances are no longer visible the Airflow UI, and it can prevent future DAG runs from running properly if they or their tasks have `depends_on_past = True`.

We currently think this is due to a [known issue](https://github.com/apache/airflow/issues/31179) in Airflow 2.6.3 where task instances can get deleted unintentionally.  That issue has been fixed in Airflow 2.7.0.

DAGs affected thus far:
- [bqetl_addons](https://workflow.telemetry.mozilla.org/dags/bqetl_addons/grid)
- [bqetl_adjust](https://workflow.telemetry.mozilla.org/dags/bqetl_adjust/grid)
- [bqetl_desktop_funnel](https://workflow.telemetry.mozilla.org/dags/bqetl_desktop_funnel/grid)
- [bqetl_firefox_ios](https://workflow.telemetry.mozilla.org/dags/bqetl_firefox_ios/grid)
- [bqetl_fog_decision_support](https://workflow.telemetry.mozilla.org/dags/bqetl_fog_decision_support/grid)
- [bqetl_internal_tooling](https://workflow.telemetry.mozilla.org/dags/bqetl_internal_tooling/grid)
- [bqetl_regrets_reporter_summary](https://workflow.telemetry.mozilla.org/dags/bqetl_regrets_reporter_summary/grid)
- [bqetl_releases](https://workflow.telemetry.mozilla.org/dags/bqetl_releases/grid)
- [bqetl_sponsored_tiles_clients_daily](https://workflow.telemetry.mozilla.org/dags/bqetl_sponsored_tiles_clients_daily/grid)
- [jetstream](https://workflow.telemetry.mozilla.org/dags/jetstream/grid)
- [ltv_daily](https://workflow.telemetry.mozilla.org/dags/ltv_daily/grid)
- [operational_monitoring](https://workflow.telemetry.mozilla.org/dags/operational_monitoring/grid)
- [private_bqetl_historical_transactions](https://workflow.telemetry.mozilla.org/dags/private_bqetl_historical_transactions/grid)
- [search_alert](https://workflow.telemetry.mozilla.org/dags/search_alert/grid)
- [taar_daily](https://workflow.telemetry.mozilla.org/dags/taar_daily/grid)
- [update_orphaning_dashboard_etl](https://workflow.telemetry.mozilla.org/dags/update_orphaning_dashboard_etl/grid)

Dates affected thus far:
- 2023-10-27
- 2023-10-28
- 2023-10-29
- 2023-11-01
- 2023-11-05
- 2023-11-06
- 2023-11-07
- 2023-11-08
- 2023-11-09
- 2023-11-10
- 2023-11-11
- 2023-11-12
- 2023-11-13
- 2023-11-14
Revision 1 by
on 
Task instances seem to be getting deleted.  When this happens, the task instances are no longer visible the Airflow UI, and it can prevent future DAG runs from running properly if they or their tasks have `depends_on_past = True`.

We currently think this is due to a [known issue](https://github.com/apache/airflow/issues/31179) in Airflow 2.6 where task instances can get deleted unintentionally.  That issue has been fixed in Airflow 2.7.

DAGs affected thus far:
- [bqetl_addons](https://workflow.telemetry.mozilla.org/dags/bqetl_addons/grid)
- [bqetl_adjust](https://workflow.telemetry.mozilla.org/dags/bqetl_adjust/grid)
- [bqetl_desktop_funnel](https://workflow.telemetry.mozilla.org/dags/bqetl_desktop_funnel/grid)
- [bqetl_firefox_ios](https://workflow.telemetry.mozilla.org/dags/bqetl_firefox_ios/grid)
- [bqetl_fog_decision_support](https://workflow.telemetry.mozilla.org/dags/bqetl_fog_decision_support/grid)
- [bqetl_internal_tooling](https://workflow.telemetry.mozilla.org/dags/bqetl_internal_tooling/grid)
- [bqetl_regrets_reporter_summary](https://workflow.telemetry.mozilla.org/dags/bqetl_regrets_reporter_summary/grid)
- [bqetl_releases](https://workflow.telemetry.mozilla.org/dags/bqetl_releases/grid)
- [bqetl_sponsored_tiles_clients_daily](https://workflow.telemetry.mozilla.org/dags/bqetl_sponsored_tiles_clients_daily/grid)
- [jetstream](https://workflow.telemetry.mozilla.org/dags/jetstream/grid)
- [ltv_daily](https://workflow.telemetry.mozilla.org/dags/ltv_daily/grid)
- [operational_monitoring](https://workflow.telemetry.mozilla.org/dags/operational_monitoring/grid)
- [private_bqetl_historical_transactions](https://workflow.telemetry.mozilla.org/dags/private_bqetl_historical_transactions/grid)
- [search_alert](https://workflow.telemetry.mozilla.org/dags/search_alert/grid)
- [taar_daily](https://workflow.telemetry.mozilla.org/dags/taar_daily/grid)
- [update_orphaning_dashboard_etl](https://workflow.telemetry.mozilla.org/dags/update_orphaning_dashboard_etl/grid)

Dates affected thus far:
- 2023-10-27
- 2023-10-28
- 2023-10-29
- 2023-11-01
- 2023-11-05
- 2023-11-06
- 2023-11-07
- 2023-11-08
- 2023-11-09
- 2023-11-10
- 2023-11-11
- 2023-11-12
- 2023-11-13
- 2023-11-14
Revision 2 by
on 
Task instances seem to be getting deleted.  When this happens, the task instances are no longer visible the Airflow UI, and it can prevent future DAG runs from running properly if they or their tasks have `depends_on_past = True`.

We currently think this is due to a [known issue](https://github.com/apache/airflow/issues/31179) in Airflow 2.6 where task instances can get deleted unintentionally.  That issue has been [fixed](https://github.com/apache/airflow/pull/32684) in Airflow 2.7.

DAGs affected thus far:
- [bqetl_addons](https://workflow.telemetry.mozilla.org/dags/bqetl_addons/grid)
- [bqetl_adjust](https://workflow.telemetry.mozilla.org/dags/bqetl_adjust/grid)
- [bqetl_desktop_funnel](https://workflow.telemetry.mozilla.org/dags/bqetl_desktop_funnel/grid)
- [bqetl_firefox_ios](https://workflow.telemetry.mozilla.org/dags/bqetl_firefox_ios/grid)
- [bqetl_fog_decision_support](https://workflow.telemetry.mozilla.org/dags/bqetl_fog_decision_support/grid)
- [bqetl_internal_tooling](https://workflow.telemetry.mozilla.org/dags/bqetl_internal_tooling/grid)
- [bqetl_regrets_reporter_summary](https://workflow.telemetry.mozilla.org/dags/bqetl_regrets_reporter_summary/grid)
- [bqetl_releases](https://workflow.telemetry.mozilla.org/dags/bqetl_releases/grid)
- [bqetl_sponsored_tiles_clients_daily](https://workflow.telemetry.mozilla.org/dags/bqetl_sponsored_tiles_clients_daily/grid)
- [jetstream](https://workflow.telemetry.mozilla.org/dags/jetstream/grid)
- [ltv_daily](https://workflow.telemetry.mozilla.org/dags/ltv_daily/grid)
- [operational_monitoring](https://workflow.telemetry.mozilla.org/dags/operational_monitoring/grid)
- [private_bqetl_historical_transactions](https://workflow.telemetry.mozilla.org/dags/private_bqetl_historical_transactions/grid)
- [search_alert](https://workflow.telemetry.mozilla.org/dags/search_alert/grid)
- [taar_daily](https://workflow.telemetry.mozilla.org/dags/taar_daily/grid)
- [update_orphaning_dashboard_etl](https://workflow.telemetry.mozilla.org/dags/update_orphaning_dashboard_etl/grid)

Dates affected thus far:
- 2023-10-27
- 2023-10-28
- 2023-10-29
- 2023-11-01
- 2023-11-05
- 2023-11-06
- 2023-11-07
- 2023-11-08
- 2023-11-09
- 2023-11-10
- 2023-11-11
- 2023-11-12
- 2023-11-13
- 2023-11-14

Back to Bug 1864968 Comment 0