Closed Bug 1269754 Opened 8 years ago Closed 3 years ago

[meta] Airflow

Categories

(Data Platform and Tools :: General, defect, P3)

Product:
Data Platform and Tools
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Unassigned)

References

Details

The current mechanism for scheduling tasks on analysis.telemetry.mozilla.org is very simple and as our needs become more complex, we're rapidly outgrowing its capabilities.

Specifically, we need the following:
- Dependencies between jobs
- Improved monitoring (see bug 1232642)
- More flexible scheduling options
- Support for backfill
- Ability to launch one-off jobs
Blocks: 1248688
Depends on: 1232642
Priority: -- → P3
Summary: [meta] Improve scheduling on analysis.telemetry.mozilla.org → [meta] Deploy Airflow
Summary: [meta] Deploy Airflow → [meta] Airflow
I have changed the title as Airflow has been deployed. The remaining work involves slowly moving existing scheduled jobs to Airflow.
No longer blocks: 1248688
No longer depends on: 1274984
Depends on: 1309352
Depends on: 1310486
Depends on: 1309622
Depends on: 1306664
Depends on: 1316669
Depends on: 1321424
Depends on: 1323321
Depends on: 1324805
Depends on: 1339495
Depends on: 1353097
Component: Metrics: Pipeline → Scheduling
Product: Cloud Services → Data Platform and Tools
Depends on: 1362227
Depends on: 1362229
Depends on: 1365363

This tracking bug appears to have no remaining dependencies, and no activity for 4 years. Closing.

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
Component: Scheduling → General
You need to log in before you can comment on or make changes to this bug.