Closed
Bug 1485166
Opened 7 years ago
Closed 5 years ago
airflow jobs should throw errors if a scheduled job is never attempted
Categories
(Data Platform and Tools :: General, enhancement, P2)
Data Platform and Tools
General
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: vng, Unassigned)
Details
(Whiteboard: [DataPlatform])
Airflow currently does not emit warning messages when jobs fail early in a DAG. Dependent jobs are never started, and jobs that do not start are not considered as failures.
This currently affects jobs on the longitudinal DAG, but this seems like a generalized problem with airflow.
|
Reporter | |
Updated•7 years ago
|
Whiteboard: [DataPlatform]"
|
|
Reporter | |
Updated•7 years ago
|
Whiteboard: [DataPlatform]" → [DataPlatform]
|
||
Comment 1•7 years ago
|
||
We could potentially make use of the SLA alerting functionality[1] in Airflow to send a notification if a task doesn't run by a certain time.
[1] https://airflow.apache.org/concepts.html#slas
Points: --- → 1
Priority: -- → P2
|
|
Reporter | |
Comment 2•5 years ago
|
||
A work around that we've used for TAAR is to reduce the retry limit to one run.
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
|
Assignee | |
Updated•3 years ago
|
Component: Datasets: General → General
You need to log in
before you can comment on or make changes to this bug.
Description
•