52 bytes, text/x-github-pull-request
|Details | Review | Splinter Review|
Currently, a fresh dev deployment will try to re-run all jobs that are elapsed since the start date, since there's no database record for those runs. This is fine as long as the AWS credentials aren't set in dev. If the credentials happen to be available, however, the clusters for those jobs will actually spin up in aws and this becomes an expensive mistake. We should figure out how to prevent this from happening and only kick off jobs in dev if they're explicitly triggered.
Created attachment 8801907 [details] [review] [telemetry-airflow] mozilla:dags-off-by-default > mozilla:master
AFAICT this bug was fixed by the referenced PR from :sunahsuh. Further, this setting was made the default by airflow 1.8.0 so our new dev containers should also not exhibit this issue. Closing.