Closed Bug 1286280 Opened 8 years ago Closed 2 years ago

Document worfklow.t.m.o. (airflow)

Categories

(Data Platform and Tools :: Documentation and Knowledge Repo (RTMO), defect, P3)

Product:
Data Platform and Tools
Component:
Documentation and Knowledge Repo (RTMO)
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: rvitillo, Unassigned)

References

Details

User Story

Our Airflow deployment should be documented on our wiki. Ideally a new employee should find there anything he needs to create & monitor a new scheduled job.

References:
- https://mail.mozilla.org/pipermail/fhr-dev/2016-July/000973.html
      No description provided.
Priority: -- → P2
Priority: P2 → P3
Assignee: rharter → nobody
Component: Metrics: Pipeline → Documentation and Knowledge Repo (RTMO)
Product: Cloud Services → Data Platform and Tools
<harter> Is this headbanging par for the course or is there an "Intro to Airflow" somewhere that I should read


<frank> it is par for the course
13:25:22 if we want to rewrite Airflow docs then a lot of people would be very happy
13:25:27 because imo it is no good :(
13:26:03 there needs to be separate levels of docs
13:26:17 User - someone with access to UI, can create new DAGs
13:26:21 Advanced User - access to CLI
13:26:33 Developer - needs to know details about DAG implementations and new operators
13:26:46 95% of the time we just need that first one -_-

We have https://docs.telemetry.mozilla.org/cookbooks/bigquery-airflow.html but there might be a few more things we could do here.

Summary: Document w.t.m.o. → Document worfklow.t.m.o. (airflow)

I think https://docs.telemetry.mozilla.org/cookbooks/scheduling_queries.html covers most use cases here. Let's close this vague bug.

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.