Apache Workflow Terminology
Apache Workflow Terminology by PCWorkshops Term Explanation DAG Directed Acyclic Graph — the main structure in Airflow. It defines a workflow and the order in which tasks should run. Task A single unit of work in a workflow, such as running a Python function or executing a SQL query. DAG Run One execution/instance of a DAG. If a DAG runs every day, each day's execution is a separate DAG Run. Task Instance A specific execution of a task within a particular DAG Run. Scheduler Airflow's component that monitors DAGs and determines when tasks are ready to run. Executor Determines how and where Airflow runs tasks, such as locally, in multiple processes, or on Kubernetes. Worker A process or machine that actually executes Airflow tasks. Webserver Airflow's web interface, where you can view DAGs, task statuses, logs, and other information. Trigger Rule A rule that determines when a task is allowed to run based on the status of its upstream tasks. Dependency A rela...