Apache Airflow Tutorial

Apache Airflow Tutorial. Tutorial on the taskflow api. It's one of the most reliable systems for orchestrating processes or pipelines that data engineers employ.

Airflow Basics — Airflow Tutorial Documentation
Airflow Basics — Airflow Tutorial Documentation from airflow-tutorial.readthedocs.io

This tutorial builds on the regular airflow tutorial and focuses specifically on writing data pipelines using the taskflow api paradigm which is introduced as part of airflow 2.0 and contrasts this with dags written using the traditional paradigm. Apache airflow (or simply airflow) is a highly versatile tool that can be used across multiple domains for managing and scheduling workflows. It's one of the most reliable systems for orchestrating processes or pipelines that data engineers employ.

Read more