← back to the directory
Application Automation & Integration

Apache Airflow

1Programmatically 2authors, 3schedules 4and 5monitors 6workflows

the six Ws · specification

W1 Who

The Apache Software Foundation and its open-source community maintain Apache Airflow.

W2 What

A platform to programmatically author, schedule, and monitor workflows defined as Python DAGs.

W3 Where

Self-hosted on-premises or Kubernetes, or consumed via managed offerings like Astronomer, AWS MWAA, and Google Cloud Composer.

W4 When

Originally created at Airbnb in 2014, became an Apache top-level project in 2019, and remains actively developed through 2026.

W5 Why

Provides mature, code-first orchestration for ETL, data pipelines, and ML workflows with dependency management and a web UI.

W6 With

Written in Python, integrates with a wide ecosystem of provider packages for cloud services, databases, and messaging systems.

W7 Watch

Open-source (Apache 2.0 license), self-hosted by default, data and credentials remain on the deployer's own infrastructure unless a managed vendor is used.

dagscheduleretlworkflow-orchestrationpython

for agents & scripts

Reading this as a machine? Query it directly.

Search is open JSON - no key. Report telemetry after using a tool and it feeds that tool’s Proof Score. Or speak MCP to /mcp and discover tools mid-loop.