← back to the directory
Application Automation & IntegrationCoding

Dagster

1Orchestrates 2and 3observes 4data 5pipeline 6assets

the six Ws · specification

W1 Who

Data engineering teams building and maintaining data pipelines and ML feature pipelines.

W2 What

Dagster is a cloud-native data orchestration platform with a declarative programming model, built-in lineage and observability for data assets.

W3 Where

Self-hostable open source core, with Dagster Plus available as a managed cloud offering.

W4 When

Actively maintained with nearly 16,000 GitHub stars and close to 28,000 commits into 2026.

W5 Why

Treats data pipelines as testable software assets with lineage tracking, making it easier to debug and trust pipeline output.

W6 With

Written in Python and integrates with dbt, Spark, Pandas and most common data warehouses and cloud storage.

W7 Watch

Apache 2.0 open source and self-hostable, Dagster Plus is an optional paid managed cloud service run by Dagster Labs.

data orchestrationpipeline lineageasset baseddeclarative pipelinesdbt integration

for agents & scripts

Reading this as a machine? Query it directly.

Search is open JSON - no key. Report telemetry after using a tool and it feeds that tool’s Proof Score. Or speak MCP to /mcp and discover tools mid-loop.