Workflow Orchestration Tools
Schedule, monitor, and manage complex data workflows and pipeline dependencies.
Apache Airflow
Platform to programmatically author, schedule, and monitor workflows.
Orchestrationworkfloworchestration
Prefect
Modern workflow orchestration tool for data pipelines with a Pythonic API.
OrchestrationorchestrationPython
Dagster
Data orchestrator for machine learning, analytics, and ETL workflows.
Orchestrationorchestrationsoftware-defined assets
Mage
Open-source data pipeline tool for building, running, and managing ETL and ML workflows.
Orchestrationorchestrationopen-source
Kestra
Open-source, declarative, event-driven orchestration platform that defines workflows in YAML.
OrchestrationorchestrationYAML
Flyte
Open-source, Kubernetes-native workflow orchestration platform built for scalable ML and data pipelines.
OrchestrationorchestrationML
Luigi
Python package from Spotify for building complex batch job pipelines with dependency resolution.
OrchestrationorchestrationPython
Temporal
Durable execution platform for building reliable, fault-tolerant distributed applications and workflow automation.
Orchestrationorchestrationdistributed
Windmill
Open-source developer platform for turning scripts into workflows, internal tools, and scheduled jobs.
Orchestrationorchestrationopen-source
9 tools