Astronomer
Managed Apache Airflow service for orchestrating and monitoring data pipelines in the cloud
Open-Source Projects
Discover top open-source software, updated regularly with real-world adoption signals.
Discover top open-source software, updated regularly with real-world adoption signals.
Scalable orchestration engine for resilient microservice workflows
Conductor lets developers define event‑driven workflows as JSON, offering automatic retries, flexible task types, built‑in UI, and support for Redis, MySQL, Postgres, Elasticsearch, and more.
Conductor targets development teams building distributed microservice or event‑driven applications that need reliable, durable workflow execution. It is suited for enterprises and startups alike that want to decouple services while maintaining end‑to‑end visibility.
Workflows are expressed as versioned JSON, enabling a code‑first approach. The engine ships with a rich catalog of task types—HTTP, Lambda, Sub‑workflow, Event, and more—plus a customizable web UI for monitoring, debugging, and observability. Automatic retries, fallback mechanisms, and configurable timeouts provide resilience. Persistence and queue layers are pluggable, supporting Redis, MySQL, Postgres, and Elasticsearch (or Opensearch) out of the box. Official SDKs for Java, Python, JavaScript/TypeScript, Go, and C# simplify client integration.
Developers can start locally with Docker Compose, requiring Docker Desktop, Java 17+, and Node 14 for UI builds. For production, Conductor can be built from source and run as a standalone Java service on any JVM‑compatible host, with flexible database and indexing configurations. The project is actively maintained by Orkes and a vibrant open‑source community.
When teams consider Conductor, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
Order fulfillment pipeline
Coordinates inventory check, payment processing, shipping label creation, and notification across services with automatic retries on failures.
Data ingestion and transformation
Orchestrates fetching data from APIs, applying Lambda tasks for transformation, storing results in a data lake, and handling back‑pressure via queue integration.
CI/CD multi‑stage deployment
Runs build, test, security scan, and deployment tasks across heterogeneous environments, rolling back automatically on errors.
Customer onboarding workflow
Guides new users through verification, account provisioning, welcome email, and CRM update, with real‑time monitoring via the UI.
Conductor provides official SDKs for Java, Python, JavaScript/TypeScript, Go, and C#.
Elasticsearch is the default indexing backend, but you can use Opensearch or disable indexing if not required.
Yes, you can build the Java application from source and deploy it on any JVM‑compatible host.
It supports configurable retries, timeout policies, and fallback tasks to ensure resilient execution.
A built‑in web UI lets you view workflow instances, task status, and logs, and it can be customized.
Project at a glance
ActiveLast synced 4 days ago
