Aiven for Apache Kafka
Managed Kafka with tiered storage and built-in schema registry.
Open-Source Projects
Discover top open-source software, updated regularly with real-world adoption signals.
Discover top open-source software, updated regularly with real-world adoption signals.
Composable distributed data streaming engine written in Rust
Lean distributed data streaming engine with stateful stream processing. Build real-time data pipelines with WebAssembly-based transformations and native connectors for MQTT, Kafka, HTTP, and SQL.
Fluvio is a distributed data streaming engine written in Rust that combines high-performance event streaming with stateful data processing. Designed for developers building responsive, data-intensive applications, it provides a unified platform for collecting, transforming, and routing data in motion.
Fluvio supports WebAssembly-based stream processing through reusable "Smart Modules" that enable inline data transformations. Native connectors for HTTP, MQTT, Kafka, SQL, and experimental support for DuckDB, Redis, and S3 allow integration with virtually any system. The Connector Development Kit (CDK) and Smart Module Development Kit (SMDK) accelerate custom extension development.
Deploy locally via the Fluvio Version Manager (fvm) or use InfinyOn Cloud for managed hosting. Client libraries span Rust, Python, JavaScript, with community-maintained support for Go, Java, and Elixir. The Stateful DataFlow framework handles complex workflows with customization across multiple programming languages. Apache-2.0 licensed, Fluvio powers real-time analytics, event-driven architectures, and streaming data pipelines for cloud-native and serverless environments.
When teams consider Fluvio, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
Real-Time Stock Market Dashboards
Ingest market data feeds, apply WebAssembly transformations for aggregations, and stream to visualization frontends with sub-second latency.
IoT Sensor Data Processing
Collect MQTT telemetry from edge devices, filter and enrich streams with Smart Modules, then route to SQL databases or time-series stores.
Event-Driven Microservices
Decouple services with Fluvio topics, apply stateful processing for order fulfillment workflows, and trigger downstream actions via HTTP connectors.
LLM Application Data Pipelines
Stream documents and embeddings to vector databases like Qdrant, transform content inline, and power retrieval-augmented generation systems.
Fluvio is written in Rust for lower resource usage and includes native WebAssembly-based stream processing. Kafka requires separate frameworks like Kafka Streams or Flink for transformations.
Yes. Deploy locally via fvm or use InfinyOn Cloud for managed hosting. The Apache-2.0 license permits commercial use, and the project powers InfinyOn's cloud platform.
Smart Modules compile to WebAssembly, supporting Rust primarily. Connectors use the CDK, also Rust-based. Client libraries exist for Rust, Python, JavaScript, Go, Java, and Elixir.
The README does not specify delivery guarantees. Consult the official architecture documentation or community forums for details on consistency models.
Fluvio includes native Kafka inbound and outbound connectors, enabling gradual migration by bridging topics between systems while you rebuild producers and consumers.
Project at a glance
ActiveLast synced 4 days ago
