AI RESEARCH
[P] Volga - Data Engine for Real-Time AI/ML
r/MachineLearning
•
Hi all, wanted to share the project I've been working on: Volga - an open-source data engine for real-time AI/ML. In short, it is a Flink/Spark/Arroyo alternative tailored for AI/ML pipelines, similar to systems like Chronon and OpenMLDB. I’ve recently completed a full rewrite of the system, moving from a Python+Ray prototype to a native Rust core. The goal was to build a truly standalone runtime that eliminates the "infrastructure tax" of traditional JVM-based stacks.