I Rewrote Pipecat in Rust. Here's What I Learned Building a Voice Agent Framework from Scratch.

Dev.to AI
Generative AI

Description: rustvani is a Rust-native voice agent pipeline framework - a from-scratch port of Pipecat for when 30MB of memory per instance is all There's a moment in every voice AI conversation where the user says something, and then. waits. Maybe 800 milliseconds. Maybe a full second. Maybe more. In that silence, trust evaporates. The user starts wondering if the bot heard them. They repeat themselves. The bot now has two overlapping utterances to deal with. Things spiral. I spent months obsessing over that silence.