The power of structured workflows and small local models

r/LocalLLaMA
Generative AI

A month ago, I experimented with a very basic home-rolled agent loop with a handful of tools and found it worked surprisingly well in spite of how crude it was: Later, I wrote about how I addictive developing your own agent loop is, esp. once you reach the point that the agent loop is capable of editing itself: Well, 28 days later, it's been getting out of hand. I've been working until 5am on it as it was so addictive. Once you have a good agentic setup, you quickly realise that you, as the human, is the main bottleneck.