Small models can be good agents
r/LocalLLaMA
•
AI Hardware
I have been messing with some of the smaller models (think sub 30B range), and getting them to do complex tasks. My approach is pretty standard: take a big problem and get it to break it down into smaller tasks. They are instructed to create JavaScript code that runs in a sandbox (v8), with custom functions and MCP tools. Though I don't currently have the hardware to run this myself, I am using a provider to rent GPU by the hour (usually one or two RTX 3090). Keep that in mind for some of this.