My own local first ai harness

r/LocalLLaMA
Generative AI Open Source AI AI Tools

Hi, i just wanted to share what im playing with for last couple weaks. I built my own AI harness: TinyHarness My main goal was low memory footprint, it is not written in Typescript/Javascript/Python, leaving as much memory as possible for running local models. Its compatible with Ollama, Llama.cpp and vllm and it can access web throught ollama web search api. The ambition is to make a competitor to tools like pi and opencode in the near future. Please roast it, i need every bit of criticism to improve it submitted by /u/WhiskyAKM [link] [comments.