Made a simple template manager and GUI for llama.cpp so I don't have to keep memorizing CLI flags.

r/LocalLLaMA
Generative AI Open Source AI

Introducing Hexllama Hey, I’ve always found llama-server to be than enough for testing out local models, mostly because it guarantees you always have the absolute latest llama.cpp features and architecture support. But keeping track of different CLI commands, context sizes, and batch settings for different models was becoming a massive headache. Plus, managing multiple terminal tabs when I wanted to run two models at once was annoying. So, I built Hexllama. It's a fast desktop interface that gets out of your way and just makes managing llama.cpp easier...