your daily driver stack, what's it look like? and why?
r/LocalLLaMA
•
Generative AI
Open Source AI
AI Tools
What it says in the title, I'm interested in hearing what you all have landed on as a workable / useful stack for you. Mine looks like this: back end inference servers - llama.cpp, vLLM | V hermes-agent - cron jobs + OpenAI compatible endpoints | V home-grown web UI & iOS / Swift client I landed on this for a couple reasons: - I have test driven a bunch of the go-to front ends - Open WebUI, LobeHub, Libera Chat etc. Couldn't get behind them. Too many knobs and too many features. I don't mind lots of knobs but I don't want them in my chat UI.