Docker Model Runner Replaced My Entire Local AI Setup
Dev.to AI
•
Generative AI
Open Source AI
AI Tools
I used to have a ridiculous local AI setup. Ollama running as a service. A separate Python ven for LangChain experiments. Another terminal with llama.cpp because I wanted to test quantized models. Three different API formats, three different port numbers, three things that broke independently every time I updated macOS. Then Docker shipped Model Runner and I deleted all of it. What Model Runner Actually Is It's built into Docker Desktop. No separate install.