llama.cpp docker images to run MTP models
r/LocalLLaMA
•
Generative AI
Open Source AI
This is follow up from previous post: There have been many improvements to the MTP pull request and the llama.cpp main branch, such as image and various bug fixes. I recently made a new build for my local machine, but keeping guides up to date is an issue, so I built Docker images to make running them easier. If you are already using llama.cpp Docker images, it would be straightforward to switch over until official builds