llama.cpp docker images to run MTP models

r/LocalLLaMA
Generative AI Open Source AI

This is follow up from previous post: There have been many improvements to the MTP pull request and the llama.cpp main branch, such as image and various bug fixes. I recently made a new build for my local machine, but keeping guides up to date is an issue, so I built Docker images to make running them easier. If you are already using llama.cpp Docker images, it would be straightforward to switch over until official builds