MTP vs non-MTP vram usage difference?
r/LocalLLaMA
•
Generative AI
Open Source AI
As per title, assuming you run both with the same context and quantization in llama.cpp is there any difference in vram usage? submitted by /u/DeepBlue96 [link] [comments]