llama + spec: MTP Support by am17an · Pull Request #22673 · ggml-org/llama.cpp

r/LocalLLaMA
Generative AI Open Source AI

AI news: llama + spec: MTP by am17an · Pull Request · ggml-org/llama.cpp. From r/LocalLLaMA.