llama.cpp's Preliminary SM120 Native NVFP4 MMQ Is Merged

r/LocalLLaMA
Generative AI Open Source AI

And somehow we already got some GGUFs for it! (the below one is from PR author himself) submitted by /u/ggonavyy [link] [comments]