Nemotron super 120b on strix halo
r/LocalLLaMA
•
Generative AI
Open Source AI
Nemotron super 120b is out and I had a bit of trouble getting it running on my strix halo and llama.cpp due to a tensor shape error. I realize I may just be a dumbass and everyone else may have figured this out with no issues, but I wanted to post this in case someone else ran into problems.