Getting the most out of my Mi50
r/LocalLLaMA
•
Generative AI
AI Hardware
Open Source AI
Just received my AMD Instinct Mi50 32gb (for about the same price as 32gb ddr5, which is depressing), and was wondering if there were any Mi50 owners that could help me get the most out of this card. I'll mostly just be using this for llama.cpp inference and using it as my OpenCode GPU. Firstly, this is going in my desktop gaming pc (I have ordered a blower-style shroud which should arrive this week), which is running windows 11 and a Radeon Rx 6700xt.