Advice on low cost hardware for MoE models

r/LocalLLaMA
Generative AI AI Hardware

I'm currently running a NAS with the minisforum BD895i SE (Ryzen 9 8945HX) with 64GB DDR5 and a 16x 5.0 pcie slot. I have been trying some local LLM models on my main rig (5070ti, pcie 3, 32GB DDR4) which has been nice for smaller dense models. I want to expand to larger (70 to 120B) MoE models and want some advice on a budget friendly way to do that. With current memmory pricing it feels attractive to add a GPU to my NAS. Chassi is quite small but I can fit either a 9060xt or 5060ti 16GB.