I have a dream. A dream to run a state of the art model on my setup.

My specs is an RX 580 2048 SP running at PCIe x4, an i5-8265U, 8GB system ram, 12GB system swap. The NVME drive on my laptop is running via that NVME to USB 3. This setup runs a 9B parameter model (qwen3.5-9b-gemini-3.1-pro-reasoning-distill), at 20 tokens/second. I just had so much fun tweaking MCPs, sympy setup on this but lol. AI is quite fun to do. Maybe in the future I could run something better. But right now, I'm having fun. submitted by /u/ItzYaBoiGoogle [link] [comments.