Strix Halo or DGX Spark for a home LLM server?
r/LocalLLaMA
•
Generative AI
AI Hardware
I’m currently stuck deciding between AMD Strix Halo (128 GB AMD Ryzen AI Max+ 395 Framework Desktop) and an Nvidia DGX Spark (Asus Ascent GX10) for a home LLM server that can be accessed over the local network with a ChatGPT like interface in a web browser. Keep in mind I’m a noob at this, my only previous experience with local LLMs is using LM Studio on one machine, with no network hosting. The Framework Desktop costs $3,388, while the Asus Ascent GX10 costs $3,500. I’m willing to pay this difference if the GX10 is faster in real world inference speeds.