Run Qwen3.5-397B-A13B with vLLM and 8xR9700
r/LocalLLaMA
•
AI Hardware
AI Tools
Special thanks for u/Sea-Speaker1700 to make possible run mxfp4 on R0700 GPU, first guide to run 122B models here Well, 397B model works amazing, super fast.