Kimi K2.5 - running locally without GPU; splitting across multiple PCs?
r/LocalLLaMA
•
AI Hardware
I recently got some old servers, and have done some early testing of Kimi K2.5. So far, I have tried running the unsloth 4-bit UD K XL quant (~620gb) on just one computer with 768