Going local with old GPUs

r/LocalLLaMA
Generative AI AI Tools

I'm an ex crypto miner with remnant mining parts so I threw them together into a franken hydra case. I've been using claude oath previously, but they just shut that door last week or so. I need to catch up on local inference know how. Any sites that can help with this? So far I have this rig of mixed 5090, 3090s, 3090ti on a x299 Sage Asus board. So far i've tested Ollama, vLLM and Aphrodite Engine. Any sites like hashrate.no that post undervolt overclock settings to maximize the hardware and save power? submitted by /u/AbbreviationsSad5582 [link] [comments.