RTX 3060 12Gb as a second GPU
r/LocalLLaMA
•
Generative AI
AI Hardware
Hi! I’ve been messing around with LLMs for a while, and I recently upgraded to a 5070ti (16 GB). It feels like a breath of fresh air compared to my old 4060 (8 GB), but now I’m finding myself wanting a bit VRAM. I’ve searched the market, and 3060 (12 GB) seems like a pretty decent option. I know it’s an old GPU, but it should still be better than CPU offloading, right? These GPUs are supposed to be going into my home server, so I’m trying to stay on a budget. I am going to use them to inference and train models.