RTX A5000 Pro Balckwell 48GB

r/LocalLLaMA
Machine Learning Open Source AI

What do people think about this card for an enthusiast? With 48GB. You can fit qwen 27B q8 with context. It's still pricy, I get that. But the 48 GB seems nice. The next step up would be almost double the price. $4500 vs $9000. I would use this for finetune and inference. I like the idea of keeping all the ram in one card vs splitting with 2x 5090s Also - Are people really getting RTX6000s for ~$7K? submitted by /u/deltamoney [link] [comments]