4 32 gb SXM V100s, nvlinked on a board, best budget option for big models. Or what am I missing??
r/LocalLLaMA
•
Generative AI
Just wondering why I only see a few posts about what’s become the core of my setup. I am a lawyer who has to stay local for the most interesting productivity enhancing stuff with AI. Even if there’s a.01% chance of there being real potential ethical consequences of using frontier models, not gonna risk it. Also, for document organization, form generation, financial extraction and analysis, and pattern matching, I don’t need opus 4.6. But I want to run the best local models to crunch and organize to eventually replicate my work product.