How do I find and vet someone to set up a high-end local AI workstation? (Threadripper + RTX PRO 6000 96GB)
r/LocalLLaMA
•
Generative AI
AI Hardware
My boss recently spent around ~$13k on a high-end workstation intended to run local AI (LLMs / similar), and I’ve been tasked with figuring out how to get everything properly set up. Neither of us are particularly technical. From what I understand, the system includes: • AMD Threadripper PRO platform • NVIDIA RTX PRO 6000 (Blackwell) with 96GB VRAM • 128GB ECC RAM • Gen5 NVMe storage • Running Windows currently One of the main drivers here is security/privacy - he’s especially interested in local-first setups (he’s mentioned tools like Nemoclaw), which is why we’re avoiding cloud solutions.