Anyone here actually using a Mac Studio Ultra (512GB RAM) for local LLM work? Feels like overkill for my use case
r/LocalLLaMA
•
Generative AI
I’m running a Mac Studio Ultra (512GB RAM) and I’ve been experimenting with local LLMs on it over the past few months. Most of my work is in data heavy prototyping and small scale model experimentation (mainly testing inference pipelines, working with embeddings, and occasionally running larger context models for research style analysis). I also do a lot of software development around AI tooling and automation workflows, but nothing at a production