"Go big or go home."
r/LocalLLaMA
•
Generative AI
AI Research
Looking for some perspective and suggestions. I'm 48 hours into the local LLM rabbit hole with my M5 Max with 128GB of RAM. And I'm torn. I work in the legal industry and have to protect client data. I use AI mainly for drafting correspondence and for some document review and summation. On the one hand, it's amazing to me that my computer now has a mini human-brain in that is offline and or less capable of handling some drafting work with relative accuracy. On the other, it's clear to me that local LLMs (at my current compute power) do not hold a candle to cloud-based solutions.