I regret ever finding LocalLLaMA
r/LocalLLaMA
•
Generative AI
Open Source AI
It all started with using "the AI" to help me study for a big exam. Can it make some flashcards or questions? Then Gemini. Big context, converting PDFs, using markdown, custom system instruction on Ai Studio, API. We can run this locally? Then LocalLLama. Now I'm buying used MI50s from China, quantizing this and that, squeezing every drop in REAP, custom imatrices, llama forks. Exam? What exam? In all seriousness, i NEVER thought, of all things to be addicted to (and be so distracted by), local LLMs would be it. They are very interesting though.