RTX 5060 Ti 16GB Local LLM Findings: 30B Still Wins, 35B UD Is Surprisingly Fast
r/LocalLLaMA
•
Generative AI
Open Source AI
AI Research
My first post here since I benefit a lot from reading. Bought 5060ti 16gb and tried various model. This is the short version for me deciding what to run on this card with llama.cpp, not a giant benchmark dump.