Benchmarks of 20 small LLMs on a 6GB RTX 4050

r/LocalLLaMA
Generative AI AI Hardware

I'm looking for models that can run on my GPU and actually do something useful. I think that any small difference could be a "big" improvement, because they are all so small. So I went to the LM studio database and searched many variants from the same family, trying to select the newer models. Then asked claude to select known benchmarks and then run some qualitative tests. Now I'll try to test with real use cases and then select a "team". Most of the people runs local with powerful machines. But the majority of the people barely has a 6gb gpu. So this review may help them.