M5 Pro LLM benchmark
r/LocalLLaMA
•
Generative AI
Open Source AI
AI Research
I thinking of upgrading my M1 Pro machine and went to the tonight and ran a few benchmarks. I have seen almost nothing using about the Pro, all the reviews are on the Max. Here are a couple of llama-bench results for 3 models (and comparisons to my personal M1 Pro and work M2 Max). Sadly, my M1 Pro only has 16gb so only was able to load 1 of the 3 models.