Mistral-Medium-3.5-128B-Q3_K_M on 3x3090 (72GB VRAM)

r/LocalLLaMA
Generative AI Open Source AI

Here is the actual speed of Mistral Medium Q3 running locally on 3x3090 first some Python then svg then html submitted by /u/jacek2023 [link] [comments]