The MTP function in LMStudio causes a decrease in output quality.
r/LocalLLaMA
•
Generative AI
Open Source AI
The prompt is very simple, you can see it at the end. Both tests used the exact same settings, the only difference was that I turned the MTP button on/off, nothing else changed, I tried similar tests multiple times with similar results: By the way, this situation does not occur when I use the llama-server.exe I compiled myself. Works well garbage output Summarize the meaning of each sentence, shorten it, and output it while maintaining the original format: The sun rises in the east. @ Birds sing beautifully in the morning. @ A journey of a thousand miles begins with a single step.