How to add multipart GGUF models to models.ini for llama server?
r/LocalLLaMA
•
Generative AI
Open Source AI
With the recent change leading to -hf downloaded models being moved and saved as blob files, I want to change hiw I do thibgs to avoid this being a problem now or in the future. I have started using a models.ini file to list out model-specific parameters (like temp and min-p) with the 'm = ' to put the full path to a local GGUF file. My question is, how do I use model.ini amd a 'm =' path for multipart GGUF files? For example, the unsloth/Qwen3.5-122B-A10B-GGUF at a 3 or 4 bit quant contain multiple GGUF files.