When are we gonna get more 1-Bit models(Medium & Large size)?
r/LocalLLaMA
•
Machine Learning
Obviously this thought came after recent Prism ML's Bonsai 8B model. This thread seems honest feedback on Bonsai-8B model. Few mentioned that halluciation happened few times. Hope future 1-bit models come with improvements. There's recent thread on simulation for Qwen3.5 models. That looks awesome for tiny GPUs. I also mentioned the size ratio for medium-big-large models(on some other thread) which seems nice. Pasting the size ratio below.