Introducing Ternary Bonsai: Top Intelligence at 1.58 Bits (4 minute read)

Ternary Bonsai is a 1.58-bit language model family offering improved performance with minimal memory usage. It outperforms 1-bit counterparts, scoring 75.5 on average benchmarks and achieving 3-4x better energy efficiency. The models, available in 8B, 4B, and 1.7B versions, provide flexible deployment across devices like Macs and iPhones under the Apache 2.0 License.