A 397B Model Running on a MacBook. 48 GB of RAM. No Cloud

Towards AI
Generative AI

A VP of AI at CVS Health built a 7,000-line C inference engine that runs Qwen3.5-397B