24GB M4 Mac - is Qwen 9B only option while system is running?

I have mac at work that I want to use local model for prototyping and basic prompts that needs to stay on device. What sort of model I can run that I can fit at least 64k context? Any setups share or guides welcome. I need to have firefox open with one tab at minium. Problem I have is all the crap that runs on Mac itself by default. submitted by /u/sagiroth [link] [comments]