Qwen 3.5 27B Macbook M4 Pro 48GB
r/LocalLLaMA
•
Open Source AI
AI Tools
Has anyone tried Qwen 3.5 27b on a 48gb Macbook Pro? What has been the results for them and at what quant? I have been reading that the 27b outperforms the 35B-A3B and I would like to know if anyone has the same system as above and if it runs smooth (with enough room for cache and context) There are some mlx-versions available on huggingface I have seen that offer different quants. 4b, Opus Distilled 6bit, a 7 bit, mxfp8, etc. Would appreciate feedback from any hands on experience with these models, their speeds, quality in quantizations, and viability for real world use. Much Appreciated.