RTX Pro 4500 Blackwell - Qwen 3.6 27B?
r/LocalLLaMA
•
Generative AI
AI Hardware
Open Source AI
Have have a server running a 4500 blackwell on cuda 13.1 and nvidia/595.58.03 with 48GB mem assigned to it. I have build: dcad77cc3 with Qwen3.6-27B UD-Q5_K_XL loaded and connected it to Roo code. seems ok. Anything I am missing or can I run a larger model? I guess I am looking for it to run a little better / smarter? im building stuff in ue5 now but using codex and claude mostly.