Qwen3.5-27B-Claude-4.6-Opus-Uncensored-V2-Kullback-Leibler-GGUF
r/LocalLLaMA
•
Machine Learning
Generative AI
AI Research
AI Tools
Here model: (Q4_K_M quant is most solid (contains KL fix)) Q4_K_M contains my fixes for attn_ and ffn_gate_exps layers for holding context during conversation. Q8_0 is just pure merge via script below from pastebin. Merging has been done via following script: - I vibecoded it via Claude Opus 4.6. It's pretty solid now and works for Q8_0 quants on Google Colab Free. So, Jackrong made a really good Qwen3.5 27B model finetuned on this dataset: It achieves 96.91% on HumanEval benchmark.