Qwen3.5-9B finetune/export with Opus 4.6 reasoning distillation + mixed extras

r/LocalLLaMA
Machine Learning Open Source AI

I just uploaded a new GGUF release here: This is my own Qwen 3.5 9B finetune/export project. The base model is unsloth/Qwen3.5-9B, and this run was trained primarily on no/Opus-4.6-Reasoning-3000x-filtered, with extra mixed data from Salesforce/xlam-function-calling-60k and OpenAssistant/oasst2. The idea here was pretty simple: keep a small local model, push it harder toward stronger reasoning traces and structured assistant behavior, then export clean GGUF quants for local use. The repo currently has these GGUFs: Q4_K_M Q8_0 In the name: opus46 = primary.