QwenDean-4B | fine-tuned SLM for UIGen; our first attempt, looking for feedback!
r/LocalLLaMA
•
Machine Learning
Generative AI
AI Research
We've been quietly working on a fine-tuned model and finally decided to put it out there. The idea was to fine-tune a really small LLM that could be mediocre at CodeGen, but then try to enhance it by feeding it better quality code for a very niche CodeGen task (To be precise: UIgen, in one particular framework, language & CSS library) We got the idea from this paper: Overview Qwendean is a 4B parameters model fine-tuned on top of Qwen3-4B for UI gen tasks. It was trained on a {prompt, completion} pair JSONL dataset consisting of around 4K samples.