AI RESEARCH
First time fine-tuning, need a sanity check — 3B or 7B for multi-task reasoning? [D]
r/MachineLearning
•
Ok so this is my first post here, been lurking for a while. I’m about to start my first fine-tuning project and I don’t want to commit to the wrong direction so figured I’d ask. Background on me: I’m not from an ML background, self-taught, been working with LLMs through APIs for about a year. Hit the wall where prompt engineering isn’t enough anymore for what I’m trying to do, so now I need to actually fine-tune something. Here’s the task. I want the model to learn three related things: First, reading what’s actually going on underneath someone’s question.