Fine-Tuning Llama 3.2 3B on Medical QA: Week 1 Setup and Baseline Inference

The Problem With General-Purpose LLMs in Healthcare Ask a general-purpose LLM about the early symptoms of type 2 diabetes and it might tell you: "When your body produces insulin, it can cause your body to hold onto water, leading to increased thirst." That is wrong. Increased thirst in diabetes is caused by high blood glucose pulling fluid from tissues, not insulin. The model arrived at that answer through superficial pattern matching: insulin, fluid retention, and thirst are highly correlated keywords in general web text, so the model linked them causally.