Your RAG Chatbot Lies Because You're Chunking Wrong
Dev.to AI
•
Generative AI
Three weeks into building FolioChat - a chatbot that lets portfolio visitors talk to my GitHub - I had a system that gave answers like a drunk Wikipedia editor. "Tell me about Shane's React work," someone would ask. It would respond with a rambling paragraph about my Python scripts, a random commit message, and somehow my college graduation year. The context was drifting so badly I was getting ready to scrap the whole thing. The fix turned out to be a single architectural decision that most RAG tutorials skip entirely: chunking by meaning instead of by size.