How small model can I go for a little RAG?

Hi, I would like to make a RAG out of old incidents and solutions. The text is not super advanced but it can be a bit. sloppy sometimes. I am not sure how small model I could use. Anyone who tried a similar thing and could make a recommendation? Right now we have a simple search engine but exact matches can miss a lot of valuable old info so I figured a little chatbot would potentially be better. submitted by /u/hugthemachines [link] [comments]