What is Hybrid search in RAGs?
Dev.to AI
•
Generative AI
AI Tools
⚠️Need of Hybrid Search We have documents containing error codes in python with their respective definitions and use-cases. User writes a query to know about "What is ERR_404_AUTH?" Classic Rag: Will retrieve all the authentication and error related context it can find from vector db (document embeddings). 🛠️Using BM25 Take BM25 as extended version of TF-IDF for key-word based search. The step-wise implementation of BM25 in LangChain is straightforward because LangChain provides a built-in BM25Retriever. Here is the step-wise implementation alongside the intuition.