What is Hybrid search in RAGs?

Dev.to AI
Generative AI AI Tools

⚠️Need of Hybrid Search We have documents containing error codes in python with their respective definitions and use-cases. User writes a query to know about "What is ERR_404_AUTH?" Classic Rag: Will retrieve all the authentication and error related context it can find from vector db (document embeddings). 🛠️Using BM25 Take BM25 as extended version of TF-IDF for key-word based search. The step-wise implementation of BM25 in LangChain is straightforward because LangChain provides a built-in BM25Retriever. Here is the step-wise implementation alongside the intuition.