32k documents RAG running locally on an RTX 5060 laptop ($1299 AI PC)
r/LocalLLaMA
•
Generative AI
AI Hardware
AI Research
Quick update to a I posted earlier. Previously the system handled ~12k documents. Now it scales to ~32k documents locally. Hardware: ASUS TUF Gaming F16 RTX 5060 laptop GPU 32GB RAM ~$1299 retail price Dataset in this: ~30k PDFs under ACL-style folder hierarchy 1k research PDFs (RAGBench) ~1k multilingual docs Everything runs fully on-device. Compared to the previous post: RAG retrieval tokens reduced from ~2000 → ~1200 tokens. Lower cost and suitable for AI PCs / edge devices.