Docling Alternatives in OWUI

r/LocalLLaMA
Generative AI

Hey all, Just updated to a 9070xt and still using docling in the docker container using CPU. Looking for docling alternative, thats faster or at least use vulkan or rocm. Im really only using it to review and read my assignments embedding model is octen-4b-Q4_K_M. It appears that docling is taking ages before it puts the data into the embedding model, would like to make it faster and open to suggestions. as i am a beginner. submitted by /u/uber-linny [link] [comments]