Operationalizing Document AI: A Microservice Architecture for OCR and LLM Pipelines in Production

ArXi:2605.18818v1 Announce Type: new Academic research tends to focus on new models for document understanding creating a wide gap in the literature between model definition and running models at production scale. To close that gap, we present a microservice architecture that encapsulates pipelines of multiple models for classification, optical character recognition (OCR), and large language model structured field extraction as well as our experience running this pipeline on thousands of multi-page documents per hour.