AI RESEARCH
Vidya: An AI-Driven Modular Pipeline for Archival Automation and Semantic Metadata Enrichment
arXiv CS.CL
•
ArXi:2605.16338v1 Announce Type: cross The large-scale digitization of historical archives has created a paradox: "dark data"-digital objects lacking metadata for retrieval. Manual archival description is slow and expensive, limiting discovery and reuse. We propose Vidya, a modular pipeline that orchestrates Large Language Models (LLMs) and FOSS tools to automate semantic enrichment and archival ingestion at scale. Vidya constrains generations using YAML-defined ontologies and Pydantic validation, producing deterministic, structured JSON outputs from probabilistic models.