AI RESEARCH

Optimal sequential decision-making for error propagation mitigation in digital twins

arXiv CS.LG

ArXi:2604.22168v1 Announce Type: new Here, we explore the problem of error propagation mitigation in modular digital twins as a sequential decision process. Building on a companion study that used a Hidden Marko Model (HMM) to infer latent error regimes from surrogate-physics residuals, we develop a Marko Decision Process (MDP) in which the inferred regimes serve as states, corrective interventions serve as actions, and a scalar reward that takes into consideration the cost-benefit tradeoff between system fidelity and maintenance expense.