AI RESEARCH

MDPs with a State Sensing Cost

arXiv CS.LG

ArXi:2505.03280v3 Announce Type: replace In many practical sequential decision-making problems, tracking the state of the environment incurs a sensing/communication/computation cost. In these settings, the agent's interaction with its environment includes the additional component of deciding when to sense the state, in a manner that balances the value associated with optimal (state-specific) actions and the cost of sensing.