Optimizing Remote Decision-Making Under Random Delay: An Age-Aware Markov Decision Process Approach

The paper proposes an age-aware remote Markov Decision Process (MDP) framework to explore the direct causal relationship between Age of Information (AoI) and the utility of the remote decision-making process. It shows that the age-aware remote MDP can be reduced to a standard MDP without delays, and reveals that treating AoI solely as a metric for optimization is not optimal in achieving remote decision making. Instead, AoI can serve as important side information to facilitate remote decision making.