General
The Ces\`aro Value Iteration
arXiv cs.SY0 views
arXiv:2504.04889v5 Announce Type: replace Abstract: In this paper, we consider undiscouted infinite-horizon optimal control for deterministic systems with an uncountable state and input space. We specifically address the case when the classic value iteration does not converge. For such systems, we use the Ces`aro mean to define the infinite-horizon optimal control problem and the corresponding infinite-horizon value function. Moreover, for this value function, we introduce the Ces\`aro value iteration and prove its convergence for the special case of systems with periodic optimal operating behavior. For this instance, we also show that the Ces\`aro value function recovers the undiscounted infinite-horizon optimal cost, if the latter is well-defined.
Source:https://arxiv.org/abs/2504.04889PreviousDS3M: Deep structured state space models for nonlinear system identification on modern hardwareNextComfort energy management system for electrified buildings using hydrogen for seasonal storage
Related posts
Former YC President: "Stop!”
0Hacker News
"I can tell you wrote this yourself"
0Hacker News
GIMP now has UI tests
0Hacker News
Kernel Regression using Persistence Diagrams
0arXiv stat.TH
The Scaled Dirichlet Distribution: Lauricella Representations and Estimation
0arXiv stat.TH
Functional Estimation under Local Differential Privacy: General Lower Bounds and Applications to Entropy and Power Sums
0arXiv stat.TH