Frontend
GP--RL--MPC: Uncertainty-Aware Reinforcement Learning-Augmented Model Predictive Control with Gaussian Process Postdecision State-Value Functions
arXiv eess.SY0 views
arXiv:2611.22038v1 Announce Type: cross Abstract: We propose Gaussian Process Reinforcement Learning-Augmented Model Predictive Control (GP--RL--MPC), which uses a learned critic as the MPC terminal penalty to account for costs beyond the prediction horizon. Gaussian process regression (GPR) enables data-efficient critic learning from limited, noisy rollouts within optimistic approximate policy iteration (OAPI), with soft updates mitigating policy chattering. A tunable risk coefficient weights GP epistemic uncertainty in the terminal cost, regulating sensitivity to uncertain critic predictions. The postdecision state formulation shifts disturbance averaging offline to account for aleatoric uncertainty from the terminal transition onward. Under matching objectives and admissible actions, a one-step horizon recovers greedy value-space RL. After fitting GP hyperparameters by exact marginal likelihood, we construct a sparse deterministic training conditional (DTC) posterior using inducing points selected by pivoted Cholesky (PC), reducing online evaluation costs as the training dataset grows. In a continuous stirred-tank reactor (CSTR) subject to exogenous disturbances, GP--RL--MPC with an appropriately selected risk coefficient and policy screening reduces the sum of squared errors (SSE) by an average of 80.52% relative to an otherwise matched baseline MPC across five random seeds (sample standard deviation: 3.48%).
Source:https://arxiv.org/abs/2611.22038PreviousCausal Input--Output Modeling with Prior InformationNextCRA: Continuous Risk Assessment for Safety-critical Visual Navigation
Related posts
クラウド同期をやめて、社内にファイルサーバを戻した話(単一バイナリのファイルブラウザ 榕樹 Banyan)
0dev.to
Movetio is live: from open test to v1.0
0dev.to

Retrieval Ran First. Was Its Result Actually Ready?
0dev.to
The Most-Broken Package on Our New Site Never Actually Broke
0dev.to
The Air Says +5 C. The Road Says -1. Surface Temperature From 3,501 Stations in 10 Countries.
0dev.to
When Everything Has Changed, What Do We Do Next?
0CSS-Tricks