AI & ML
A Control Barrier Function-Constrained Model Predictive Control Framework for Safe Reinforcement Learning
arXiv eess.SY0 views
arXiv:2604.06463v2 Announce Type: replace Abstract: Ensuring safety under unknown and stochastic dynamics remains a significant challenge in reinforcement learning (RL). In this paper, we propose a model predictive control (MPC)-based safe RL framework, called Probabilistic Ensembles with CBF-constrained Trajectory Sampling (PECTS), to address this challenge. PECTS jointly learns stochastic system dynamics with probabilistic neural networks (PNNs) and control barrier functions (CBFs) with Lipschitz-bounded neural networks. Safety is enforced by incorporating learned CBF constraints into the MPC formulation while accounting for the model stochasticity. This enables probabilistic safety under model uncertainty. To solve the resulting MPC problem, we utilize a sampling-based optimizer together with a safe trajectory sampling method that discards unsafe trajectories based on the learned system model and CBF. We also derive a finite-horizon exit-probability bound using tail information for centered barrier increments. We validate PECTS in various simulation studies, where it outperforms baseline methods.
Source:https://arxiv.org/abs/2604.06463PreviousSystem-wide Dynamic Performance Metric for Converter-Dominated Power SystemsNextRCOA Extension and Applications
Related posts
Geometric Refinement and Distributional Alignment for Sim2Real Roadside LiDAR Detection
0arXiv cs.RO
D-VLA: A High-Concurrency Distributed Asynchronous Reinforcement Learning Framework for Vision-Language-Action Models
0arXiv cs.RO
Beyond Trajectory Similarity: Evaluating Surgical Planning by Protocol Adherence
0arXiv cs.RO
HEIR: Harness Egocentric Intent for Human-Robot Interactions
0arXiv cs.RO
EmbodiExp: Compositional Experience Transfer for Embodied Agents
0arXiv cs.RO
The Missing Touch: Sensing and Displaying Localized Contact Geometry Brings Teleoperation Closer to Human Dexterity
0arXiv cs.RO