AI & ML
A Reinforcement Learning Approach to Space-Filling Input Design for Nonlinear System Identification
arXiv cs.SY0 views
arXiv:2611.18229v1 Announce Type: new Abstract: In this paper, we propose a reinforcement learning (RL) approach to space-filling input design for nonlinear system identification, in which an agent learns a control policy that actively drives the system to explore its state space. Classical input design, developed mainly for linear models, minimises the covariance of the estimated parameters. For nonlinear black-box models, however, the dominant error is the bias induced by the model structure over the region of interest, which motivates space-filling strategies that seek to cover the system state space. Existing space-filling approaches rely on predefined input signal classes and require solving explicit optimisation problems. Unlike these methods, the proposed approach requires no input class to be selected and no frequency band to be tuned for the system at hand, satisfies an amplitude bound by construction, and adapts to varying initial conditions through its observation-based policy without re-optimisation. The learned excitation signals exhibit physically meaningful behaviours, such as resonance excitation and amplitude modulation. The approach is evaluated against tuned swept sine and crest-factor-optimised multisine excitations, and against a state-of-the-art space-filling multisine design, on two nonlinear benchmark systems: a mass-spring-damper with nonlinear stiffness and a Van der Pol oscillator. Under the same amplitude bound, the learned policy achieves the best overall space-filling performance on both systems and distributes its samples more uniformly than the state-of-the-art design.
Source:https://arxiv.org/abs/2611.18229PreviousCharacterisation of the DQsym Framework Against Harmonic State-Space and Dynamic Phasor Models for Modular Multilevel ConvertersNextLinear Modeling of Hybrid Shipboard Power Systems under Pulsed Power Load Operation
Related posts

'Slow Horses' to Hit 10-Season Milestone With Apple TV Renewal
0MacRumors

Apple's New HomeView Smart Home Hub Has Some Issues, Say Owners
0MacRumors

Adobe's Black Friday Sale Takes 57% Off Creative Cloud Pro for Your First Year
0MacRumors
Who Is Anthropic Kidding?
0Hacker News New
Is it OK to write blog posts with AI yet?
0Hacker News New
SatBench a Benchmark of AI Benchmarks
0Hacker News New