Backend
A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems
arXiv eess.SY0 views
arXiv:2607.02050v3 Announce Type: replace-cross Abstract: Motivated by the challenge of stabilizing a general unknown linear dynamical system (LDS) from observations, we study the natural prerequisite of online prediction. Our goal is to achieve sublinear regret with a memory footprint that adapts to the intrinsic complexity of the dynamics rather than the full hidden-state dimension. We focus on the practically central regime of systems with low instability complexity -- eigenvalues outside the real stable interval that do not decay rapidly, together with non-semisimple modes -- potentially embedded in an otherwise stable real spectrum of much higher dimension; we write $k$ for this count. This regime is the primary setting in which stabilization is plausible: we show that many systems with high instability complexity cannot be stabilized without exponentially large controls. Thus, prediction is meaningful for stabilization precisely when the instability complexity is small. Within this regime, we introduce a unified online algorithm that handles every LDS (including non-diagonalizable systems with complex or exploding modes) with a learnable parameter count of $\widetilde{O}(k)$. Finally, we prove a lower bound showing that $k$ is a valid complexity measure: any filter-based predictor needs at least $k$ filters. Experiments corroborate our theory: on a high-dimensional system, our predictor sharply outperforms prior methods at an equal parameter budget.
Source:https://arxiv.org/abs/2607.02050PreviousBeyond Benchmarks: Continuous Edge Inference for Traffic Sign Recognition on Embedded Vehicular HardwareNextRADAR Perception for Dynamic Obstacle Avoidance onboard small-scale Quadrotor UAVs
Related posts
A structure-preserving semi-implicit finite volume scheme on vertex-staggered unstructured meshes
0arXiv cs.NA
Descending Everest, Part II: Oracle Complexity of Minimizing a Sum of Convex $(L_0,L_1)$-Smooth Functions
0arXiv stat.ML
Black-box model classification under the discriminative factorization
0arXiv stat.ML
Matrix Factorization Framework for Community Detection under the Degree-Corrected Block Model
0arXiv stat.ML
Guidance for Prior Change via Density Ratio Estimation
0arXiv stat.ML
Action-BED: Task-Driven Bayesian Experimental Design with Singly Intractable Objectives
0arXiv stat.ML