AI & ML
Nonlinear compressive reduced basis approximation : when Taylor meets Kolmogorov
arXiv cs.NA0 views
arXiv:2601.13712v2 Announce Type: replace Abstract: This paper investigates model reduction methods for efficiently approximating the solution of parameter-dependent PDEs with a multi-parameter vector $\vec{\mu} \in \mathbb{R}^p$. In cases where the Kolmogorov $N$-width decays fast enough, it is effective to approximate the solution as a sum of $N$ separable terms, each being the product of a parameter-dependent coefficient and a space-dependent function. This leads to reduced-order models with $N$ degrees of freedom and complexity of order ${\mathcal O}(N^3)$. However, when the $N$-width decays slowly, $N$ must be large to achieve acceptable accuracy, making cubic complexity prohibitive. The linear complexity measure in terms of Kolmogorov width must be replaced by the Gelfand width, with its associated sensing number. Recent nonlinear approaches based on this notion decompose the $N$ coordinates into two groups: $n$ free variables and $\overline{n}$ dependent variables, where the latter are nonlinear functions of the former ($N= n+\overline n$). Several works have focused on cases where these $\overline{n}$ functions are homogeneous quadratic forms of the $n$ variables, with optimization strategies for choosing $n$ given a target accuracy. A rigorous analysis of the local sensing number is carried out, showing that $n = p$ is optimal and appropriate, at least locally, around a reference point. In practical scenarios involving wide parameter ranges, the condition $p\le n \le p + k$ (with $k$ small) is valid and more robust from continuity arguments. Additionally, the assumption of a quadratic mapping, while justified in a local sense, becomes insufficient. More expressive nonlinear mappings-including those using machine learning-become necessary. This work contributes a theoretical foundation for such strategies and highlights the need for further investigations to push back the Kolmogorov Barrier.
Source:https://arxiv.org/abs/2601.13712PreviousOvercoming Spectral Bias via Cross-AttentionNextEfficient construction and explicit dimensionality of Lie group-equivariant and permutation-invariant spaces
Related posts
How I accidentally became a millionaire
0Lobsters
Ultrathin pipes solve space constraints on platforms
0Phys.org Tech
My AI agents found an unmapped Maya site
0Hacker News Best
Gemini Decisions API
0Simon Willison

Anthropic is spending $3.4 billion on natural gas turbines to avoid the AI power crisis
0TechRadar

Jensen Huang now accused of affair with Nvidia executive who reported to him, alleged cover-up attempt — new indiscretion comes in wake of admitted affair with alleged Chinese spy
0Tom's Hardware