AI & ML
General Frequency Principle for Linear Approximation Classes
arXiv cs.NA0 views
arXiv:2610.41179v1 Announce Type: cross Abstract: In this paper, we study a general frequency principle under gradient descent training for the finite linear approximation classes. Under suitable assumptions, we prove that the learner amplitude relative to the target amplitude vanishes at high frequencies, uniformly throughout training. We also establish sufficient conditions for low-frequency priority, covering single-frequency targets trained separately and two frequency components trained in the same run. This general frequency principle does not imply that lower frequencies always converge faster. Instead, for two frequencies that satisfy certain comparison conditions, one component will take longer to learn than the other; and in common cases, the longer component has higher frequency. Numerical experiments with Legendre and trigonometric bases validate the theoretical results.
Source:https://arxiv.org/abs/2610.41179PreviousKernel-based Interpolatory Methods for Context Compression of Attention MechanismsNextFeature-preserving interface reconstruction using piecewise circles and cusps
Related posts
I Built the Same App With Cursor, Copilot, Codex and Antigravity. Here's What Each Did Best
0dev.to
TailSteer reduces drift in multi‑turn image editing; History Forcing stabilizes long‑horizon video generation
0dev.to
Barkbox Promo Codes and Discounts: Up to 50% Off
0Wired
California’s proposed ‘billionaire tax’ fails to pass
0TechCrunch
UK Biobank 8만 단백질 데이터, 평면 화면으론 답이 안 보였다 — VR 분자 실험실에서 길을 찾다
0dev.to
TryClothAI – Free AI Clothes Changer & Virtual Try-On
0dev.to AI