AI & ML
Arbitrary-Accuracy Neural Approximation with Optimal Neuron Count and Optimal Bit Complexity
arXiv stat.ML0 views
arXiv:2609.35628v2 Announce Type: replace-cross Abstract: We study the minimum number of hidden neurons required for arbitrary-accuracy approximation of continuous functions on $[0,1]^d$ and the associated encoding complexity. For $d\geq 2$, we construct two fixed, explicitly defined activation functions and, for each, a closed-form network with two hidden layers of widths $d$ and $1$ that achieves arbitrary accuracy in the uniform norm. We prove that $d+1$ is the exact minimum total number of hidden neurons among standard feedforward networks with locally integrable activations and affine outputs. We further give a simpler construction using a single elementary activation that combines the floor and exponential functions. This construction requires three hidden layers of widths $d$, $1$, and $2$. If a skip connection is allowed, widths $d$, $1$, and $1$ suffice. For a bounded $\alpha$-H\"older class with $\alpha\in(0,1]$, the networks with the digit-extraction activation and with the elementary activation require $O(\varepsilon^{-d/\alpha}\log(1/\varepsilon))$ bits, matching the metric-entropy lower bound up to a logarithmic factor. The other $(d,1)$ network, which stores differences of neighboring values along a spanning tree, needs only $\Theta(\varepsilon^{-d/\alpha})$ bits and is optimal in both neuron count and bit complexity.
Source:https://arxiv.org/abs/2609.35628PreviousPrior-Amortized In-Context Bayesian Inference for Generalized Linear Mixed-Effects ModelsNextPragmatic DML with AI-Learned Representations
Related posts
Which app should you drive for? Compare them by net profit per hour, not by the payout
0dev.to Career
Who is hiring AI engineers right now? 682 companies, from OpenAI to ServiceNow (November 2026)
0dev.to Career
Who is hiring in the US right now? 2,991 companies and 113,000 open jobs (November 2026)
0dev.to Career
I opened three small services on Gumroad — voiceover, proofreading, and minimal logos
0dev.to Career
Why I Test My Downloader on a Real Android Phone, Not Just Desktop Chrome
0dev.to PHP

Day 2 of my 15-Day Graphic Design Challenge: From Rough Ideas to a Moodboard
0dev.to Beginners