AI & ML
Improved estimation of differential entropy of a multivariate Gaussian distribution
arXiv stat.TH0 views
arXiv:2610.41849v1 Announce Type: new Abstract: We consider estimation of entropy of a multivariate variate normal distribution with unknown mean vector and unknown covariance matrix. Using a decision-theoretic approach, we study the problem under a general location-invariant loss function that is strictly convex and minimized at zero. We first characterize the class of affine equivariant estimators and obtain the best affine equivariant estimator. We further show that the best affine equivariant estimator is inadmissible under the general loss. Exploiting information in the sample mean, we derive Stein-type improved estimators, including an extension to the case of a mean matrix. Under the linex loss, we obtain a smooth Brewster--Zidek-type estimator that dominates the best affine equivariant estimator, and we show that this estimator is generalized Bayes under a suitable non-informative prior.
Source:https://arxiv.org/abs/2610.41849PreviousBethe Hessian Recovery through the Kesten-Stigum RegimeNextOn Statistical-Computational Gaps in Graph Combinatorial Testing Problems
Related posts
DeepRitzSplit: A Variational Neural Operator Framework for Gradient Flows with Application to Dendritic Growth
0arXiv cs.NA
Quantitative Universal Approximation for Noisy Quantum Neural Networks
0arXiv cs.NA
Vertex interpolation by bivariate $C^1$ cubic splines: counterexamples, geometric stability, and indecomposable defects
0arXiv cs.NA
Adaptive refinement based on local approximation power of hierarchical spline spaces
0arXiv cs.NA
Discrete hypocoercive estimates for discontinuous Galerkin methods: application to the Vlasov-Poisson-Fokker-Planck system
0arXiv cs.NA
Novel technique based on L\'eja Points Approximation for Log-determinant Estimation of Large matrices
0arXiv cs.NA