AI & ML
Characterizing M-estimators using canonical divergences from information geometry
arXiv stat.TH0 views
arXiv:2611.18141v1 Announce Type: new Abstract: On Euclidean space, the losses that produce consistent M-estimators of a functional are its strictly consistent scoring functions (Dimitriadis, Fissler and Ziegel, 2024), and Osband's principle characterizes these through identification functions, which define method-of-moments estimators. We extend this characterization to the probability simplex. We define the residual, which on Euclidean space is a subtraction, as the inverse exponential map of an affine connection. It identifies the exponential barycenter of the connection: the arithmetic, normalized geometric and Fr\'echet means for the mixture, exponential and Levi-Civita connections. Its integral along geodesics is the canonical divergence of Ay and Amari (2015). A geometric form of Osband's principle decides which losses each connection admits. For the flat connections every strictly convex generator yields a consistent Bregman loss. For the curved $\alpha$-connections, half the squared Fisher-Rao distance is (up to scale) the only consistent loss for the Fr\'echet mean, and for $\alpha \notin \{-1, 0, 1\}$ no such loss exists and only the method of moments remains. The residual is integrable only at $\alpha = 0$, sharpening the integrability claim of Ay and Amari. The characterization yields the estimating equations of regression on the simplex and the calibration decomposition of compositional forecasts.
Source:https://arxiv.org/abs/2611.18141PreviousStatistical guarantees for signature kernel ridge regressionNextCausal and conditional tail coefficients: asymptotics, inference and graph recovery
Related posts

How to Use Git Stash Step by Step
0dev.to Git
GenTUS: Table Union Search via Constrained Generation of Semantic Table Identifiers
0arXiv cs.DB
Larch: Learned Query Optimization for Semantic Predicates
0arXiv cs.DB
Use-case-driven ontology modeling with the NeOn methodology for ambient assisted living
0arXiv cs.DB
Enhancing Quality of Experience in Future Telecommunication Networks: A Review of Frameworks and Machine Learning Algorithms
0arXiv cs.NI
Who sets the consent signal? Platform defaults and crawl coverage in measuring opt-outs from AI training
0arXiv cs.NI