General
Bregman geometry in regular exponential families: dual representations and relative smoothness
arXiv stat.ML0 views
arXiv:2611.18480v1 Announce Type: new Abstract: Regular exponential-family distributions are ubiquitous in statistics due to their appealing and convenient properties. Notably, they can be expressed in terms of Bregman divergences, revealing fundamental connections between statistics, convex analysis, and information geometry. However, this geometric structure has not been systematically exploited to characterize these distributions with respect to their expectation parametrization. Building on a projective characterization, we establish a general construction of equivalent dual Bregman representations, together with normalization and uniqueness results. These representations express log-densities as ordinary Bregman divergences in dual coordinate systems, providing geometric characterizations of the parameter space. So-called $\beta$- and $\alpha$-scaled dual representations emerge as particular instances of this framework. We further derive dual Bregman representations of conjugate priors and establish that they preserve conjugacy. Applications to classical distributions illustrate the geometric structures underlying seemingly different statistical models. Moreover, we show that these representations provide natural reference geometries for establishing relative smoothness of the primal Bregman representation of the distribution, with explicit bounds that are sharp in the scalar and separable settings. An illustrative application to the Poisson distribution sheds new light on several works in the literature, providing complementary geometric justifications for reference geometries while deriving existing algorithms.
Source:https://arxiv.org/abs/2611.18480PreviousContrastive latent representation learning with denoising score matchingNextElliptic Sampling: Optimal Interpolant Schedules for Gaussians and Beyond
Related posts

Intel sued by shareholders for misleading investors after stock plunges 29%
0Tom's Hardware
As El Niño builds, studies of extreme marine heatwaves must start now
0Nature News
Delivery drones are coming. For some with PTSD, that's a terrifying prospect.
0Ars Technica

North America and UK are among worst for indoor mobile signal, study finds
0TechRadar

Fable 5.2 creates an underwater world in a browser in only 96 KB
0Tom's Hardware

Grab a beginner-friendly Anycubic 3D printer for under $300, back at its record-low price
0Tom's Hardware