AI & ML
Pairwise Distortion Distribution with Graph-Based Importance Sampling for Quantization Error and Intrinsic Dimension Estimation
arXiv math.IT0 views
arXiv:2611.04341v1 Announce Type: new Abstract: Quantifying the dimensionality of data is a fundamental need in machine learning and signal processing applications such as representation learning, data compression, and inverse problems, where the extrinsic dimension in which the data is presented can be very different from the intrinsic dimension that determines the operational performance. Various concepts, such as R\'enyi information dimension, rate-distortion dimension, and quantization dimension are useful here. Despite their theoretical significance, estimating these measures are challenging given their asymptotic definitions. Recent research has shown that analyzing the pairwise distortion distribution (PDD) of a data source can provide a tractable lower bound on the distortion of random codebook quantization, from which a tractable notion of intrinsic dimension can be derived. In this paper we extend this line of research in three main ways. First, we develop a related upper bound on distortion of random codebook quantization. Second, we improve the computability of both the lower and upper bounds, using a graph-based adaptive importance sampling approach. Third, we leverage the bounds to define new notions of intrinsic dimension which form upper and lower bounds on the R\'enyi information dimension, rate-distortion dimension, and quantization dimension, and which can be empirically estimated from unknown data sources. We illustrate the concepts by analyzing several artificial and empirical distributions.
Source:https://arxiv.org/abs/2611.04341PreviousOptimal Communication for Distributed Sparse Histogram AggregationNextEstimating the generator of matrix exponential time-series
Related posts
AI PACs spent millions trying to shape Congress. Here’s how they fared.
0TechCrunch
How We Processed 600 Real Tax Invoices in 4.5 Minutes Using a Dual-Engine Gemini AI & Vertex AI Architecture
0dev.to
Vom Voxel-Stadtplan zum begehbaren Protein: Was Warschau in Voxeln Entwickler:innen über immersive Visualisierung lehrt
0dev.to
Performance review season: a short about the self-review you can't remember writing material for, and the weekly note I use now
0dev.to
Ask HN: What your experience with the monthly "who wants to be hired" thread?
0Hacker News

Apple TV reportedly getting Justin Timberlake docuseries, announces new Toni Collette show
09to5Mac