AI & ML
High-Dimensional Tail Index Regression
arXiv stat.ML0 views
arXiv:2403.01318v4 Announce Type: replace Abstract: Motivated by the empirical observation of power-law distributions in the credits (e.g., ``likes'') of viral posts on social media, we introduce a high-dimensional tail index regression model and propose methods for estimation and inference of its parameters. First, we propose a regularized estimator, establish its consistency, and derive its convergence rate. Second, we construct a debiased version of the regularized estimator to facilitate inference and prove its asymptotic normality. Monte Carlo simulation studies corroborate our theoretical findings. We apply these methods (1) to the text analysis of viral posts on X (formerly Twitter) and (2) to the analysis of abnormally high health expenditures.
Source:https://arxiv.org/abs/2403.01318PreviousSOTA or Luck? The Winner's Curse in LLM LeaderboardsNextScalable Learning from Probability Measures with Mean Measure Quantization
Related posts

‘It’s a risk’: How Rockstar built the most detailed (and romantic) GTA yet
0The Verge
China dominates battery graphite, but this startup could break the monopoly
0TechCrunch
AI visibility: mentions, recommendations and citations need separate checks
0dev.to
Background AI Makes Inference a Scheduling Problem
0dev.to

DeepSeek vs Claude vs Kimi vs Codex vs Gemini: A 70-Call AI Ethics Test
0dev.to
Fluent English is not evidence of ASL understanding: lessons from building a video translator
0dev.to