AI & ML
Assessing model calibration with boosting trees
arXiv stat.TH0 views
arXiv:2606.08084v2 Announce Type: replace Abstract: The main goal in regression modelling consists in approximating the conditional mean of a response given a set of features. A regression function is said to be strongly calibrated if the resulting mean estimates match the true conditional means for almost every set of features. Aiming for strong calibration seems not achievable in practice as one typically deals with finite samples of noisy observations. A weaker notion of calibration is auto-calibration, and it means that the conditional expectation of the response, given a mean estimate, matches this estimate. This notion is important, e.g., in insurance pricing as it ensures no cross-subsidization between different price cohorts. In this paper, we show that boosting trees can be used to test necessary conditions for strong calibration and auto-calibration, respectively. The practical relevance of our approach is supported by a numerical example, in which the proposed tests achieve high empirical power.
Source:https://arxiv.org/abs/2606.08084PreviousOn the Validity of Fisher Randomization Tests under the Weak NullNextNonparametric Regression on Fixed-Cardinality Subsets:Minimax Risk and Random-Design Effects
Related posts
20x longer: Google's 'temporary' AI chats last 2 months
0dev.to Discuss
How I stopped guessing: confused about whether to submit a bid or a proposal and
0dev.to Discuss
Scalenut Review: Features, Pricing, Pros, Cons, and Alternatives
0dev.to Productivity
Xelta AI: The All-in-One AI Creative Platform Transforming How Content Is Created
0dev.to Productivity
How to Make AI Writing Sound More Human: A Guide to Authentic Content Creation
0dev.to Productivity
Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
0arXiv eess.IV