AI & ML
When Features Beat Noise: A Noise-Driven Hypothesis Testing Method for Feature Selection
arXiv stat.ML0 views
arXiv:2511.20851v4 Announce Type: replace Abstract: Feature selection has remained a daunting challenge in machine learning and artificial intelligence, where increasingly complex, high-dimensional datasets demand principled strategies for isolating the most informative predictors. Despite widespread adoption, many established techniques such as Boruta, Recursive Feature Elimination and other wrapper based methods suffer from notable limitations; some incur substantial computational cost, while others offer no definite statistical driven stopping criteria or assess the significance of their importance scores. This paper proposes a novel feature selection method that addresses these limitations. Our approach introduces multiple random noise features and evaluates each feature's importance against the maximum importance value among these noise features incorporating a non-parametric bootstrap-based hypothesis testing framework to establish a solid theoretical foundation. We establish the conceptual soundness of our approach through statistical derivations that articulate the principles guiding the design of our algorithm. To assess reliability and practical utility, we validated the method on controlled simulations and diverse real-world datasets, where it consistently outperformed established feature-selection approaches including Boruta, Model-X Knockoffs, RFE, LASSO, Elastic Net, and mRMR in recovering meaningful signals. Hence, the method emerges as a robust algorithm for principled feature selection, enabling the distillation of informative predictors that support reliable inference, enhanced predictive performance, and efficient computation.
Source:https://arxiv.org/abs/2511.20851PreviousEquivariant Modeling with Polynomial Features via Minimal Homogeneous GeneratorsNextGenerative modeling of conditional probability distributions on the level-sets of collective variables
Related posts
The draft is not the send
0dev.to Discuss

My First GitHub Issue & My First Forem (DEV.to) Issue 🚀
0dev.to Discuss
Multimodel AI for Business: How to Build a Reliable Video Content Workflow
0dev.to Productivity
Your Thanksgiving flight home is on the busiest travel day of the year
0dev.to Productivity
Audit Week: When Your AI Assistant Knows Your Website Better Than You
0dev.to Productivity

Telegram เตรียม Dictator: AI Agent บน Mac ที่รายงานว่ารันบน Hermes Agent
0dev.to Machine Learning