Backend
Bayesian Tensor Train Kernel Machines with Automatic Model Complexity Inference
arXiv stat.ML0 views
arXiv:2611.07129v1 Announce Type: new Abstract: Tensor Network (TN) kernel machines accelerate supervised learning by using low-rank TNs to reduce computation and memory. However, most TN-based methods are deterministic with manually tuned ranks and feature dimensions, while the existing Bayesian TN kernel machine is restricted to the CANDECOMP/PARAFAC decomposition (CPD), whose single rank is shared by all modes. We extend this framework to the tensor train (TT) and propose Bayesian Tensor Train Kernel Machines (BTT-KM), whose hierarchical ARD-type priors on the TT cores infer the TT ranks and feature dimensions from data. Since each TT core is coupled to the others only through its neighbors, its closed-form posterior update requires propagating the contributions of all other cores along the chain. Mean-field variational inference yields a Bayesian alternating least squares algorithm with the same computational complexity as its deterministic counterpart and a closed-form predictive distribution. A synthetic experiment illustrates that BTT-KM recovers the true TT ranks and feature dimensions from an over-parameterized initialization.
Source:https://arxiv.org/abs/2611.07129PreviousToroFit: Fitting Wedge Sums of Tori to High-Dimensional DataNextShapleyOG: Fast Adaptive Shapley Value Estimation with Odd Gaussian Processes
Related posts

Polars vs pandas: What's the Difference?
0Real Python

Beautiful Soup: Build a Web Scraper With Python
0Real Python
Quiz: LBYL vs EAFP: Preventing or Handling Errors in Python
0Real Python
The Real Python Podcast – Episode #318: Free-Threaded Python: Why Python Devs Should Know About the ABI
0Real Python
Decentralized AI Inference Needs a Boring Job Queue
0HackerNoon

Why SSH Still Matters After More Than 30 Years
0HackerNoon