AI & ML
Sigmoid Tensor Decomposition for Compact Representations of Binary Data
arXiv cs.NA0 views
arXiv:2611.08020v1 Announce Type: new Abstract: Nonlinear low-rank decompositions are receiving growing attention as a way to represent structured data with fewer parameters than conventional linear methods. Existing nonlinear approaches have focused mainly on matrices, which limits their ability to capture multidimensional structure. We propose a nonlinear tensor decomposition based on sigmoid nonlinearization in the Tucker and tensor-train formats. A binary tensor is represented by a low-rank real-valued score tensor, whose parameters are estimated by minimizing the binary cross-entropy loss. The resulting optimization problem is jointly nonconvex, but becomes convex with respect to one factor or score block when the remaining factors are fixed, as in the corresponding matrix case. We evaluate the method on several structured binary tensors and compare it with conventional Tucker and tensor-train decompositions across a range of common ranks. These results indicate that sigmoid nonlinearization is particularly effective in the low-rank regime, where it can provide more accurate binary reconstructions than conventional linear tensor decompositions at comparable model sizes.
Source:https://arxiv.org/abs/2611.08020PreviousLithoSAGE: Spatially Adaptive and Geometrically Equivariant Neural Operators for Computational LithographyNextA Second-Order Semi-Implicit Projection Time-Stepping Scheme for the Shallow-Water Equations on the Sphere Using Compatible Finite Elements
Related posts
Best AI tools to add vocals to your own beat (2026)
0dev.to

How to Keep Product Information in Sync Across a Multilingual Website
0dev.to
UK Warns Its Critical Infrastructure Faces Grave Risk
0Dark Reading
We tested memory retrieval on DolphinBench. Plain keyword search exposed our own regression.
0dev.to
Global stocks tumble as AI panic grips markets after Democrats' midterm success
0Hacker News
Turning GPT GIFs into a cat film: what smoothing fixed, and what it didn’t
0dev.to AI