AI & ML
Sigmoid Tensor Decomposition for Compact Representations of Binary Data
arXiv cs.NA0 views
arXiv:2611.08020v1 Announce Type: new Abstract: Nonlinear low-rank decompositions are receiving growing attention as a way to represent structured data with fewer parameters than conventional linear methods. Existing nonlinear approaches have focused mainly on matrices, which limits their ability to capture multidimensional structure. We propose a nonlinear tensor decomposition based on sigmoid nonlinearization in the Tucker and tensor-train formats. A binary tensor is represented by a low-rank real-valued score tensor, whose parameters are estimated by minimizing the binary cross-entropy loss. The resulting optimization problem is jointly nonconvex, but becomes convex with respect to one factor or score block when the remaining factors are fixed, as in the corresponding matrix case. We evaluate the method on several structured binary tensors and compare it with conventional Tucker and tensor-train decompositions across a range of common ranks. These results indicate that sigmoid nonlinearization is particularly effective in the low-rank regime, where it can provide more accurate binary reconstructions than conventional linear tensor decompositions at comparable model sizes.
Source:https://arxiv.org/abs/2611.08020PreviousLithoSAGE: Spatially Adaptive and Geometrically Equivariant Neural Operators for Computational LithographyNextA Second-Order Semi-Implicit Projection Time-Stepping Scheme for the Shallow-Water Equations on the Sphere Using Compatible Finite Elements
Related posts
I Handed My Business to Four Different AIs Today. Two of Them Invented Facts. Here's the System That Caught Them.
0dev.to
Two kinds of show me another one
0dev.to
Looking a word up, and looking a claim up
0dev.to
AI is dramatically accelerating AI research
0Hacker News

Russian Federal State Statistics Service says it was hit by massive cyberattack — hackers steal 23TB of data, including Ukraine war casualty figures
0TechRadar

Friday’s Android app deals and freebies: Wreckfest, Kingdom Rush 5, Rites of Conquest, more
09to5Google