Open Source
Spectral Vision Transformer for Efficient Tokenization with Limited Data
arXiv eess.SP0 views
arXiv:2605.12026v2 Announce Type: replace-cross Abstract: Vision transformers tokenize an image into patches, which couples the token count to resolution and requires the embedding to be learned from data. We propose a spectral vision transformer architecture for efficient tokenization in the limited-data regime, with an emphasis on medical imaging. Rather than using spatial patches, we tokenize into coefficients of a fixed basis. This approach defines each token as one spectral mode, and the sequence length is chosen rather than implied by resolution, reducing the cost of attention. Our proposed spectral ViT shows superior or comparable performance where data is scarce in public medical imaging benchmarks, natural images, object shapes, simulations, and protected clinical data. We release our code at: https://github.com/agr78/SpectralViT.
Source:https://arxiv.org/abs/2605.12026PreviousA Continuous Payload-Bearing Discrete Multitone Modulation Framework for Fiber-Optic Integrated Sensing and CommunicationNextOmni-modal decomposition autoencoders learn full-stack wearable disentangled representations
Related posts
Are You Buying a Company or a model_id?
0dev.to Discuss
How to Test a Resistor, Diode, LED and Capacitor with a Multimeter (Before You Blame Your Code)
0dev.to Beginners
Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations
0arXiv eess.SP
Gaussian Quasi-Likelihood Estimation for Nonsynchronously Observed L\'evy processes
0arXiv stat.TH
Triple Overlap in Pipelined Krylov Methods on Multi-GPU Systems
0arXiv cs.DC
Rhythm-TTS: High-Fidelity Shortcut Latent Modeling and Probabilistic Rhythm Generation for Zero-Shot Text-to-Speech
0arXiv cs.SD