AI & ML
LUMIR: Decoupled Multimodal Representation Learning from Heterogeneous Data for Next-POI Recommendation
arXiv cs.IR0 views
arXiv:2611.14004v1 Announce Type: new Abstract: As multimodal tourism-related information collected from heterogeneous data sources has become increasingly available, learning effective representations has attracted attention for improving recommendation performance. Existing approaches often tightly couple multimodal fusion with the architecture and optimization objective of a specific downstream model, which limits the generality and reusability of the learned representations. To address these limitations, we propose LUMIR, a decoupled multimodal representation learning framework based on contrastive learning. Multimodal information collected from heterogeneous data sources is first semantically unified into a shared textual representation space using large language models (LLMs). An interaction-aware fusion mechanism is then designed to model cross-modal interactions, while sequential signals are incorporated as a structural constraint to guide representation learning. To evaluate the learned representations, experiments are conducted on a multimodal point-of-interest (POI) dataset under the next-POI recommendation setting across multiple sequential recommendation backbones. The results show that LUMIR consistently outperforms existing multimodal fusion baselines in both accuracy-oriented and beyond-accuracy metrics, demonstrating that decoupling representation learning from downstream optimization provides an effective paradigm for learning reusable multimodal representations. The code is publicly available at https://github.com/wzehui/LUMIR.
Source:https://arxiv.org/abs/2611.14004PreviousData Quality Challenges in Multimodal Tourism Recommender SystemsNextFrom Show Programs to Linked Data
Related posts

Five Details That Make a Bedroom Feel French, From Someone Who Sells French Bedding
0dev.to Design
User-Friendly Mobile App UX Design – Best Practice & Process
0dev.to Design
The empty states in my app blamed the user, so I wrote a linter for that
0dev.to Design
Generic CRMs made me hate CRM, so I built one with only my trade's stages
0dev.to Productivity
Think Before You Solve: The Importance of Planning in Software Engineering
0dev.to Productivity
Attention Fusion for Bridge Deck Delamination Detection
0arXiv eess.IV