AI & ML
Improving Contextual Retrieval for Long Documents using Semantic Chunking and Hybrid Retrieval Strategies
arXiv cs.IR0 views
arXiv:2611.08498v1 Announce Type: new Abstract: The vast amount of information available in lengthy, distributed documents makes finding relevant answers difficult, especially when the answer requires connecting evidence from multiple sources. Standard Retrieval-Augmented Generation (RAG) systems often struggle with this type of "multi-hop" reasoning and frequently face issues with context fragmentation. In this paper, we propose a hybrid RAG framework that integrates the structured reasoning of knowledge graphs with the broad semantic coverage of dense vector retrieval. Our approach employs a multi-stage pipeline using transformer-based summarization and semantic chunking to improve context retention. We construct a dynamic knowledge graph to capture explicit relationships between entities while simultaneously maintaining a dense vector index. During inference, the system uses a hierarchical mechanism that prioritizes graph traversal for precision and falls back to vector retrieval when necessary. We evaluated our framework on the MultiHop-RAG dataset. The results show that this hybrid approach outperforms standalone vector and graph-based baselines, achieving higher Exact Match scores and improved retrieval accuracy for complex queries. This confirms that merging structured reasoning with standard vector retrieval creates a more robust system for handling complex knowledge-intensive questions.
Source:https://arxiv.org/abs/2611.08498PreviousAugmentation with Dilution? A Large-Scale Empirical Study of Human Contributor Ecosystems After AI Coding Agent AdoptionNextRedMall: Generative Recommendation for Large-Scale E-commerce
Related posts
DeepRitzSplit: A Variational Neural Operator Framework for Gradient Flows with Application to Dendritic Growth
0arXiv cs.NA
Quantitative Universal Approximation for Noisy Quantum Neural Networks
0arXiv cs.NA
Vertex interpolation by bivariate $C^1$ cubic splines: counterexamples, geometric stability, and indecomposable defects
0arXiv cs.NA
Adaptive refinement based on local approximation power of hierarchical spline spaces
0arXiv cs.NA
Discrete hypocoercive estimates for discontinuous Galerkin methods: application to the Vlasov-Poisson-Fokker-Planck system
0arXiv cs.NA
Novel technique based on L\'eja Points Approximation for Log-determinant Estimation of Large matrices
0arXiv cs.NA