PRIME:面向结构化文档检索的预检索索引建模与增强
原标题:PRIME: Pre-Retrieval Index Modeling Enhancement for Structured Document Retrieval-Real
AI 摘要
香港科技大学(广州)的研究者提出 PRIME,一个面向结构化文档检索的索引侧优化框架,包含 LLM 驱动的语义重构(SR)与确定性的元数据合成(MS)加分层检索(HR)两条路径。实验显示确定性元数据在匹配结构感知分块检索质量的同时,将嵌入计算降低 45.8 倍、索引向量数减少 22.4 倍;语义重构在全量部署下进一步将 Answer-F1 提升 13.7%。在 QASPER、BRIGHT、NFCorpus 上,研究还识别出三种决定索引侧优化是否有效的语料情形,并发现强交叉编码器重排器会中和这些收益。
正文节选
PRIME: Pre-Retrieval Index Modeling & Enhancement for Structured Document Retrieval Abstract High-precision retrieval over external knowledge bases is essential for LLM agents to operate effectively. However, existing Information Retrieval (IR) research primarily optimizes query-side retrievers (e.g., ColBERT, BGE) and generators (e.g., Self-RAG, GraphRAG), while reducing corpus-side representation to chunking. This leaves index-side quality an underexplored lever. We propose Pre-Retrieval Index