AI聊天能取代传统搜索吗?基于RAG的现场活动实验证据
原标题:Can AI Chat Replace Traditional Search? Evidence from a RAG-based Live Events Experiment
AI 摘要
研究者开展了一项预注册的激励在线实验,让参与者在从大型现场活动平台抓取的数千个活动目录中搜索,对比传统属性筛选界面(Filter)、基于RAG的生成式AI聊天界面(Chat)以及两者结合的混合界面(Hybrid)。结果显示Chat表现最差,且该结论在gpt-4.1-mini、gpt-5.2、gpt-5.4多个模型下稳健,主要影响开放式探索型用户;Filter与Hybrid之间无显著差异。作者指出Chat存在回音室效应和提示疲劳两个机制,认为AI应作为筛选式搜索的补充而非替代。
正文节选
Working Paper \JOURNALshort \RRHFirstLine\theRUNAUTHOR: \theRUNTITLE\LRHFirstLine\theRUNAUTHOR: \theRUNTITLE\RRHSecondLine\LRHSecondLine Can AI Chat Replace Traditional Search? Evidence from a RAG-based Live Events Experiment Abstract Conversational AI tools are being increasingly integrated into online search and browsing interfaces. To understand how such tools affect user behavior and search outcomes, we run a pre-registered, incentivized online experiment in which participants search a catal