Uber Eats 重建搜索流水线,端到端延迟降低 50%
原标题:Uber Eats Rebuilds Search Pipeline to Cut End-to-End Latency by 50%
AI 摘要
Uber 重建了 Uber Eats 搜索流水线,端到端搜索延迟降低 50%。改动覆盖检索、特征填充、排序、广告、展示和基础设施,并借助 agentic 编码工作流识别、基准测试和验证优化项。Uber 还改用 Above-the-Fold 完成时间作为主要延迟指标,并探索端到端微批处理、基于产品的检索、Zero Pass Ranking 和 HTTP 多部分流式传输,早期测试显示 p99 延迟降低超过 50%。
正文节选
Uber has rebuilt major parts of the Uber Eats search pipeline and reports a 50% reduction in end-to-end search latency. The changes span retrieval, feature hydration, ranking, advertising, presentation, and infrastructure, while an agentic coding workflow was also used to identify, benchmark, and validate additional optimizations. The work began with a change in the primary latency metric. Instead of focusing on backend API response time, Uber began measuring Above-the-Fold completion, defined a