BI-Agent与BI-Bench:迈向端到端商业智能自动化
原标题:BI-Agent and BI-Bench: Towards Automating End-to-End Business Intelligence
AI 摘要
研究者从公开来源收集真实世界BI项目(.pbix文件),人工提取业务问题与标准答案,构建了首个端到端BI基准BI-Bench。测试发现前沿LLM在BI-Bench上准确率不足50%。为此提出工具增强的BI-Agent,将BI工作流分解为搜索、连接、转换等子任务,并开发后训练框架合成训练轨迹,结合SFT和RL进行训练。BI-Agent在BI-Bench上相比原始LLM提升最高40个百分点,后训练版本再提升最高30个百分点。
正文节选
BI-Agent and BI-Bench: Towards Automating End-to-End Business Intelligence Abstract. Business intelligence (BI) is a cornerstone of enterprise decision-making and is widely used by enterprise users in software such as Power BI and Tableau. In traditional BI workflows, users need to prepare data by (1) identifying relevant tables, (2) performing data transformations, and (3) building join relationships, before they can (4) answer their business questions. These steps can be complex and time-cons