IChart2Code:多模态大模型交互式图表代码生成基准
原标题:IChart2Code: Benchmarking Multimodal Large Language Models for Interactive Chart Code Generation
AI 摘要
重庆大学团队提出 IChart2Code 基准,用于评估多模态大模型生成交互式图表代码的能力,包含 377 个任务、20 种图表形式、13 类数据及 1209 项交互需求。该基准配套基于浏览器的评估协议,设有可执行性门槛及数据保真度、静态视觉正确性、交互正确性三个评分维度,其 MLLM 评判器与人工标注的条目级 F1 达 0.8844。团队还提出轨迹引导的双智能体框架 TRAIL,在四个 MLLM 上平均将四个评估维度较直接提示分别提升 7.89、4.98、3.45 和 4.47 个百分点。
正文节选
IChart2Code: Benchmarking Multimodal Large Language Models for Interactive Chart Code Generation Abstract Interactive chart code generation requires models to reproduce a reference chart’s appearance and underlying data and correctly implement the state changes triggered by specified user interactions. Existing chart-to-code benchmarks focus on static outputs and lack task representations or evaluation protocols for interaction specification, browser execution, and post-interaction verification.