Business Arena：在真实市场中评估 LLM 代理的商业智能
原标题：Business Arena: Benchmarking LLM Agents in a Realistic Marketplace
AI 摘要
Hugging Face 每日论文发布了一篇关于 Business Arena 基准的论文，该基准用于评估 LLM 代理在真实跨境市场中的商业运营能力。研究发现，15 个前沿模型在最终净资产上存在九倍差异，即使最佳模型也落后于人类设计的策略，表明商业运营对 LLM 代理仍具挑战性。该基准基于真实的阿里巴巴采购数据和市场条件，并提供技能级分析和动作级归因，以诊断代理的决策。
正文节选
Business Arena: Benchmarking LLM Agents in a Realistic Marketplace Abstract Business Arena evaluates LLM agents running a realistic cross-border shop, revealing large performance gaps versus human strategies and enabling detailed attribution of business decisions. Running a business is a challenging form of intelligent work. Operators must infer opportunities from partial signals, commit capital under uncertainty, adapt to delayed outcomes in a changing market, and satisfy regulatory obligations