WuYuEval:面向固体废物管理的大语言模型多层级基准
原标题:WuYuEval: A Multi-Level Benchmark for Large Language Models in Solid Waste Management
AI 摘要
WuYuEval是一个针对大语言模型在固体废物管理领域能力评估的多层级基准,包含4590道基础选择题和247道专家级开放式问题。对33个LLM的测试显示,领先模型在基础模块准确率达94.64%,但平均准确率从简单题的84.14%降至难题的42.50%,在计算、实验设计、城市规划和开放式专家任务上表现较弱。推理模式(Thinking)在多数模型对中带来改进,但效果取决于基线能力,并非总是正向。该基准为开发面向固体废物管理的专业基础模型提供了评估资源和实证基础。
正文节选
Computer Science > Computation and Language Title:WuYuEval: A Multi-Level Benchmark for Large Language Models in Solid Waste Management View PDF HTML (experimental) Abstract:Large language models (LLMs) are increasingly used as technical assistants, but their competence in solid waste management (SWM) remains difficult to assess because existing benchmarks emphasize general knowledge rather than professional decisions under engineering, environmental, and policy constraints. We intro