返回全部动态

OpenCompass v0.5.0 发布:新增科学基准与级联评估器

原标题:0.5.0

OpenCompass Releases一手来源产品发布质量 79

AI 摘要

OpenCompass 发布 v0.5.0 版本,新增了 10+ 科学基准数据集(如 MedXpertQA、ClimaQA、ProteinLMBench),支持级联评估器(Cascade Evaluator)和 Rjob Runner,并改进了 OpenAI SDK 流式支持。该版本还修复了多个 bug,增加了文档和评估示例,并欢迎了多位新贡献者。这些更新增强了模型评估的深度和可靠性。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

# OpenCompass v0.5.0 Release Notes ## 🌟 **Highlights** ✨ **​Comprehensive Scientific Benchmarks**: Integrated 10+ specialized datasets (MedXpertQA, ClimaQA, SmolInstruct, etc.), covering multiple scientific fields such as chemistry, physics, biology, and earth sciences ✨ **Cascade Evaluator**: Supported cascading eval methods from rules to LLM judgments. ✨ **New Runner**: Supported for Rjob Runner has now been completed. ✨ **OpenAISDK Streaming**: Provided a more stable OpenAI API metho


发布时间:2025-09-01 14:20
抓取时间:2026-08-31 00:41
来源机构:Shanghai AI Laboratory
阅读原文github.com