Sci-VBench：评估科学领域知识推理视频生成的新基准
原标题：Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains
AI 摘要
Hugging Face 发布了 Sci-VBench，一个用于评估科学领域视频生成的基准，包含 1253 个专家标注示例，覆盖自然科学、医疗、人文社科和工程四个学科。该基准采用基于规则的评估协议，发现非专家和 MLLM 评审与专家判断高度一致。对 16 个前沿模型的评估显示，视觉质量分数接近，但提示遵循和科学因果正确性差异显著，且闭源模型优于开源模型。
正文节选
Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains Abstract We introduce Sci-VBench, a comprehensive benchmark for evaluating knowledge- and reasoning-intensive video generation across scientific domains. It contains 1,253 expert-annotated examples spanning 60 subjects across four core disciplines: Natural Science, Healthcare, Humanities & Social Sciences, and Engineering. Each example requires models to generate temporally rich videos that demand scien