模态成熟度指数：评估全模态模型多模态能力的基准
原标题：Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models
AI 摘要
arXiv 论文提出 Modality Maturity Index (MMI) 基准，用于评估全模态模型在文本、图像、音频、视频和文档五种模态及其组合上的输入输出能力。MMI 包含 893 个问题，并引入 Modality Presence Score (MPS) 衡量模态生成能力。测试五个前沿模型发现 MPS 仅 15.6 至 34.9，表明现有模型多模态能力严重不足。
正文节选
Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models Abstract Frontier language models are increasingly marketed as multimodal, or even omni systems that can perceive and respond across text, image, audio, video and document inputs and outputs. Existing evaluation frameworks, however, focus almost exclusively on bimodal understanding, typically text plus one other modality. Few benchmarks probe how models combine multiple non-text modalities within a single p