VLANeXt:面向机器人研究的简单开源代码库
原标题:VLANeXt: A Simple and Research-Oriented Codebase for Robotics Research
AI 摘要
Hugging Face 博客发布了关于 VLANeXt 的介绍,这是一个面向机器人研究的开源代码库,旨在系统性地探索 VLA(视觉-语言-动作)模型的设计空间。作者从 RT-2 风格的基线出发,通过超过 500 个实验,提炼出构建强 VLA 模型的实用配方,并扩展了代码库以支持多种模型规模和训练目标。该工作基于 ICML 论文,并提供了多个基线模型,以促进机器人基础模型的研究。
正文节选
Vision-language-action (VLA) models are becoming one of the most exciting directions in robotics. The idea is simple but powerful: use a vision-language model (VLM) to connect what a robot sees with a language instruction, then enable it to take actions in the physical world. However, the field faces a fundamental challenge. The current VLA field is advancing rapidly, but it is also becoming increasingly fragmented. Different papers use different backbones, different policy heads, different acti