PrismML 将微型 LLM 带入高通芯片智能眼镜
原标题：PrismML brings its tiny LLMs to Qualcomm-powered smart glasses
AI 摘要
由加州理工学院研究人员创立、UC Berkeley 的 Ion Stoica 担任顾问的 AI 实验室 PrismML，为搭载高通 Snapdragon 芯片的智能眼镜开发了其微型语言模型版本。在高通 Snapdragon 峰会上，高通展示了 PrismML 的 1-bit Bonsai LLM，可在基于 Snapdragon AR1 Gen 1 平台的 AI 智能眼镜上本地运行。该智能眼镜版本是一个 20 亿参数、面向视觉和语言调优的模型，可将大模型压缩约 4 倍并保留几乎全部基准性能。PrismML 的目标是推动可在设备上运行的开源权重 AI，但目前尚无搭载其模型的智能眼镜产品发布。
正文节选
The AI Lab PrismML — founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica — has created a version of its tiny language models for smart glasses running on Qualcomm’s Snapdragon chips. On Wednesday, at Qualcomm’s Snapdragon Summit, the chipmaker showcased PrismML’s 1-bit Bonsai LLM, which can be run locally on AI smart glasses built on the Snapdragon AR1 Gen 1 Platform. As TechCrunch previously reported, PrismML’s claim to fame is that it shrinks larger models substantially (in