Google 开源 ML Drift 跨平台 GPU 推理引擎
原标题:Google ML Drift Accelerates On-Device AI Inference Across Diverse GPUs
AI 摘要
Google 开源了跨平台 GPU 计算引擎 ML Drift,采用 Apache 2.0 许可,支持 OpenGL ES、OpenCL、Metal 和 WebGPU,用于设备端 AI 推理。它是 LiteRT 的核心 GPU 加速引擎,通过统一着色器、五维张量和硬件特定优化简化多 GPU 硬件适配。Google 称其在 Gemma 模型上内存开销比 llama.cpp 和 MLX LM 低 12%,并已在 Chrome、YouTube Shorts、Photos 等应用中落地,同时将停止更新旧版 TensorFlow Lite GPU delegate。
正文节选
Google has released ML Drift, an open-source, cross-platform GPU compute engine designed for on-device AI and machine learning inference. Licensed under Apache 2.0, it abstracts the complexities of different GPU hardware and low-level APIs, supporting OpenGL ES, OpenCL, Metal, and WebGPU. ML Drift is the core GPU acceleration engine that powers LiteRT. By open-sourcing it, Google is enabling developers to build custom graphics and inference runtimes for applications ranging from traditional comp