返回全部动态

Google 开源 ML Drift 跨平台 GPU 推理引擎

原标题:Google ML Drift Accelerates On-Device AI Inference Across Diverse GPUs

InfoQ AI ML and Data Engineering开源质量 70

AI 摘要

Google 开源了跨平台 GPU 计算引擎 ML Drift,采用 Apache 2.0 许可,支持 OpenGL ES、OpenCL、Metal 和 WebGPU,用于设备端 AI 推理。它是 LiteRT 的核心 GPU 加速引擎,通过统一着色器、五维张量和硬件特定优化简化多 GPU 硬件适配。Google 称其在 Gemma 模型上内存开销比 llama.cpp 和 MLX LM 低 12%,并已在 Chrome、YouTube Shorts、Photos 等应用中落地,同时将停止更新旧版 TensorFlow Lite GPU delegate。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Google has released ML Drift, an open-source, cross-platform GPU compute engine designed for on-device AI and machine learning inference. Licensed under Apache 2.0, it abstracts the complexities of different GPU hardware and low-level APIs, supporting OpenGL ES, OpenCL, Metal, and WebGPU. ML Drift is the core GPU acceleration engine that powers LiteRT. By open-sourcing it, Google is enabling developers to build custom graphics and inference runtimes for applications ranging from traditional comp


发布时间:2026-10-26 01:00
抓取时间:2026-10-26 01:25
来源机构:InfoQ
阅读原文infoq.com