TGI v3.3.4 发布：修复 Neuron 并支持 Gemma3

AI 摘要

Text Generation Inference 发布 v3.3.4 版本，修复了 Neuron 模型导出时 batch_size 为 1 的问题，并增加了对 Gaudi 上 Gemma3 文本和 VLM 模型的初步支持。该版本还包含其他后端修复。

正文节选

Fix for Neuron models exported with batch_size 1. ## What's Changed * [gaudi] gemma3 text and vlm model intial support. need to add sliding window … by @sywangyi in https://github.com/huggingface/text-generation-inference/pull/3270 * Neuron backend fix by @dacorvo in https://github.com/huggingface/text-generation-inference/pull/3273 **Full Changelog**: https://github.com/huggingface/text-generation-inference/compare/v3.3.3...v3.3.4

发布时间：2025-06-19 18:00

抓取时间：2026-08-02 00:31

来源机构：Hugging Face