Desert Ant Labs 发布端侧标题生成模型 Title
原标题:desert-ant-labs/title
AI 摘要
Desert Ant Labs 在 Hugging Face 发布名为 Title 的端侧文本标题与摘要生成模型,基于 IBM Granite 4.0 350M 微调,采用 6-bit 量化权重,仅支持 Apple 平台并通过 MLX 在 GPU 上运行。官方称其在 GPU 上生成文本比 Neural Engine 快 5.7-8.3 倍,Core ML 版本在首 token 时间、吞吐、加载时间和内存上均落后,因此不计划发布。模型以源码可见许可证提供,多数应用免费、规模化商用需付费授权。
正文节选
--- license: other license_name: desert-ant-labs-source-available license_link: https://license.desertant.com/ language: - multilingual tags: - text - text-generation - summarization - on-device - mlx - multilingual pipeline_tag: text-generation --- <!-- Generated from docs/models/title.md in https://github.com/Desert-Ant-Labs/desert-ant-core. Edit that file: changes made here are overwritten. --> # Title Suggest a title and description for any text. On-device titles and descriptions: a shor