CMSManhattan 发布 JiRack Ultra 32B CPU 三值量化模型
原标题:CMSManhattan/JiRackUltra_32b
AI 摘要
CMSManhattan 在 Hugging Face 发布 JiRack Ultra 32B(CPU)模型,基于 DeepSeek R1-32B 架构并引入 BitNet 风格的三值(1.58bit)量化与更新版 JiRack 分词器,新增路由、媒体、视觉、声音、工具调用和机器人等标签。模型提供 GGUF 量化版本,面向 CPU 推理优化,可用于 RAG 部署和工具调用场景,并附带 Docker 部署方式与 JiRack 编码 Agent IDE。
正文节选
--- language: - en - zh - ja - ko - fr - es - pt - de - it - ru - ar - vi - th tags: - text-generation - ternary - bitnet - 1.58bit - cpu - gguf - qwen2.5 - deepseek - deepseek-r1 - efficient - low-memory - jirack - web-ui - routing - tool-call - robotics license: mit --- # JiRack Ultra 32B (CPU) A fast and efficient 32B model optimized for CPU inference. The model was refactored with BitNet features and an updated tokenizer that includes new **Routing**, **Media**, **Vision**, **Sound**, **Too