返回全部动态

在 SageMaker HyperPod 上微调 GPT-OSS-20B 实现多语言推理

原标题:Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod

AWS Machine Learning Blog一手来源教程质量 71

AI 摘要

AWS 机器学习博客介绍在 Amazon SageMaker HyperPod 上对开源权重推理模型 GPT-OSS-20B 进行多语言推理微调。该模型默认用英语思考,在 50 例多语言测试中仅 22% 用目标语言推理(英语 100%,法/西/意 0%)。文章对比了监督微调(SFT)与 GRPO 强化学习:SFT 负责教会模型原本不具备的行为,GRPO 在模型已有一定概率产生目标行为时进一步优化,并给出基于 TRL、veRL、vLLM 和 LoRA 的训练栈与部署细节。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod GPT-OSS-20B is an open-weight reasoning model that thinks in English. Ask it to reason in French, German, Spanish, or Italian and it acknowledges the instruction, then produces its chain-of-thought in English anyway. On a 50-example multilingual reasoning test, the base model reasoned in the correct target language only 22 percent of the time. That 22 percent was almost entirely the English examples (English 100 perc


发布时间:2026-10-21 01:48
抓取时间:2026-10-21 02:37
来源机构:AWS
阅读原文aws.amazon.com