Falcon-Emirati-7B:让大模型学会阿联酋方言与文化细微差别
原标题:Falcon-Emirati: When an LLM Learns the Dialect, the Culture, and the Nuance
AI 摘要
Hugging Face 发布 Falcon-Emirati-7B,一个基于 Falcon-H1-Arabic 的阿拉伯语方言专用模型,专注于理解和生成阿联酋阿拉伯语(海湾方言)。该模型通过爬取原生方言文本、MSA 文化资料和受规则约束的合成数据构建数据管线,并实验了方言数据注入比例与训练阶段。其目标是让模型掌握方言词汇、语气及背后的文化语境,而非仅做字面翻译。
正文节选
Arabic is really a family of languages living under one name. Modern Standard Arabic is what you read in the news or a textbook, but it's rarely how people actually talk to each other. In the UAE, day-to-day conversation, humor, negotiation, and storytelling happen in Emirati Arabic, a Gulf dialect with its own vocabulary, its own rhythm, and a culture wrapped tightly around it. Emirati poetry, especially nabati poetry, along with proverbs and short anecdotes, carries meaning that doesn't surviv