Vaani-LID_v0:覆盖42种印度语言的语音识别前端
原标题:Language Identification for 42 Indian Languages: Opening New Frontiers in Indic Speech AI
AI 摘要
Hugging Face 与 ARTPARK-IISc 联合发布 Vaani-LID_v0,这是一个开源语音语言分类器,可识别印度 42 种语言,覆盖四个语系。该模型基于 Vaani 语料库预训练的 FastConformer 编码器,在冻结状态下跨域表现优于微调的 Whisper,并采用分层 softmax 提升泛化能力。研究还发现,对预训练编码器进行微调会降低跨域性能,而语系间的准确率差异显著,反映了语言相似度的影响。
正文节选
For Indian languages that decision has been hard to make well, because the models that could make it did not cover enough of the map. We are releasing Vaani-LID_v0, an open spoken language classifier that identifies 42 Indian languages across four language families, including many that no other speech model supports. It runs in four lines: from transformers import pipeline pipe = pipeline("audio-classification", model="ARTPARK-IISc/Vaani-LID_v0", trust_remote_code=True) print(pipe("path/to/16kHz