返回全部动态

同源不同判:文本生产条件干扰俄语机器生成文本检测

原标题:Same Origin, Different Verdicts: Text Production Conditions Confound Machine-Generated Text Detection in Russian

arXiv cs.CL一手来源研究质量 78

AI 摘要

该研究在俄语语料(1882 篇文档)上固定文本来源,仅改变任务措辞等生产条件,用四种机器文本检测方法(可解释指数、训练分类器、零样本指标、评判模型)打分。结果显示四种方法对同一条件变化的评分方向不一致,且仅用来源标识符这一单特征即可达到中位 AUROC 1.0000,说明来源类别与语料组装方式混淆。作者据此指出,机器文本检测分数反映的是特定测量系统与语料的属性,而非文本来源的直接测量。

以上摘要由 AI 生成,可能存在误差。事实请以原文为准。

正文节选

Same Origin, Different Verdicts: Text Production Conditions Confound Machine-Generated Text Detection in Russian Аннотация Automated assessment of whether a text was machine-generated is applied where the verdict carries a cost for the author, yet origin is a property of the production process, not an observable property of the text. The conditions under which a text was produced — how rigid the task was, the editorial rules, the platform template — push it in the same direction in which a gener


发布时间:2026-11-06 13:00
抓取时间:2026-11-05 13:16
来源机构:arXiv
阅读原文arxiv.org