Cloudflare 推出 Disallow AI Training 设置,兼顾搜索可见性与拒绝 AI 训练
原标题:Have it both ways: stay discoverable in search while disallowing AI training
AI 摘要
Cloudflare 推出新的 Disallow AI Training 设置,允许网站主在保留搜索引擎索引的同时拒绝同一爬虫将内容用于 AI 训练。Apple、Google 和 Microsoft 已承诺或已支持该设置。Cloudflare 还推出 Accountable 认定,要求爬虫运营方提供训练退出机制、AI 摘要退出机制、URL 级可见性,并保证退出训练不影响传统搜索。
正文节选
Without proper controls, website owners have long faced a difficult tradeoff: allow your content to be used for AI training, or risk losing discoverability in search. That tradeoff exists because some of the largest organizations on the Internet use mixed-use crawlers: a single crawler serving both search and AI training. Refuse one, and you refuse the other. Today, Cloudflare is announcing a new Disallow AI Training setting that lets you easily stay indexed for search while refusing to let that