# OpenAI, Google, Microsoft, and Anthropic create new standard for opting out of scraping

Published: 2026-10-30 · Updated: 2026-10-30 · Category: Regulation

Source page: https://www.sipply.dev/story/openai-google-microsoft-and-anthropic-create-new-standard-dc4510fb · 中文: https://www.sipply.dev/zh/story/openai-google-microsoft-and-anthropic-create-new-standard-dc4510fb

## Summary

In a significant move towards protecting content creators, OpenAI, Google, Microsoft, and Anthropic have joined forces to establish a new standard that allows publishers to opt out of AI scraping. This initiative introduces a shared policy token that can be integrated into the robots.txt file, enabling publishers to manage their preferences regarding AI training across multiple platforms. This collaborative effort aims to provide greater control to content owners over how their material is utilized in AI training processes.

## Key takeaways

- Major AI companies are uniting to create a standardized opt-out mechanism for scraping.
- The new system will allow publishers to control AI training preferences more effectively.
- This initiative reflects a growing recognition of the need for ethical AI practices.

## Why it matters

This development underscores the importance of ethical considerations in AI training and the need for content creators to have a say in how their work is used.

- **Product managers:** For product managers, this new standard could influence product development strategies, particularly in how AI tools interact with external content.
- **Developers:** Developers will need to adapt their systems to accommodate the new opt-out protocols, ensuring compliance with publisher preferences.
- **Students and job seekers:** Students and job-seekers should be aware of these changes as they highlight the evolving landscape of AI ethics and the importance of content ownership in tech.

## Sources

- [The biggest names in AI are backing a new way to opt out of scraping](https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt-out) (The Verge AI, 2026-10-30)

## 中文

### OpenAI、Google、Microsoft和Anthropic创建新的拒绝爬虫标准

为了保护内容创作者，OpenAI、Google、Microsoft和Anthropic联合建立了一项新标准，允许出版商拒绝AI爬虫。该倡议引入了一种共享政策令牌，可以集成到robots.txt文件中，使出版商能够管理他们在多个平台上对AI训练的偏好。这一合作努力旨在为内容所有者提供更大的控制权，决定他们的材料在AI训练过程中的使用方式。

**要点：**

- 主要AI公司联合创建标准化的拒绝爬虫机制。
- 新系统将使出版商更有效地控制AI训练偏好。
- 这一倡议反映了对伦理AI实践日益增长的认识。

**为什么重要：** 这一发展强调了AI训练中的伦理考量的重要性，以及内容创作者在其作品使用方式上的发言权。

---
Sipply: Sip AI News Simply. https://www.sipply.dev