Sipply
Daily Digest

Policy & Safety1 min readLast updated

OpenAI, Google, Microsoft, and Anthropic create new standard for opting out of scraping

1 outlet · 1 article — narrow sourcing (verify claims carefully)

Summary

In a significant move towards protecting content creators, OpenAI, Google, Microsoft, and Anthropic have joined forces to establish a new standard that allows publishers to opt out of AI scraping. This initiative introduces a shared policy token that can be integrated into the robots.txt file, enabling publishers to manage their preferences regarding AI training across multiple platforms. This collaborative effort aims to provide greater control to content owners over how their material is utilized in AI training processes.

Takeaways

  1. Major AI companies are uniting to create a standardized opt-out mechanism for scraping.
  2. The new system will allow publishers to control AI training preferences more effectively.
  3. This initiative reflects a growing recognition of the need for ethical AI practices.

Why it matters

This development underscores the importance of ethical considerations in AI training and the need for content creators to have a say in how their work is used.

Read as

PMs

For product managers, this new standard could influence product development strategies, particularly in how AI tools interact with external content.

Developers

Developers will need to adapt their systems to accommodate the new opt-out protocols, ensuring compliance with publisher preferences.

Students & job seekers

Students and job-seekers should be aware of these changes as they highlight the evolving landscape of AI ethics and the importance of content ownership in tech.

Covered sources

Source titles and excerpts stay in their original language for accuracy and traceability.

  • The Verge AI

    The biggest names in AI are backing a new way to opt out of scraping

    OpenAI, Google, Microsoft, and Anthropic are collaborating to implement a new standard that allows publishers to opt out of AI scraping. This approach will enable publishers to manage their AI training preferences across multiple companies using a shared policy token within their robots.txt file.