AI Business LensTHE BUSINESS OF AI, FOR PEOPLE WHO TEACH IT OR LEARN FROM IT
The Verge · October 31, 2026 · On the brief until November 14, 2026

The biggest names in AI are backing a new way to opt out of scraping

Intellectual Property LawMedia StudiesJournalism
THE AI ANGLE
Scraping online publications to train models

OpenAI, Google, Microsoft, and Anthropic agreed to support a shared standard for website scraping opt-outs. Publishers can place a single policy token in their robots.txt files to block AI training across multiple companies at once. This system allows outlets to restrict model training without losing their visibility in regular search engine results.

Summary written by AI Business Lens with an AI model from the article at theverge.com. It is not the article, and the publisher has not reviewed it. For publishers.

THE TEACHING ANGLE
The framework relies on voluntary compliance by tech companies, leaving publishers exposed if firms endorse the idea without promising to honor the code.

Read the original at theverge.com   Generate teaching or study materials

Instructors get discussion guides, assignments, and mini-cases. Students and readers get a plain summary, points to raise, an exercise, and a self-check. All built from the full article. A free account saves stories and gives you three generations. Stories stay on the brief for 14 days. After that this page keeps the link to the original.

More in Intellectual Property Law