OpenAI, Google, Microsoft and Anthropic to Adopt IETF‑Proposed Policy Token for AI Scraping Opt‑Out

OpenAI, Google, Microsoft and Anthropic announced they will support a new IETF‑proposed “policy token” that publishers can embed in their robots.txt files to signal AI‑training preferences. The token allows a single opt‑out setting that applies across multiple AI companies, eliminating the need for publishers to configure each crawler separately. Anthropic has already adopted the signal; Google and Microsoft plan to support it next year, while OpenAI will implement it in the coming months. Microsoft will also offer granular controls to opt out of AI training or AI grounding, though sites will still appear in Bing search results regardless of preferences.