OpenAI Will Honor Shared robots.txt Signals to Let Sites Communicate AI‑Training Preferences

OpenAI announced that it will respect a shared robots.txt signal, allowing website operators to specify their preferences for AI training data. The signal lets site administrators indicate which content should or should not be used by participating AI providers, simplifying the process of managing data usage for training large language models. This change is intended to give web owners more control over how their content is leveraged in AI development and to streamline compliance with data‑usage policies.