AI
One robots.txt line for AI training opt-outs: what OpenAI, Google, Microsoft and Anthropic agreed to
Four AI providers say they will honor a shared robots.txt token, __usage_ai-training, that states a training preference once for all of them. It is not live everywhere yet, so here is what it does, what it doesn't, and what to put in your robots.txt today.