I’ve Disallowed LLMs

As an experiment, I changed the robots.txt on this blog to disallow LLMs from crawling it. I saw a reference – lost now in my notes – to something like this: # Disallow AI training # OpenAI - https://platform.openai.com/docs/bots User-agent: GPTBot Disallow: / # Anthropic -…