eleventy-homepage/_src/robots.txt

17 lines
431 B
Plaintext

#SOURCE: <https://www.didiermary.fr/bloquer-ai-bots-chatgpt-openai/>
# AI crawlers
User-agent: Amazonbot 🆕
User-agent: anthropic-ai
User-agent: Applebot 🆕
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: cohere-ai
User-agent: Diffbot 🆕
User-Agent: FacebookBot
User-agent: Google-Extended
User-agent: GPTBot
User-agent: Omgili1
User-agent: PerplexityBot 🆕
User-agent: YouBot 🆕
Disallow: /