ausglamr/blogs/templates/robots.txt
Hugh Rundle a79b771e6c
fix robots.txt
Serve robots.txt from django
2024-01-26 15:48:34 +11:00

14 lines
179 B
Plaintext

User-agent: AdsBot-Google
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: CCBot
Disallow: /