philomena/assets/static/robots.txt

14 lines
219 B
Text

User-agent: *
Crawl-delay: 2
Allow: /images/*
Disallow: /images
Disallow: /tags
Disallow: /search
Disallow: /profiles
Disallow: /api
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self