philomena/assets/static/robots.txt

15 lines
219 B
Text
Raw Permalink Normal View History

2020-05-28 02:21:17 +02:00
User-agent: *
Crawl-delay: 2
2020-05-28 02:21:17 +02:00
Allow: /images/*
Disallow: /images
Disallow: /tags
Disallow: /search
2020-05-28 02:21:17 +02:00
Disallow: /profiles
Disallow: /api
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self