philomena/assets/static/robots.txt
2020-05-27 20:21:17 -04:00

9 lines
151 B
Text

User-agent: *
Crawl-delay: 0.5
Disallow: /profiles
Disallow: /api
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self