philomena/assets/static/robots.txt

mirror of https://github.com/philomena-dev/philomena.git synced 2024-11-24 04:27:59 +01:00
User-agent: *
Crawl-delay: 0.5

Disallow: /profiles
Disallow: /api

Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self
robots config 2020-05-28 02:21:17 +02:00			`User-agent: *`
			`Crawl-delay: 0.5`

			`Disallow: /profiles`
			`Disallow: /api`

			`Disallow: /harming/humans`
			`Disallow: /ignoring/human/orders`
			`Disallow: /harm/to/self`