PonyMirrors/Pony.fm
1
0
Fork 0
mirror of https://github.com/Poniverse/Pony.fm.git synced 2024-11-24 14:08:00 +01:00
Code Issues Projects Releases Packages Wiki Activity

Added Crawl-Delay

Browse source
This commit is contained in:
Dagan Bronstein 2015-09-27 15:56:58 +03:00
parent 62731e2129
commit aa4350596e
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
public/robots.txt
View file

@ -1,2 +1,3 @@
User-agent: * User-agent: *
Disallow: Disallow:
Crawl-Delay: 10