mirror of
https://github.com/Neetpone/ponepaste.git
synced 2025-03-11 14:10:06 +01:00
update: robots.txt
This commit is contained in:
parent
db316cd7cc
commit
d36886c3be
1 changed files with 2 additions and 20 deletions
|
@ -1,22 +1,4 @@
|
|||
User-agent: *
|
||||
Disallow: /admin/
|
||||
Disallow: /includes/
|
||||
Disallow: /theme/
|
||||
Disallow: /langs/
|
||||
Disallow: /tmp/
|
||||
|
||||
User-Agent: Googlebot
|
||||
Disallow: /
|
||||
Disallow: /admin/
|
||||
|
||||
User-Agent: Googlebot-Mobile
|
||||
Disallow: /
|
||||
Disallow: /admin/
|
||||
|
||||
User-Agent: Mediapartners-Google
|
||||
Disallow: /
|
||||
Disallow: /admin/
|
||||
|
||||
User-Agent: msnbot
|
||||
Disallow: /
|
||||
Disallow: /admin/
|
||||
Disallow: /captcha
|
||||
Disallow: /logout
|
||||
|
|
Loading…
Add table
Reference in a new issue