robots.txt: don't allow robots to go into the infinite loop of root

This commit is contained in:
Mikaela Suomalainen 2013-04-22 13:18:09 +03:00
parent 8bfc5ac886
commit 59c92bdfb3

View File

@ -0,0 +1,6 @@
# Robots, don't be stupid!
User-agent: *
Disallow /root
Disallow /root/*
Disallow */root/
Disallow */root/*