Mikaela/mikaela.github.io
1
0
Fork 0
mirror of https://github.com/mikaela/mikaela.github.io/ synced 2025-10-15 15:47:23 +02:00
Code Issues Projects Releases Wiki Activity

robots.txt: don't allow robots to go into the infinite loop of root

Browse Source
This commit is contained in:
Mikaela Suomalainen 2013-04-22 13:18:09 +03:00
parent 8bfc5ac886
commit 59c92bdfb3
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
robots.txt
View File

@ -0,0 +1,6 @@
# Robots, don't be stupid!
User-agent: *
Disallow /root
Disallow /root/*
Disallow */root/
Disallow */root/*