Mikaela/mikaela.github.io
1
0
Fork 0
mirror of https://github.com/mikaela/mikaela.github.io/ synced 2024-11-22 12:09:28 +01:00
Code Issues Projects Releases Wiki Activity

robots.txt: be more strict

Browse Source
This commit is contained in:
Aminda Suomalainen 2015-04-26 20:24:28 +03:00
parent 354683729f
commit 083bfcc98a
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
robots.txt
View File

@ -1,8 +1,8 @@
User-agent: *
Allow: /
Disallow: /404.html
Disallow: /bot.html
Disallow: /channel.html
Disallow: /404
Disallow: /bot
Disallow: /channel
Sitemap: https://mikaela.info/sitemap.xml