Mikaela/mikaela.github.io
1
0
Fork 0
mirror of https://github.com/mikaela/mikaela.github.io/ synced 2024-11-25 13:59:25 +01:00
Code Issues Projects Releases Wiki Activity

fix robots.txt

Browse Source 
I somehow misremembered that you Allow and Deny while in reality you
Allow and Disallow.
This commit is contained in:
Aminda Suomalainen 2015-04-26 20:09:14 +03:00
parent 23aac36722
commit 354683729f
1 changed files with 3 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
robots.txt
View File

@ -1,10 +1,8 @@
User-agent: * User-agent: *
Allow: / Allow: /
# I prefer search engines to not advertise these pages even if you can find Disallow: /404.html
# them here or in `_config.yml`. Disallow: /bot.html
Deny: /404.html Disallow: /channel.html
Deny: /bot.html
Deny: /channel.html
Sitemap: https://mikaela.info/sitemap.xml Sitemap: https://mikaela.info/sitemap.xml