robots.txt: remove empty lines

Apparently some robots (or at least robots.txt validators) don't like
them.
This commit is contained in:
Aminda Suomalainen 2015-04-26 20:30:57 +03:00
parent 083bfcc98a
commit 5df02aed87

View File

@ -1,8 +1,6 @@
User-agent: * User-agent: *
Allow: / Allow: /
Disallow: /404 Disallow: /404
Disallow: /bot Disallow: /bot
Disallow: /channel Disallow: /channel
Sitemap: https://mikaela.info/sitemap.xml Sitemap: https://mikaela.info/sitemap.xml