mikaela.github.io/robots.txt
Mikaela Suomalainen 5df02aed87 robots.txt: remove empty lines
Apparently some robots (or at least robots.txt validators) don't like
them.
2015-04-26 20:30:57 +03:00

7 lines
114 B
Plaintext

User-agent: *
Allow: /
Disallow: /404
Disallow: /bot
Disallow: /channel
Sitemap: https://mikaela.info/sitemap.xml