mikaela.github.io/robots.txt

13 lines
250 B
Plaintext

User-agent: *
Allow: /
Disallow: /404
Disallow: /bot
Disallow: /channel
Disallow: /links2
Disallow: /irc/bot
Disallow: /irc/channel
Disallow: /irc/znc
Disallow: /r/
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml