mikaela.github.io/robots.txt

25 lines
452 B
Plaintext

User-agent: *
Allow: /
Disallow: /404
Noindex: /404
Disallow: /bot
Noindex: /bot
Disallow: /channel
Noindex: /channel
Disallow: /links2
Noindex: /links2
Disallow: /irc/bot
Noindex: /irc/bot
Disallow: /irc/channel
Noindex: /irc/channel
Disallow: /irc/znc
Noindex: /irc/znc
Disallow: /r/
Noindex: /r/
Disallow: /or/
Noindex: /or/
Disallow: /reflinks
Noindex: /reflinks
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml