Mikaela
/
mikaela.github.io
mirror of https://github.com/mikaela/mikaela.github.io/
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

robots.txt: opt out of search engines for now

This commit is contained in:
Aminda Suomalainen 2019-06-03 21:57:03 +03:00
parent 1378cbb7ea
commit c90a96bd8a
No known key found for this signature in database
GPG Key ID: 0C207F07B2F32B67
1 changed files with 2 additions and 23 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

25
robots.txt
View File

@ -1,26 +1,5 @@
User-agent: *
Allow: /
Disallow: /404
Noindex: /404
Disallow: /bot
Noindex: /bot
Disallow: /channel
Noindex: /channel
Disallow: /links2
Noindex: /links2
Disallow: /irc/bot
Noindex: /irc/bot
Disallow: /irc/channel
Noindex: /irc/channel
Disallow: /irc/znc
Noindex: /irc/znc
Disallow: /r/
Noindex: /r/
Disallow: /or/
Noindex: /or/
Disallow: /ir/
Noindex: /ir/
Disallow: /reflinks
Noindex: /reflinks
Disallow: /
Noindex: /
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml