Mikaela/mikaela.github.io
1
0
Fork 0
mirror of https://github.com/mikaela/mikaela.github.io/ synced 2024-11-22 12:09:28 +01:00
Code Issues Projects Releases Wiki Activity

robots.txt: add Noindex

Browse Source
This commit is contained in:
Aminda Suomalainen 2019-02-22 19:18:10 +02:00
parent ccf3021bb4
commit 294c14c91b
No known key found for this signature in database
GPG Key ID: 0C207F07B2F32B67
1 changed files with 10 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
robots.txt
View File

@ -1,13 +1,22 @@
User-agent: *
Allow: /
Disallow: /404
Noindex: /404
Disallow: /bot
Noindex: /bot
Disallow: /channel
Noindex: /channel
Disallow: /links2
Noindex: /links2
Disallow: /irc/bot
Noindex: /irc/bot
Disallow: /irc/channel
Noindex: /irc/channel
Disallow: /irc/znc
Noindex: /irc/znc
Disallow: /r/
Noindex: /r/
Disallow: /or/
Noindex: /or/
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml