Mikaela/mikaela.github.io
1
0
Fork 0
mirror of https://github.com/mikaela/mikaela.github.io/ synced 2025-02-19 23:10:46 +01:00
Code Issues Projects Releases Wiki Activity
mikaela.github.io/robots.txt

11 lines
237 B
Plaintext
Raw Normal View History

add robots.txt
2015-02-06 08:39:24 +02:00
User-agent: *
Allow: /
robots.txt: be more strict
2015-04-26 20:24:28 +03:00
Disallow: /404
Disallow: /bot
Disallow: /channel
pages/links2: hidden linklist on minorities Closes #50
2015-06-12 19:58:09 +03:00
Disallow: /links2
r: redirects elsewhere
2015-05-01 10:23:02 +03:00
Disallow: /r/
fix 82f87bb41fae166f4a8a5ca670fd139b6fe5bca8
2015-02-06 08:46:58 +02:00
Sitemap: https://mikaela.info/sitemap.xml
robots.txt: add Tumblr sitemap [SKIP CI]
2015-04-29 08:24:54 +03:00
Sitemap: http://tumblr.mikaela.info/sitemap.xml
add sitemaps.xml && update robots.txt & README
2015-05-02 10:34:18 +03:00
Sitemap: https://mikaela.info/sitemaps.xml
Reference in New Issue Copy Permalink