mikaela.github.io/robots.txt

User-agent: *
Allow: /
Allow: /$
Allow: /index.html
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml
add robots.txt 2015-02-06 07:39:24 +01:00			`User-agent: *`
robots.txt: remove Disallow so noindex can be read 2020-11-23 12:28:35 +01:00			`Allow: /`
robots.txt: allow /$ & /index.html 2019-12-08 15:48:38 +01:00			`Allow: /$`
			`Allow: /index.html`
fix 82f87bb41fae166f4a8a5ca670fd139b6fe5bca8 2015-02-06 07:46:58 +01:00			`Sitemap: https://mikaela.info/sitemap.xml`
robots.txt: Disallow & Deny reflinks as search engines are unhappy 2019-03-09 13:34:48 +01:00			`Sitemap: https://mikaela.info/sitemaps.xml`