mikaela.github.io/robots.txt

User-agent: *
Allow: /$
Allow: /index.html
Disallow: /
Noindex: /
Sitemap: https://mikaela.info/sitemap.xml
Sitemap: https://mikaela.info/sitemaps.xml
add robots.txt 2015-02-06 07:39:24 +01:00			`User-agent: *`
robots.txt: allow /$ & /index.html 2019-12-08 15:48:38 +01:00			`Allow: /$`
			`Allow: /index.html`
robots.txt: opt out of search engines for now 2019-06-03 20:57:03 +02:00			`Disallow: /`
			`Noindex: /`
fix 82f87bb41fae166f4a8a5ca670fd139b6fe5bca8 2015-02-06 07:46:58 +01:00			`Sitemap: https://mikaela.info/sitemap.xml`
robots.txt: Disallow & Deny reflinks as search engines are unhappy 2019-03-09 13:34:48 +01:00			`Sitemap: https://mikaela.info/sitemaps.xml`