mikaela.github.io/robots.txt

User-agent: *
Allow: /
Allow: /$
Allow: /index.html
Disallow: /txt/
Disallow: /php/
Noindex: /txt/
Noindex: /php/
Sitemap: https://www.aminda.eu/sitemap.xml
Sitemap: https://www.aminda.eu/sitemaps.xml
add robots.txt 2015-02-06 07:39:24 +01:00			`User-agent: *`
robots.txt: remove Disallow so noindex can be read 2020-11-23 12:28:35 +01:00			`Allow: /`
robots.txt: allow /$ & /index.html 2019-12-08 15:48:38 +01:00			`Allow: /$`
			`Allow: /index.html`
robots.txt: Disallow /txt/ and /php/ as they don't contain HTML noindex 2020-11-23 12:39:27 +01:00			`Disallow: /txt/`
			`Disallow: /php/`
			`Noindex: /txt/`
			`Noindex: /php/`
transfer domains 2022-03-06 13:37:23 +01:00			`Sitemap: https://www.aminda.eu/sitemap.xml`
			`Sitemap: https://www.aminda.eu/sitemaps.xml`