Limnoria/robots.txt

mirror of https://github.com/Mikaela/Limnoria.git
User-agent: *
Allow: /$
Allow: /*.html$
Allow: /robots.txt
Allow: /sitemap.xml
Disallow: /
Sitemap: https://supybot.mikaela.info/sitemap.xml
add robots.txt 2015-02-06 07:46:23 +01:00			`User-agent: *`
fix robots 2024-06-03 10:02:14 +02:00			`Allow: /$`
			`Allow: /*.html$`
			`Allow: /robots.txt`
			`Allow: /sitemap.xml`
robots.txt: Disallow & Noindex / 2021-06-06 17:30:29 +02:00			`Disallow: /`
add robots.txt 2015-02-06 07:46:23 +01:00			`Sitemap: https://supybot.mikaela.info/sitemap.xml`