mikaela.github.io/robots.txt

mirror of https://github.com/mikaela/mikaela.github.io/ synced 2024-11-15 00:19:25 +01:00
# robots.txt for https://mkaysi.github.io/
User-agent: *
Disallow: /pages/photos.html
Disallow: /pages/photos.html.md
Disallow: /pages/ext/
Some changes: * Restore whatever those google files were. * Add GA to index and identifying. * add photos page * add robots.txt * denies photos * denies pages/ext/ * what else? 2014-06-08 21:50:33 +02:00			`# robots.txt for https://mkaysi.github.io/`
			`User-agent: *`
			`Disallow: /pages/photos.html`
			`Disallow: /pages/photos.html.md`
robots.txt: remove last comment. 2014-06-08 21:55:52 +02:00			`Disallow: /pages/ext/`