Compare commits

...

2 Commits

Author SHA1 Message Date
4e97e1679c
robots.txt: disallow/noindex blog posts pre 2018, r/, or/ & n/
Yes, I know Noindex is deprecated
2022-11-10 12:20:08 +02:00
9700a2c3a4
bundle update 2022-11-10 12:19:16 +02:00
2 changed files with 18 additions and 2 deletions

View File

@ -21,7 +21,7 @@ GEM
em-websocket (0.5.3)
eventmachine (>= 0.12.9)
http_parser.rb (~> 0)
ethon (0.15.0)
ethon (0.16.0)
ffi (>= 1.15.0)
eventmachine (1.2.7)
execjs (2.8.1)
@ -250,7 +250,7 @@ GEM
unf_ext (0.0.8.2)
unicode-display_width (1.8.0)
webrick (1.7.0)
zeitwerk (2.6.1)
zeitwerk (2.6.6)
PLATFORMS
x86_64-linux

View File

@ -2,9 +2,25 @@ User-agent: *
Allow: /
Allow: /$
Allow: /index.html
Disallow: /blog/english/2015/
Disallow: /blog/english/2016/
Disallow: /blog/finnish/2015/
Disallow: /blog/finnish/2016/
Disallow: /blog/finnish/2017/
Disallow: /txt/
Disallow: /php/
Disallow: /r/
Disallow: /or/
Disallow: /n/
Noindex: /blog/english/2015/
Noindex: /blog/english/2016/
Noindex: /blog/finnish/2015/
Noindex: /blog/finnish/2016/
Noindex: /blog/finnish/2017/
Noindex: /txt/
Noindex: /php/
Noindex: /r/
Noindex: /or/
Noindex: /n/
Sitemap: https://www.aminda.eu/sitemap.xml
Sitemap: https://www.aminda.eu/sitemaps.xml