Reverts: c00806846003c7b22ce72ffd842cea9340e9dbb5 Note: 895a6b6903c96bf644c573c8dff4fa98bfce119d where it was enabled for reading of noindex meta tags, but I don't think those ever worked anyway
895a6b6903c96bf644c573c8dff4fa98bfce119d - so the noindex can get read everywhere
The removed lines were added in case their lack was making sitemap not work, but that is a separate bug, so they are useless to keep.