tweak to pages marked robots and sitemap accessible