Remove search engine spiders from some areas temporarily pending #241 and display name issues implementation