removing site from indexing - deny robots, user auth to see home, http auth