Removed default index.html and hid site from web-crawlers