Updated robots.txt to allow the share pages to be crawled.