Fixed robots.txt to allow crawling, added meta elements for indexing.