added Gemfile.lock to .gitignore
modified robots.txt to disallow web crawlers from all agents