Removed robots.txt and added gitignore